Nov 28 20:06:46 user nova-compute[75571]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75571) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 20:06:46 user nova-compute[75571]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75571) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 20:06:46 user nova-compute[75571]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75571) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 20:06:46 user nova-compute[75571]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:06:47 user nova-compute[75571]: INFO nova.virt.driver [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 28 20:06:47 user nova-compute[75571]: INFO nova.compute.provider_config [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] Acquiring lock "singleton_lock" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] Acquired lock "singleton_lock" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] Releasing lock "singleton_lock" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] Full set of CONF: {{(pid=75571) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ******************************************************************************** {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] Configuration options gathered from: {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ================================================================================ {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] allow_resize_to_same_host      = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] arq_binding_timeout            = 300 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] backdoor_port                  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] backdoor_socket                = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] block_device_allocate_retries  = 300 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] block_device_allocate_retries_interval = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cert                           = self.pem {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] compute_monitors               = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] config_dir                     = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] config_drive_format            = iso9660 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] config_source                  = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] console_host                   = user {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] control_exchange               = nova {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cpu_allocation_ratio           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] daemon                         = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] debug                          = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] default_access_ip_network_name = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] default_availability_zone      = nova {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] default_ephemeral_format       = ext4 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] default_green_pool_size        = 1000 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] default_schedule_zone          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] disk_allocation_ratio          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] enable_new_services            = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] enabled_ssl_apis               = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] flat_injected                  = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] force_config_drive             = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] force_raw_images               = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] graceful_shutdown_timeout      = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] heal_instance_info_cache_interval = 60 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] host                           = user {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] instance_build_timeout         = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] instance_delete_interval       = 300 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] instance_name_template         = instance-%08x {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] instance_usage_audit           = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] instance_usage_audit_period    = month {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] internal_service_availability_zone = internal {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] key                            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] live_migration_retry_count     = 30 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] log_config_append              = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] log_dir                        = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] log_file                       = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] log_options                    = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] log_rotate_interval            = 1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] log_rotate_interval_type       = days {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] log_rotation_type              = none {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] long_rpc_timeout               = 1800 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] max_concurrent_builds          = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] max_concurrent_live_migrations = 1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] max_concurrent_snapshots       = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] max_local_block_devices        = 3 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] max_logfile_count              = 30 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] max_logfile_size_mb            = 200 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] maximum_instance_delete_attempts = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] metadata_listen                = 0.0.0.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] metadata_listen_port           = 8775 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] metadata_workers               = 3 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] migrate_max_retries            = -1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] mkisofs_cmd                    = genisoimage {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] my_ip                          = 10.0.0.210 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] network_allocate_retries       = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] osapi_compute_listen_port      = 8774 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] osapi_compute_unique_server_name_scope =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] osapi_compute_workers          = 3 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] password_length                = 12 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] periodic_enable                = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] periodic_fuzzy_delay           = 60 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] pointer_model                  = ps2mouse {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] preallocate_images             = none {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] publish_errors                 = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] pybasedir                      = /opt/stack/nova {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ram_allocation_ratio           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] rate_limit_burst               = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] rate_limit_except_level        = CRITICAL {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] rate_limit_interval            = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] reboot_timeout                 = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] reclaim_instance_interval      = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] record                         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] reimage_timeout_per_gb         = 60 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] report_interval                = 120 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] rescue_timeout                 = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] reserved_host_cpus             = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] reserved_host_disk_mb          = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] reserved_host_memory_mb        = 512 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] reserved_huge_pages            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] resize_confirm_window          = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] resize_fs_using_block_device   = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] resume_guests_state_on_host_boot = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] rpc_response_timeout           = 60 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] run_external_periodic_tasks    = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] running_deleted_instance_action = reap {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] running_deleted_instance_timeout = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] scheduler_instance_sync_interval = 120 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] service_down_time              = 720 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] servicegroup_driver            = db {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] shelved_offload_time           = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] shelved_poll_interval          = 3600 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] shutdown_timeout               = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] source_is_ipv6                 = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ssl_only                       = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] state_path                     = /opt/stack/data/nova {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] sync_power_state_interval      = 600 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] sync_power_state_pool_size     = 1000 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] syslog_log_facility            = LOG_USER {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] tempdir                        = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] timeout_nbd                    = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] transport_url                  = **** {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] update_resources_interval      = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] use_cow_images                 = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] use_eventlog                   = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] use_journal                    = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] use_json                       = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] use_rootwrap_daemon            = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] use_stderr                     = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] use_syslog                     = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vcpu_pin_set                   = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vif_plugging_is_fatal          = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vif_plugging_timeout           = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] virt_mkfs                      = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] volume_usage_poll_interval     = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] watch_log_file                 = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] web                            = /usr/share/spice-html5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_concurrency.disable_process_locking = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.auth_strategy              = keystone {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.compute_link_prefix        = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.dhcp_domain                = novalocal {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.enable_instance_password   = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.glance_link_prefix         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.instance_list_per_project_cells = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.list_records_by_skipping_down_cells = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.local_metadata_per_cell    = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.max_limit                  = 1000 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.metadata_cache_expiration  = 15 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.neutron_default_tenant_id  = default {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.use_forwarded_for          = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.use_neutron_default_nets   = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.vendordata_dynamic_targets = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.vendordata_jsonfile_path   = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.backend_argument         = **** {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.config_prefix            = cache.oslo {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.dead_timeout             = 60.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.debug_cache_backend      = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.enable_retry_client      = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.enable_socket_keepalive  = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.enabled                  = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.expiration_time          = 600 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.hashclient_retry_attempts = 2 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.memcache_dead_retry      = 300 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.memcache_password        =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.memcache_sasl_enabled    = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.memcache_username        =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.proxies                  = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.retry_attempts           = 2 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.retry_delay              = 0.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.socket_keepalive_count   = 1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.socket_keepalive_idle    = 1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.socket_keepalive_interval = 1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.tls_allowed_ciphers      = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.tls_cafile               = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.tls_certfile             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.tls_enabled              = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cache.tls_keyfile              = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cinder.auth_section            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cinder.auth_type               = password {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cinder.cafile                  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cinder.certfile                = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cinder.collect_timing          = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cinder.cross_az_attach         = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cinder.debug                   = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cinder.endpoint_template       = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cinder.http_retries            = 3 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cinder.insecure                = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cinder.keyfile                 = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cinder.os_region_name          = RegionOne {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cinder.split_loggers           = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cinder.timeout                 = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] compute.cpu_dedicated_set      = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] compute.cpu_shared_set         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] compute.image_type_exclude_list = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] compute.resource_provider_association_refresh = 300 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] compute.shutdown_retry_interval = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] conductor.workers              = 3 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] console.allowed_origins        = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] console.ssl_ciphers            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] console.ssl_minimum_version    = default {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] consoleauth.token_ttl          = 600 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.cafile                  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.certfile                = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.collect_timing          = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.connect_retries         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.connect_retry_delay     = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.endpoint_override       = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.insecure                = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.keyfile                 = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.max_version             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.min_version             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.region_name             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.service_name            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.service_type            = accelerator {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.split_loggers           = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.status_code_retries     = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.status_code_retry_delay = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.timeout                 = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] cyborg.version                 = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.backend               = sqlalchemy {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.connection            = **** {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.connection_debug      = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.connection_parameters =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.connection_recycle_time = 3600 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.connection_trace      = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.db_inc_retry_interval = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.db_max_retries        = 20 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.db_max_retry_interval = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.db_retry_interval     = 1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.max_overflow          = 50 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.max_pool_size         = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.max_retries           = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.mysql_wsrep_sync_wait = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.pool_timeout          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.retry_interval        = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.slave_connection      = **** {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] database.sqlite_synchronous    = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.backend           = sqlalchemy {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.connection        = **** {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.connection_debug  = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.connection_parameters =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.connection_recycle_time = 3600 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.connection_trace  = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.db_inc_retry_interval = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.db_max_retries    = 20 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.db_max_retry_interval = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.db_retry_interval = 1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.max_overflow      = 50 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.max_pool_size     = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.max_retries       = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.pool_timeout      = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.retry_interval    = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.slave_connection  = **** {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] api_database.sqlite_synchronous = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] devices.enabled_mdev_types     = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ephemeral_storage_encryption.enabled = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.api_servers             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.cafile                  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.certfile                = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.collect_timing          = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.connect_retries         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.connect_retry_delay     = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.debug                   = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.default_trusted_certificate_ids = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.enable_certificate_validation = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.enable_rbd_download     = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.endpoint_override       = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.insecure                = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.keyfile                 = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.max_version             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.min_version             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.num_retries             = 3 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.rbd_ceph_conf           =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.rbd_connect_timeout     = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.rbd_pool                =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.rbd_user                =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.region_name             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.service_name            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.service_type            = image {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.split_loggers           = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.status_code_retries     = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.status_code_retry_delay = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.timeout                 = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.verify_glance_signatures = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] glance.version                 = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] guestfs.debug                  = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.config_drive_cdrom      = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.config_drive_inject_password = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.enable_remotefx         = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.instances_path_share    =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.limit_cpu_features      = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.use_multipath_io        = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.vswitch_name            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] mks.enabled                    = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] image_cache.manager_interval   = 2400 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] image_cache.precache_concurrency = 1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] image_cache.remove_unused_base_images = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] image_cache.subdirectory_name  = _base {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.api_max_retries         = 60 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.api_retry_interval      = 2 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.auth_section            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.auth_type               = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.cafile                  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.certfile                = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.collect_timing          = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.conductor_group         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.connect_retries         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.connect_retry_delay     = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.endpoint_override       = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.insecure                = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.keyfile                 = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.max_version             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.min_version             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.peer_list               = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.region_name             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.serial_console_state_timeout = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.service_name            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.service_type            = baremetal {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.split_loggers           = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.status_code_retries     = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.status_code_retry_delay = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.timeout                 = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ironic.version                 = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] key_manager.fixed_key          = **** {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.barbican_api_version  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.barbican_endpoint     = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.barbican_endpoint_type = public {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.barbican_region_name  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.cafile                = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.certfile              = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.collect_timing        = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.insecure              = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.keyfile               = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.number_of_retries     = 60 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.retry_delay           = 1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.send_service_user_token = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.split_loggers         = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.timeout               = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.verify_ssl            = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican.verify_ssl_path       = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican_service_user.auth_section = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican_service_user.auth_type = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican_service_user.cafile   = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican_service_user.certfile = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican_service_user.collect_timing = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican_service_user.insecure = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican_service_user.keyfile  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican_service_user.split_loggers = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] barbican_service_user.timeout  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.approle_role_id          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.approle_secret_id        = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.cafile                   = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.certfile                 = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.collect_timing           = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.insecure                 = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.keyfile                  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.kv_mountpoint            = secret {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.kv_path                  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.kv_version               = 2 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.namespace                = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.root_token_id            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.split_loggers            = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.ssl_ca_crt_file          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.timeout                  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.use_ssl                  = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.auth_section          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.auth_type             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.cafile                = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.certfile              = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.collect_timing        = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.connect_retries       = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.connect_retry_delay   = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.endpoint_override     = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.insecure              = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.keyfile               = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.max_version           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.min_version           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.region_name           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.service_name          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.service_type          = identity {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.split_loggers         = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.status_code_retries   = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.status_code_retry_delay = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.timeout               = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] keystone.version               = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.connection_uri         =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.cpu_mode               = custom {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: WARNING oslo_config.cfg [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.cpu_power_governor_high = performance {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.cpu_power_management   = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.device_detach_attempts = 8 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.device_detach_timeout  = 20 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.disk_cachemodes        = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.disk_prefix            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.enabled_perf_events    = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.file_backed_memory     = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.gid_maps               = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.hw_disk_discard        = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.hw_machine_type        = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.images_rbd_pool        = rbd {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.images_type            = default {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.images_volume_group    = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.inject_key             = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.inject_partition       = -2 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.inject_password        = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.iscsi_iface            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.iser_use_multipath     = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.live_migration_downtime = 500 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.live_migration_inbound_addr = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.live_migration_scheme  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.live_migration_timeout_action = abort {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.live_migration_tunnelled = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: WARNING oslo_config.cfg [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 28 20:06:47 user nova-compute[75571]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 28 20:06:47 user nova-compute[75571]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 28 20:06:47 user nova-compute[75571]: and ``live_migration_inbound_addr`` respectively.
Nov 28 20:06:47 user nova-compute[75571]: ).  Its value may be silently ignored in the future.
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.live_migration_with_native_tls = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.max_queues             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.nfs_mount_options      = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.num_pcie_ports         = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.pmem_namespaces        = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.quobyte_client_cfg     = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.rbd_secret_uuid        = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.rbd_user               = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.rescue_image_id        = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.rescue_kernel_id       = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.rx_queue_size          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.smbfs_mount_options    =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.snapshot_compression   = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.snapshot_image_format  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.sparse_logical_volumes = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.swtpm_enabled          = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.swtpm_group            = tss {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.swtpm_user             = tss {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.sysinfo_serial         = unique {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.tb_cache_size          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.tx_queue_size          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.uid_maps               = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.use_virtio_for_bridges = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.virt_type              = kvm {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.volume_clear           = zero {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.volume_clear_size      = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.volume_use_multipath   = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.vzstorage_cache_path   = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.auth_section           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.auth_type              = password {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.cafile                 = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.certfile               = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.collect_timing         = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.connect_retries        = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.connect_retry_delay    = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.default_floating_pool  = public {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.endpoint_override      = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.extension_sync_interval = 600 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.http_retries           = 3 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.insecure               = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.keyfile                = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.max_version            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.min_version            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.ovs_bridge             = br-int {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.physnets               = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.region_name            = RegionOne {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.service_metadata_proxy = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.service_name           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.service_type           = network {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.split_loggers          = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.status_code_retries    = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.status_code_retry_delay = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.timeout                = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] neutron.version                = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] notifications.bdms_in_notifications = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] notifications.default_level    = INFO {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] notifications.notification_format = unversioned {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] notifications.notify_on_state_change = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] pci.alias                      = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] pci.device_spec                = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] pci.report_in_placement        = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.auth_section         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.auth_type            = password {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.cafile               = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.certfile             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.collect_timing       = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.connect_retries      = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.connect_retry_delay  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.default_domain_id    = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.default_domain_name  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.domain_id            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.domain_name          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.endpoint_override    = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.insecure             = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.keyfile              = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.max_version          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.min_version          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.password             = **** {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.project_domain_id    = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.project_domain_name  = Default {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.project_id           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.project_name         = service {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.region_name          = RegionOne {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.service_name         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.service_type         = placement {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.split_loggers        = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.status_code_retries  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.status_code_retry_delay = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.system_scope         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.timeout              = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.trust_id             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.user_domain_id       = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.user_domain_name     = Default {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.user_id              = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.username             = placement {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] placement.version              = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] quota.cores                    = 20 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] quota.count_usage_from_placement = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] quota.injected_file_content_bytes = 10240 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] quota.injected_file_path_length = 255 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] quota.injected_files           = 5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] quota.instances                = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] quota.key_pairs                = 100 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] quota.metadata_items           = 128 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] quota.ram                      = 51200 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] quota.recheck_quota            = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] quota.server_group_members     = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] quota.server_groups            = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] rdp.enabled                    = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] scheduler.image_metadata_prefilter = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] scheduler.max_attempts         = 3 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] scheduler.max_placement_results = 1000 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] scheduler.workers              = 3 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.host_subset_size = 1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.isolated_hosts = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.isolated_images = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.pci_in_placement = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.track_instance_changes = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] metrics.required               = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] metrics.weight_multiplier      = 1.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] metrics.weight_setting         = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] serial_console.enabled         = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] serial_console.port_range      = 10000:20000 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] serial_console.serialproxy_port = 6083 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] service_user.auth_section      = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] service_user.auth_type         = password {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] service_user.cafile            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] service_user.certfile          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] service_user.collect_timing    = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] service_user.insecure          = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] service_user.keyfile           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] service_user.send_service_user_token = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] service_user.split_loggers     = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] service_user.timeout           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] spice.agent_enabled            = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] spice.enabled                  = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] spice.html5proxy_port          = 6082 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] spice.image_compression        = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] spice.jpeg_compression         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] spice.playback_compression     = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] spice.server_listen            = 127.0.0.1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] spice.streaming_mode           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] spice.zlib_compression         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] upgrade_levels.baseapi         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] upgrade_levels.compute         = auto {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] upgrade_levels.conductor       = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] upgrade_levels.scheduler       = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vendordata_dynamic_auth.cafile = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vendordata_dynamic_auth.certfile = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vendordata_dynamic_auth.insecure = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vendordata_dynamic_auth.timeout = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.api_retry_count         = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.ca_file                 = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.cache_prefix            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.cluster_name            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.connection_pool_size    = 10 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.console_delay_seconds   = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.datastore_regex         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.host_ip                 = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.host_password           = **** {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.host_port               = 443 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.host_username           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.insecure                = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.integration_bridge      = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.maximum_objects         = 100 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.pbm_default_policy      = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.pbm_enabled             = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.pbm_wsdl_location       = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.serial_port_proxy_uri   = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.serial_port_service_uri = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.task_poll_interval      = 0.5 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.use_linked_clone        = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.vnc_keymap              = en-us {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.vnc_port                = 5900 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vmware.vnc_port_total          = 10000 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vnc.auth_schemes               = ['none'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vnc.enabled                    = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vnc.novncproxy_port            = 6080 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vnc.vencrypt_ca_certs          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vnc.vencrypt_client_cert       = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vnc.vencrypt_client_key        = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.disable_rootwrap   = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.enable_numa_live_migration = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.libvirt_disable_apic = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] wsgi.client_socket_timeout     = 900 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] wsgi.default_pool_size         = 1000 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] wsgi.keep_alive                = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] wsgi.max_header_line           = 16384 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] wsgi.ssl_ca_file               = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] wsgi.ssl_cert_file             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] wsgi.ssl_key_file              = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] wsgi.tcp_keepidle              = 600 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] zvm.ca_file                    = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] zvm.cloud_connector_url        = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] zvm.reachable_timeout          = 300 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_policy.enforce_new_defaults = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_policy.enforce_scope      = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_policy.policy_default_rule = default {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] profiler.connection_string     = messaging:// {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] profiler.enabled               = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] profiler.es_doc_type           = notification {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] profiler.es_scroll_size        = 10000 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] profiler.es_scroll_time        = 2m {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] profiler.filter_error_trace    = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] profiler.hmac_keys             = **** {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] profiler.sentinel_service_name = mymaster {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] profiler.socket_timeout        = 0.1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] profiler.trace_requests        = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] profiler.trace_sqlalchemy      = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] profiler_jaeger.process_tags   = {} {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] profiler_jaeger.service_name_prefix = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] profiler_otlp.service_name_prefix = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] remote_debug.host              = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] remote_debug.port              = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_notifications.retry = -1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.auth_section        = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.auth_type           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.cafile              = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.certfile            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.collect_timing      = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.connect_retries     = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.connect_retry_delay = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.endpoint_id         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.endpoint_override   = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.insecure            = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.keyfile             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.max_version         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.min_version         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.region_name         = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.service_name        = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.service_type        = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.split_loggers       = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.status_code_retries = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.status_code_retry_delay = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.timeout             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.valid_interfaces    = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_limit.version             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_reports.file_event_handler = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] oslo_reports.log_dir           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vif_plug_ovs_privileged.group  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] vif_plug_ovs_privileged.user   = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_vif_ovs.isolate_vif         = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] os_brick.lock_path             = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] privsep_osbrick.capabilities   = [21] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] privsep_osbrick.group          = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] privsep_osbrick.helper_command = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] privsep_osbrick.user           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] nova_sys_admin.group           = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] nova_sys_admin.helper_command  = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] nova_sys_admin.user            = None {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG oslo_service.service [None req-e404f9e2-2dca-4e2b-a647-5bc080fee7b9 None None] ******************************************************************************** {{(pid=75571) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 28 20:06:47 user nova-compute[75571]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 28 20:06:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Connecting to libvirt: qemu:///system {{(pid=75571) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f7779f223b0> {{(pid=75571) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 28 20:06:47 user nova-compute[75571]: libvirt:  error : internal error: could not initialize domain event timer
Nov 28 20:06:47 user nova-compute[75571]: WARNING nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 28 20:06:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f7779f223b0> {{(pid=75571) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Starting native event thread {{(pid=75571) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Starting green dispatch thread {{(pid=75571) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 28 20:06:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Starting connection event dispatch thread {{(pid=75571) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 28 20:06:47 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Connection event '1' reason 'None'
Nov 28 20:06:47 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 20:06:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.mount [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Initialising _HostMountState generation 0 {{(pid=75571) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 28 20:06:55 user nova-compute[75571]: INFO nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Libvirt host capabilities <capabilities>
Nov 28 20:06:55 user nova-compute[75571]:   <host>
Nov 28 20:06:55 user nova-compute[75571]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 28 20:06:55 user nova-compute[75571]:     <cpu>
Nov 28 20:06:55 user nova-compute[75571]:       <arch>x86_64</arch>
Nov 28 20:06:55 user nova-compute[75571]:       <model>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <vendor>Intel</vendor>
Nov 28 20:06:55 user nova-compute[75571]:       <microcode version='1070'/>
Nov 28 20:06:55 user nova-compute[75571]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 28 20:06:55 user nova-compute[75571]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature name='ss'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature name='vmx'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature name='pcid'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature name='osxsave'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature name='hypervisor'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature name='arat'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature name='tsc_adjust'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature name='md-clear'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature name='stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature name='arch-capabilities'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature name='ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature name='invtsc'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature name='rsba'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature name='skip-l1dfl-vmentry'/>
Nov 28 20:06:55 user nova-compute[75571]:       <pages unit='KiB' size='4'/>
Nov 28 20:06:55 user nova-compute[75571]:       <pages unit='KiB' size='2048'/>
Nov 28 20:06:55 user nova-compute[75571]:     </cpu>
Nov 28 20:06:55 user nova-compute[75571]:     <power_management>
Nov 28 20:06:55 user nova-compute[75571]:       <suspend_mem/>
Nov 28 20:06:55 user nova-compute[75571]:       <suspend_disk/>
Nov 28 20:06:55 user nova-compute[75571]:       <suspend_hybrid/>
Nov 28 20:06:55 user nova-compute[75571]:     </power_management>
Nov 28 20:06:55 user nova-compute[75571]:     <iommu support='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     <migration_features>
Nov 28 20:06:55 user nova-compute[75571]:       <live/>
Nov 28 20:06:55 user nova-compute[75571]:       <uri_transports>
Nov 28 20:06:55 user nova-compute[75571]:         <uri_transport>tcp</uri_transport>
Nov 28 20:06:55 user nova-compute[75571]:         <uri_transport>rdma</uri_transport>
Nov 28 20:06:55 user nova-compute[75571]:       </uri_transports>
Nov 28 20:06:55 user nova-compute[75571]:     </migration_features>
Nov 28 20:06:55 user nova-compute[75571]:     <topology>
Nov 28 20:06:55 user nova-compute[75571]:       <cells num='2'>
Nov 28 20:06:55 user nova-compute[75571]:         <cell id='0'>
Nov 28 20:06:55 user nova-compute[75571]:           <memory unit='KiB'>8140616</memory>
Nov 28 20:06:55 user nova-compute[75571]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 28 20:06:55 user nova-compute[75571]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 20:06:55 user nova-compute[75571]:           <distances>
Nov 28 20:06:55 user nova-compute[75571]:             <sibling id='0' value='10'/>
Nov 28 20:06:55 user nova-compute[75571]:             <sibling id='1' value='20'/>
Nov 28 20:06:55 user nova-compute[75571]:           </distances>
Nov 28 20:06:55 user nova-compute[75571]:           <cpus num='6'>
Nov 28 20:06:55 user nova-compute[75571]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 28 20:06:55 user nova-compute[75571]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 28 20:06:55 user nova-compute[75571]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 28 20:06:55 user nova-compute[75571]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 28 20:06:55 user nova-compute[75571]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 28 20:06:55 user nova-compute[75571]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 28 20:06:55 user nova-compute[75571]:           </cpus>
Nov 28 20:06:55 user nova-compute[75571]:         </cell>
Nov 28 20:06:55 user nova-compute[75571]:         <cell id='1'>
Nov 28 20:06:55 user nova-compute[75571]:           <memory unit='KiB'>8255068</memory>
Nov 28 20:06:55 user nova-compute[75571]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 28 20:06:55 user nova-compute[75571]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 20:06:55 user nova-compute[75571]:           <distances>
Nov 28 20:06:55 user nova-compute[75571]:             <sibling id='0' value='20'/>
Nov 28 20:06:55 user nova-compute[75571]:             <sibling id='1' value='10'/>
Nov 28 20:06:55 user nova-compute[75571]:           </distances>
Nov 28 20:06:55 user nova-compute[75571]:           <cpus num='6'>
Nov 28 20:06:55 user nova-compute[75571]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 28 20:06:55 user nova-compute[75571]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 28 20:06:55 user nova-compute[75571]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 28 20:06:55 user nova-compute[75571]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 28 20:06:55 user nova-compute[75571]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 28 20:06:55 user nova-compute[75571]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 28 20:06:55 user nova-compute[75571]:           </cpus>
Nov 28 20:06:55 user nova-compute[75571]:         </cell>
Nov 28 20:06:55 user nova-compute[75571]:       </cells>
Nov 28 20:06:55 user nova-compute[75571]:     </topology>
Nov 28 20:06:55 user nova-compute[75571]:     <cache>
Nov 28 20:06:55 user nova-compute[75571]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 28 20:06:55 user nova-compute[75571]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 28 20:06:55 user nova-compute[75571]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 28 20:06:55 user nova-compute[75571]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 28 20:06:55 user nova-compute[75571]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 28 20:06:55 user nova-compute[75571]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 28 20:06:55 user nova-compute[75571]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 28 20:06:55 user nova-compute[75571]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 28 20:06:55 user nova-compute[75571]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 28 20:06:55 user nova-compute[75571]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 28 20:06:55 user nova-compute[75571]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 28 20:06:55 user nova-compute[75571]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 28 20:06:55 user nova-compute[75571]:     </cache>
Nov 28 20:06:55 user nova-compute[75571]:     <secmodel>
Nov 28 20:06:55 user nova-compute[75571]:       <model>apparmor</model>
Nov 28 20:06:55 user nova-compute[75571]:       <doi>0</doi>
Nov 28 20:06:55 user nova-compute[75571]:     </secmodel>
Nov 28 20:06:55 user nova-compute[75571]:     <secmodel>
Nov 28 20:06:55 user nova-compute[75571]:       <model>dac</model>
Nov 28 20:06:55 user nova-compute[75571]:       <doi>0</doi>
Nov 28 20:06:55 user nova-compute[75571]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 28 20:06:55 user nova-compute[75571]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 28 20:06:55 user nova-compute[75571]:     </secmodel>
Nov 28 20:06:55 user nova-compute[75571]:   </host>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='alpha'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>64</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>clipper</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='armv6l'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>32</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>spitz</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>nuri</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>kzm</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sx1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>z2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>tosa</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>n810</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>n800</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>terrier</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>midway</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>microbit</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>verdex</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>highbank</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>akita</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>connex</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>collie</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='armv7l'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>32</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>spitz</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>nuri</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>kzm</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sx1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>z2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>tosa</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>n810</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>n800</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>terrier</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>midway</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>microbit</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>verdex</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>highbank</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>akita</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>connex</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>collie</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='aarch64'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>64</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>spitz</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>nuri</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>kzm</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sx1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>z2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>tosa</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>n810</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>n800</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>terrier</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>midway</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>microbit</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>verdex</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>raspi3b</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>highbank</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>akita</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>connex</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>collie</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <acpi default='on' toggle='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='cris'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>32</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='i686'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>32</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>isapc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>microvm</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='kvm'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <pae/>
Nov 28 20:06:55 user nova-compute[75571]:       <nonpae/>
Nov 28 20:06:55 user nova-compute[75571]:       <acpi default='on' toggle='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:       <apic default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='m68k'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>32</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>an5206</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>q800</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>next-cube</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='microblaze'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>32</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='microblazeel'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>32</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='mips'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>32</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='16'>malta</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='mipsel'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>32</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='16'>malta</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='mips64'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>64</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='16'>malta</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>pica61</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>magnum</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='mips64el'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>64</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='16'>malta</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>pica61</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>magnum</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='16'>boston</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='ppc'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>32</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mac99</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>40p</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>taihu</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='ppc64'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>64</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>taihu</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>40p</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mac99</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='ppc64le'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>64</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>taihu</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>40p</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>mac99</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='riscv32'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>32</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='8'>spike</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>opentitan</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='8'>virt</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='riscv64'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>64</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='8'>spike</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>shakti_c</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='8'>virt</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='s390x'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>64</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='sh4'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>32</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>shix</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>r2d</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='sh4eb'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>64</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>shix</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>r2d</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='sparc'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>32</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>SS-5</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>SS-20</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>LX</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>SS-4</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>SS-10</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>Voyager</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='sparc64'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>64</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sun4u</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>niagara</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>sun4v</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='x86_64'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>64</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='1'>isapc</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>microvm</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='kvm'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <acpi default='on' toggle='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:       <apic default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='xtensa'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>32</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>sim</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>kc705</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>ml605</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>virt</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>lx200</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>lx60</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]:   <guest>
Nov 28 20:06:55 user nova-compute[75571]:     <os_type>hvm</os_type>
Nov 28 20:06:55 user nova-compute[75571]:     <arch name='xtensaeb'>
Nov 28 20:06:55 user nova-compute[75571]:       <wordsize>32</wordsize>
Nov 28 20:06:55 user nova-compute[75571]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='4'>sim</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>kc705</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>ml605</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>virt</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>lx200</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>lx60</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 20:06:55 user nova-compute[75571]:       <domain type='qemu'/>
Nov 28 20:06:55 user nova-compute[75571]:     </arch>
Nov 28 20:06:55 user nova-compute[75571]:     <features>
Nov 28 20:06:55 user nova-compute[75571]:       <cpuselection/>
Nov 28 20:06:55 user nova-compute[75571]:       <deviceboot/>
Nov 28 20:06:55 user nova-compute[75571]:       <disksnapshot default='on' toggle='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     </features>
Nov 28 20:06:55 user nova-compute[75571]:   </guest>
Nov 28 20:06:55 user nova-compute[75571]: </capabilities>
Nov 28 20:06:55 user nova-compute[75571]: 
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 28 20:06:55 user nova-compute[75571]: <domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 20:06:55 user nova-compute[75571]:   <domain>kvm</domain>
Nov 28 20:06:55 user nova-compute[75571]:   <machine>pc-i440fx-6.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:   <arch>i686</arch>
Nov 28 20:06:55 user nova-compute[75571]:   <vcpu max='255'/>
Nov 28 20:06:55 user nova-compute[75571]:   <iothreads supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:   <os supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='firmware'/>
Nov 28 20:06:55 user nova-compute[75571]:     <loader supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>rom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pflash</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='readonly'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>yes</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='secure'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </loader>
Nov 28 20:06:55 user nova-compute[75571]:   </os>
Nov 28 20:06:55 user nova-compute[75571]:   <cpu>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-passthrough' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='hostPassthroughMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='maximum' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='maximumMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>on</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-model' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <vendor>Intel</vendor>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ss'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='vmx'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='pcid'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='hypervisor'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arat'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='umip'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='md-clear'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibpb'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibrs'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='erms'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='lm'/>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='custom' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>qemu64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>qemu32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>phenom</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>n270</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>kvm64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>kvm32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>coreduo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>core2duo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>athlon</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Westmere</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Snowridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Penryn</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G5</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G4</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G1</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Nehalem</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Rome</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Milan</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Dhyana</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cooperlake</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Conroe</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>486</model>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:   </cpu>
Nov 28 20:06:55 user nova-compute[75571]:   <memoryBacking supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='sourceType'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>file</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>anonymous</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>memfd</value>
Nov 28 20:06:55 user nova-compute[75571]:     </enum>
Nov 28 20:06:55 user nova-compute[75571]:   </memoryBacking>
Nov 28 20:06:55 user nova-compute[75571]:   <devices>
Nov 28 20:06:55 user nova-compute[75571]:     <disk supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='diskDevice'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>disk</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cdrom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>floppy</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>lun</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='bus'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>ide</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>fdc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sata</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </disk>
Nov 28 20:06:55 user nova-compute[75571]:     <graphics supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sdl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vnc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>spice</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egl-headless</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </graphics>
Nov 28 20:06:55 user nova-compute[75571]:     <video supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='modelType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cirrus</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vmvga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>qxl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>none</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>bochs</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>ramfb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </video>
Nov 28 20:06:55 user nova-compute[75571]:     <hostdev supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='mode'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>subsystem</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='startupPolicy'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>default</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>mandatory</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>requisite</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>optional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='subsysType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pci</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='capsType'/>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='pciBackend'/>
Nov 28 20:06:55 user nova-compute[75571]:     </hostdev>
Nov 28 20:06:55 user nova-compute[75571]:     <rng supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>random</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egd</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>builtin</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </rng>
Nov 28 20:06:55 user nova-compute[75571]:     <filesystem supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='driverType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>path</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>handle</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtiofs</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </filesystem>
Nov 28 20:06:55 user nova-compute[75571]:     <tpm supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-tis</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-crb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>passthrough</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>emulator</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </tpm>
Nov 28 20:06:55 user nova-compute[75571]:   </devices>
Nov 28 20:06:55 user nova-compute[75571]:   <features>
Nov 28 20:06:55 user nova-compute[75571]:     <gic supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     <vmcoreinfo supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <genid supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backingStoreInput supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backup supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <sev supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:   </features>
Nov 28 20:06:55 user nova-compute[75571]: </domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:  {{(pid=75571) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 28 20:06:55 user nova-compute[75571]: <domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 20:06:55 user nova-compute[75571]:   <domain>kvm</domain>
Nov 28 20:06:55 user nova-compute[75571]:   <machine>pc-i440fx-jammy</machine>
Nov 28 20:06:55 user nova-compute[75571]:   <arch>i686</arch>
Nov 28 20:06:55 user nova-compute[75571]:   <vcpu max='255'/>
Nov 28 20:06:55 user nova-compute[75571]:   <iothreads supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:   <os supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='firmware'/>
Nov 28 20:06:55 user nova-compute[75571]:     <loader supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>rom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pflash</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='readonly'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>yes</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='secure'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </loader>
Nov 28 20:06:55 user nova-compute[75571]:   </os>
Nov 28 20:06:55 user nova-compute[75571]:   <cpu>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-passthrough' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='hostPassthroughMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='maximum' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='maximumMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>on</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-model' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <vendor>Intel</vendor>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ss'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='vmx'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='pcid'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='hypervisor'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arat'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='umip'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='md-clear'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibpb'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibrs'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='erms'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='lm'/>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='custom' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>qemu64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>qemu32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>phenom</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>n270</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>kvm64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>kvm32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>coreduo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>core2duo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>athlon</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Westmere</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Snowridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Penryn</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G5</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G4</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G1</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Nehalem</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Rome</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Milan</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Dhyana</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cooperlake</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Conroe</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>486</model>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:   </cpu>
Nov 28 20:06:55 user nova-compute[75571]:   <memoryBacking supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='sourceType'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>file</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>anonymous</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>memfd</value>
Nov 28 20:06:55 user nova-compute[75571]:     </enum>
Nov 28 20:06:55 user nova-compute[75571]:   </memoryBacking>
Nov 28 20:06:55 user nova-compute[75571]:   <devices>
Nov 28 20:06:55 user nova-compute[75571]:     <disk supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='diskDevice'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>disk</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cdrom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>floppy</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>lun</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='bus'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>ide</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>fdc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sata</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </disk>
Nov 28 20:06:55 user nova-compute[75571]:     <graphics supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sdl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vnc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>spice</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egl-headless</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </graphics>
Nov 28 20:06:55 user nova-compute[75571]:     <video supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='modelType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cirrus</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vmvga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>qxl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>none</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>bochs</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>ramfb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </video>
Nov 28 20:06:55 user nova-compute[75571]:     <hostdev supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='mode'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>subsystem</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='startupPolicy'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>default</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>mandatory</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>requisite</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>optional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='subsysType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pci</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='capsType'/>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='pciBackend'/>
Nov 28 20:06:55 user nova-compute[75571]:     </hostdev>
Nov 28 20:06:55 user nova-compute[75571]:     <rng supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>random</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egd</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>builtin</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </rng>
Nov 28 20:06:55 user nova-compute[75571]:     <filesystem supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='driverType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>path</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>handle</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtiofs</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </filesystem>
Nov 28 20:06:55 user nova-compute[75571]:     <tpm supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-tis</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-crb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>passthrough</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>emulator</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </tpm>
Nov 28 20:06:55 user nova-compute[75571]:   </devices>
Nov 28 20:06:55 user nova-compute[75571]:   <features>
Nov 28 20:06:55 user nova-compute[75571]:     <gic supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     <vmcoreinfo supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <genid supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backingStoreInput supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backup supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <sev supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:   </features>
Nov 28 20:06:55 user nova-compute[75571]: </domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:  {{(pid=75571) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 28 20:06:55 user nova-compute[75571]: <domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 20:06:55 user nova-compute[75571]:   <domain>kvm</domain>
Nov 28 20:06:55 user nova-compute[75571]:   <machine>pc-q35-jammy</machine>
Nov 28 20:06:55 user nova-compute[75571]:   <arch>i686</arch>
Nov 28 20:06:55 user nova-compute[75571]:   <vcpu max='288'/>
Nov 28 20:06:55 user nova-compute[75571]:   <iothreads supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:   <os supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='firmware'/>
Nov 28 20:06:55 user nova-compute[75571]:     <loader supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>rom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pflash</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='readonly'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>yes</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='secure'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </loader>
Nov 28 20:06:55 user nova-compute[75571]:   </os>
Nov 28 20:06:55 user nova-compute[75571]:   <cpu>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-passthrough' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='hostPassthroughMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='maximum' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='maximumMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>on</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-model' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <vendor>Intel</vendor>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ss'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='vmx'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='pcid'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='hypervisor'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arat'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='umip'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='md-clear'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibpb'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibrs'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='erms'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='lm'/>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='custom' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>qemu64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>qemu32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>phenom</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>n270</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>kvm64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>kvm32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>coreduo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>core2duo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>athlon</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Westmere</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Snowridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Penryn</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G5</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G4</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G1</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Nehalem</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Rome</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Milan</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Dhyana</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cooperlake</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Conroe</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>486</model>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:   </cpu>
Nov 28 20:06:55 user nova-compute[75571]:   <memoryBacking supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='sourceType'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>file</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>anonymous</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>memfd</value>
Nov 28 20:06:55 user nova-compute[75571]:     </enum>
Nov 28 20:06:55 user nova-compute[75571]:   </memoryBacking>
Nov 28 20:06:55 user nova-compute[75571]:   <devices>
Nov 28 20:06:55 user nova-compute[75571]:     <disk supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='diskDevice'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>disk</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cdrom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>floppy</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>lun</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='bus'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>fdc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sata</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </disk>
Nov 28 20:06:55 user nova-compute[75571]:     <graphics supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sdl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vnc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>spice</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egl-headless</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </graphics>
Nov 28 20:06:55 user nova-compute[75571]:     <video supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='modelType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cirrus</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vmvga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>qxl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>none</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>bochs</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>ramfb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </video>
Nov 28 20:06:55 user nova-compute[75571]:     <hostdev supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='mode'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>subsystem</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='startupPolicy'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>default</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>mandatory</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>requisite</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>optional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='subsysType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pci</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='capsType'/>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='pciBackend'/>
Nov 28 20:06:55 user nova-compute[75571]:     </hostdev>
Nov 28 20:06:55 user nova-compute[75571]:     <rng supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>random</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egd</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>builtin</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </rng>
Nov 28 20:06:55 user nova-compute[75571]:     <filesystem supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='driverType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>path</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>handle</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtiofs</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </filesystem>
Nov 28 20:06:55 user nova-compute[75571]:     <tpm supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-tis</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-crb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>passthrough</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>emulator</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </tpm>
Nov 28 20:06:55 user nova-compute[75571]:   </devices>
Nov 28 20:06:55 user nova-compute[75571]:   <features>
Nov 28 20:06:55 user nova-compute[75571]:     <gic supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     <vmcoreinfo supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <genid supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backingStoreInput supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backup supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <sev supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:   </features>
Nov 28 20:06:55 user nova-compute[75571]: </domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:  {{(pid=75571) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 28 20:06:55 user nova-compute[75571]: <domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 20:06:55 user nova-compute[75571]:   <domain>kvm</domain>
Nov 28 20:06:55 user nova-compute[75571]:   <machine>pc-q35-6.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:   <arch>i686</arch>
Nov 28 20:06:55 user nova-compute[75571]:   <vcpu max='288'/>
Nov 28 20:06:55 user nova-compute[75571]:   <iothreads supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:   <os supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='firmware'/>
Nov 28 20:06:55 user nova-compute[75571]:     <loader supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>rom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pflash</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='readonly'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>yes</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='secure'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </loader>
Nov 28 20:06:55 user nova-compute[75571]:   </os>
Nov 28 20:06:55 user nova-compute[75571]:   <cpu>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-passthrough' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='hostPassthroughMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='maximum' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='maximumMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>on</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-model' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <vendor>Intel</vendor>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ss'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='vmx'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='pcid'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='hypervisor'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arat'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='umip'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='md-clear'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibpb'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibrs'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='erms'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='lm'/>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='custom' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>qemu64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>qemu32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>phenom</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>n270</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>kvm64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>kvm32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>coreduo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>core2duo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>athlon</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Westmere</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Snowridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Penryn</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G5</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G4</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G1</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Nehalem</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Rome</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Milan</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Dhyana</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cooperlake</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Conroe</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>486</model>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:   </cpu>
Nov 28 20:06:55 user nova-compute[75571]:   <memoryBacking supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='sourceType'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>file</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>anonymous</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>memfd</value>
Nov 28 20:06:55 user nova-compute[75571]:     </enum>
Nov 28 20:06:55 user nova-compute[75571]:   </memoryBacking>
Nov 28 20:06:55 user nova-compute[75571]:   <devices>
Nov 28 20:06:55 user nova-compute[75571]:     <disk supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='diskDevice'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>disk</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cdrom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>floppy</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>lun</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='bus'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>fdc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sata</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </disk>
Nov 28 20:06:55 user nova-compute[75571]:     <graphics supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sdl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vnc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>spice</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egl-headless</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </graphics>
Nov 28 20:06:55 user nova-compute[75571]:     <video supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='modelType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cirrus</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vmvga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>qxl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>none</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>bochs</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>ramfb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </video>
Nov 28 20:06:55 user nova-compute[75571]:     <hostdev supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='mode'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>subsystem</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='startupPolicy'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>default</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>mandatory</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>requisite</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>optional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='subsysType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pci</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='capsType'/>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='pciBackend'/>
Nov 28 20:06:55 user nova-compute[75571]:     </hostdev>
Nov 28 20:06:55 user nova-compute[75571]:     <rng supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>random</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egd</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>builtin</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </rng>
Nov 28 20:06:55 user nova-compute[75571]:     <filesystem supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='driverType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>path</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>handle</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtiofs</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </filesystem>
Nov 28 20:06:55 user nova-compute[75571]:     <tpm supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-tis</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-crb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>passthrough</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>emulator</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </tpm>
Nov 28 20:06:55 user nova-compute[75571]:   </devices>
Nov 28 20:06:55 user nova-compute[75571]:   <features>
Nov 28 20:06:55 user nova-compute[75571]:     <gic supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     <vmcoreinfo supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <genid supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backingStoreInput supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backup supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <sev supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:   </features>
Nov 28 20:06:55 user nova-compute[75571]: </domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:  {{(pid=75571) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 28 20:06:55 user nova-compute[75571]: <domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 20:06:55 user nova-compute[75571]:   <domain>kvm</domain>
Nov 28 20:06:55 user nova-compute[75571]:   <machine>pc-i440fx-6.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:   <arch>x86_64</arch>
Nov 28 20:06:55 user nova-compute[75571]:   <vcpu max='255'/>
Nov 28 20:06:55 user nova-compute[75571]:   <iothreads supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:   <os supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='firmware'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>efi</value>
Nov 28 20:06:55 user nova-compute[75571]:     </enum>
Nov 28 20:06:55 user nova-compute[75571]:     <loader supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>rom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pflash</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='readonly'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>yes</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='secure'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </loader>
Nov 28 20:06:55 user nova-compute[75571]:   </os>
Nov 28 20:06:55 user nova-compute[75571]:   <cpu>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-passthrough' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='hostPassthroughMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>on</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='maximum' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='maximumMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>on</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-model' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <vendor>Intel</vendor>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ss'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='vmx'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='pcid'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='hypervisor'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arat'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='umip'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='md-clear'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='invtsc'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibpb'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibrs'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='rsba'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='erms'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='custom' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>qemu64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>qemu32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>phenom</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>n270</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>kvm64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>kvm32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>coreduo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>core2duo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>athlon</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Westmere</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Snowridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Penryn</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G5</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G4</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Opteron_G1</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Nehalem</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Rome</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Milan</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Dhyana</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cooperlake</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Conroe</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>486</model>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:   </cpu>
Nov 28 20:06:55 user nova-compute[75571]:   <memoryBacking supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='sourceType'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>file</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>anonymous</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>memfd</value>
Nov 28 20:06:55 user nova-compute[75571]:     </enum>
Nov 28 20:06:55 user nova-compute[75571]:   </memoryBacking>
Nov 28 20:06:55 user nova-compute[75571]:   <devices>
Nov 28 20:06:55 user nova-compute[75571]:     <disk supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='diskDevice'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>disk</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cdrom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>floppy</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>lun</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='bus'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>ide</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>fdc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sata</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </disk>
Nov 28 20:06:55 user nova-compute[75571]:     <graphics supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sdl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vnc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>spice</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egl-headless</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </graphics>
Nov 28 20:06:55 user nova-compute[75571]:     <video supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='modelType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cirrus</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vmvga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>qxl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>none</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>bochs</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>ramfb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </video>
Nov 28 20:06:55 user nova-compute[75571]:     <hostdev supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='mode'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>subsystem</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='startupPolicy'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>default</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>mandatory</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>requisite</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>optional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='subsysType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pci</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='capsType'/>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='pciBackend'/>
Nov 28 20:06:55 user nova-compute[75571]:     </hostdev>
Nov 28 20:06:55 user nova-compute[75571]:     <rng supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>random</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egd</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>builtin</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </rng>
Nov 28 20:06:55 user nova-compute[75571]:     <filesystem supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='driverType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>path</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>handle</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtiofs</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </filesystem>
Nov 28 20:06:55 user nova-compute[75571]:     <tpm supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-tis</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-crb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>passthrough</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>emulator</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </tpm>
Nov 28 20:06:55 user nova-compute[75571]:   </devices>
Nov 28 20:06:55 user nova-compute[75571]:   <features>
Nov 28 20:06:55 user nova-compute[75571]:     <gic supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     <vmcoreinfo supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <genid supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backingStoreInput supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backup supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <sev supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:   </features>
Nov 28 20:06:55 user nova-compute[75571]: </domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:  {{(pid=75571) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 28 20:06:55 user nova-compute[75571]: <domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 20:06:55 user nova-compute[75571]:   <domain>kvm</domain>
Nov 28 20:06:55 user nova-compute[75571]:   <machine>pc-i440fx-jammy</machine>
Nov 28 20:06:55 user nova-compute[75571]:   <arch>x86_64</arch>
Nov 28 20:06:55 user nova-compute[75571]:   <vcpu max='255'/>
Nov 28 20:06:55 user nova-compute[75571]:   <iothreads supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:   <os supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='firmware'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>efi</value>
Nov 28 20:06:55 user nova-compute[75571]:     </enum>
Nov 28 20:06:55 user nova-compute[75571]:     <loader supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>rom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pflash</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='readonly'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>yes</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='secure'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </loader>
Nov 28 20:06:55 user nova-compute[75571]:   </os>
Nov 28 20:06:55 user nova-compute[75571]:   <cpu>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-passthrough' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='hostPassthroughMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>on</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='maximum' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='maximumMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>on</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-model' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <vendor>Intel</vendor>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ss'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='vmx'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='pcid'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='hypervisor'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arat'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='umip'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='md-clear'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='invtsc'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibpb'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibrs'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='rsba'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='erms'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='custom' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>qemu64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>qemu32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>phenom</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>n270</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>kvm64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>kvm32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>coreduo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>core2duo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>athlon</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Westmere</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Snowridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Penryn</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G5</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G4</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Opteron_G1</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Nehalem</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Rome</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Milan</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Dhyana</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cooperlake</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Conroe</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>486</model>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:   </cpu>
Nov 28 20:06:55 user nova-compute[75571]:   <memoryBacking supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='sourceType'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>file</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>anonymous</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>memfd</value>
Nov 28 20:06:55 user nova-compute[75571]:     </enum>
Nov 28 20:06:55 user nova-compute[75571]:   </memoryBacking>
Nov 28 20:06:55 user nova-compute[75571]:   <devices>
Nov 28 20:06:55 user nova-compute[75571]:     <disk supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='diskDevice'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>disk</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cdrom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>floppy</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>lun</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='bus'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>ide</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>fdc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sata</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </disk>
Nov 28 20:06:55 user nova-compute[75571]:     <graphics supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sdl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vnc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>spice</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egl-headless</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </graphics>
Nov 28 20:06:55 user nova-compute[75571]:     <video supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='modelType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cirrus</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vmvga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>qxl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>none</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>bochs</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>ramfb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </video>
Nov 28 20:06:55 user nova-compute[75571]:     <hostdev supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='mode'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>subsystem</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='startupPolicy'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>default</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>mandatory</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>requisite</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>optional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='subsysType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pci</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='capsType'/>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='pciBackend'/>
Nov 28 20:06:55 user nova-compute[75571]:     </hostdev>
Nov 28 20:06:55 user nova-compute[75571]:     <rng supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>random</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egd</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>builtin</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </rng>
Nov 28 20:06:55 user nova-compute[75571]:     <filesystem supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='driverType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>path</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>handle</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtiofs</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </filesystem>
Nov 28 20:06:55 user nova-compute[75571]:     <tpm supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-tis</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-crb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>passthrough</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>emulator</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </tpm>
Nov 28 20:06:55 user nova-compute[75571]:   </devices>
Nov 28 20:06:55 user nova-compute[75571]:   <features>
Nov 28 20:06:55 user nova-compute[75571]:     <gic supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     <vmcoreinfo supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <genid supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backingStoreInput supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backup supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <sev supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:   </features>
Nov 28 20:06:55 user nova-compute[75571]: </domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:  {{(pid=75571) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 28 20:06:55 user nova-compute[75571]: <domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 20:06:55 user nova-compute[75571]:   <domain>kvm</domain>
Nov 28 20:06:55 user nova-compute[75571]:   <machine>pc-q35-jammy</machine>
Nov 28 20:06:55 user nova-compute[75571]:   <arch>x86_64</arch>
Nov 28 20:06:55 user nova-compute[75571]:   <vcpu max='288'/>
Nov 28 20:06:55 user nova-compute[75571]:   <iothreads supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:   <os supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='firmware'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>efi</value>
Nov 28 20:06:55 user nova-compute[75571]:     </enum>
Nov 28 20:06:55 user nova-compute[75571]:     <loader supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>rom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pflash</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='readonly'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>yes</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='secure'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>yes</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </loader>
Nov 28 20:06:55 user nova-compute[75571]:   </os>
Nov 28 20:06:55 user nova-compute[75571]:   <cpu>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-passthrough' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='hostPassthroughMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>on</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='maximum' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='maximumMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>on</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-model' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <vendor>Intel</vendor>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ss'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='vmx'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='pcid'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='hypervisor'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arat'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='umip'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='md-clear'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='invtsc'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibpb'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibrs'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='rsba'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='erms'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='custom' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>qemu64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>qemu32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>phenom</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>n270</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>kvm64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>kvm32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>coreduo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>core2duo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>athlon</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Westmere</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Snowridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Penryn</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G5</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G4</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Opteron_G1</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Nehalem</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Rome</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Milan</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Dhyana</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cooperlake</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Conroe</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>486</model>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:   </cpu>
Nov 28 20:06:55 user nova-compute[75571]:   <memoryBacking supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='sourceType'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>file</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>anonymous</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>memfd</value>
Nov 28 20:06:55 user nova-compute[75571]:     </enum>
Nov 28 20:06:55 user nova-compute[75571]:   </memoryBacking>
Nov 28 20:06:55 user nova-compute[75571]:   <devices>
Nov 28 20:06:55 user nova-compute[75571]:     <disk supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='diskDevice'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>disk</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cdrom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>floppy</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>lun</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='bus'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>fdc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sata</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </disk>
Nov 28 20:06:55 user nova-compute[75571]:     <graphics supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sdl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vnc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>spice</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egl-headless</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </graphics>
Nov 28 20:06:55 user nova-compute[75571]:     <video supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='modelType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cirrus</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vmvga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>qxl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>none</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>bochs</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>ramfb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </video>
Nov 28 20:06:55 user nova-compute[75571]:     <hostdev supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='mode'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>subsystem</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='startupPolicy'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>default</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>mandatory</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>requisite</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>optional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='subsysType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pci</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='capsType'/>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='pciBackend'/>
Nov 28 20:06:55 user nova-compute[75571]:     </hostdev>
Nov 28 20:06:55 user nova-compute[75571]:     <rng supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>random</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egd</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>builtin</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </rng>
Nov 28 20:06:55 user nova-compute[75571]:     <filesystem supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='driverType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>path</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>handle</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtiofs</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </filesystem>
Nov 28 20:06:55 user nova-compute[75571]:     <tpm supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-tis</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-crb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>passthrough</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>emulator</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </tpm>
Nov 28 20:06:55 user nova-compute[75571]:   </devices>
Nov 28 20:06:55 user nova-compute[75571]:   <features>
Nov 28 20:06:55 user nova-compute[75571]:     <gic supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     <vmcoreinfo supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <genid supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backingStoreInput supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backup supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <sev supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:   </features>
Nov 28 20:06:55 user nova-compute[75571]: </domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:  {{(pid=75571) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 28 20:06:55 user nova-compute[75571]: <domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 20:06:55 user nova-compute[75571]:   <domain>kvm</domain>
Nov 28 20:06:55 user nova-compute[75571]:   <machine>pc-q35-6.2</machine>
Nov 28 20:06:55 user nova-compute[75571]:   <arch>x86_64</arch>
Nov 28 20:06:55 user nova-compute[75571]:   <vcpu max='288'/>
Nov 28 20:06:55 user nova-compute[75571]:   <iothreads supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:   <os supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='firmware'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>efi</value>
Nov 28 20:06:55 user nova-compute[75571]:     </enum>
Nov 28 20:06:55 user nova-compute[75571]:     <loader supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>rom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pflash</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='readonly'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>yes</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='secure'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>yes</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>no</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </loader>
Nov 28 20:06:55 user nova-compute[75571]:   </os>
Nov 28 20:06:55 user nova-compute[75571]:   <cpu>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-passthrough' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='hostPassthroughMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>on</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='maximum' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='maximumMigratable'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>on</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>off</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='host-model' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <vendor>Intel</vendor>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ss'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='vmx'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='pcid'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='hypervisor'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arat'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='umip'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='md-clear'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='invtsc'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibpb'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='ibrs'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-stibp'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='rsba'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='erms'/>
Nov 28 20:06:55 user nova-compute[75571]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:     <mode name='custom' supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>qemu64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>qemu32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>phenom</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>pentium</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>n270</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>kvm64</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>kvm32</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>coreduo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>core2duo</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>athlon</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Westmere</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Snowridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Skylake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>SandyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Penryn</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G5</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G4</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G3</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Opteron_G2</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Opteron_G1</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Nehalem</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>IvyBridge</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Icelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Haswell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Rome</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-Milan</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>EPYC</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Dhyana</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cooperlake</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>Conroe</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='no'>Broadwell</model>
Nov 28 20:06:55 user nova-compute[75571]:       <model usable='yes'>486</model>
Nov 28 20:06:55 user nova-compute[75571]:     </mode>
Nov 28 20:06:55 user nova-compute[75571]:   </cpu>
Nov 28 20:06:55 user nova-compute[75571]:   <memoryBacking supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:     <enum name='sourceType'>
Nov 28 20:06:55 user nova-compute[75571]:       <value>file</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>anonymous</value>
Nov 28 20:06:55 user nova-compute[75571]:       <value>memfd</value>
Nov 28 20:06:55 user nova-compute[75571]:     </enum>
Nov 28 20:06:55 user nova-compute[75571]:   </memoryBacking>
Nov 28 20:06:55 user nova-compute[75571]:   <devices>
Nov 28 20:06:55 user nova-compute[75571]:     <disk supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='diskDevice'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>disk</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cdrom</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>floppy</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>lun</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='bus'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>fdc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sata</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </disk>
Nov 28 20:06:55 user nova-compute[75571]:     <graphics supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='type'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>sdl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vnc</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>spice</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egl-headless</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </graphics>
Nov 28 20:06:55 user nova-compute[75571]:     <video supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='modelType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>cirrus</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>vmvga</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>qxl</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>none</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>bochs</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>ramfb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </video>
Nov 28 20:06:55 user nova-compute[75571]:     <hostdev supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='mode'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>subsystem</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='startupPolicy'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>default</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>mandatory</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>requisite</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>optional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='subsysType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>usb</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>pci</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>scsi</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='capsType'/>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='pciBackend'/>
Nov 28 20:06:55 user nova-compute[75571]:     </hostdev>
Nov 28 20:06:55 user nova-compute[75571]:     <rng supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtio-non-transitional</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>random</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>egd</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>builtin</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </rng>
Nov 28 20:06:55 user nova-compute[75571]:     <filesystem supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='driverType'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>path</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>handle</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>virtiofs</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </filesystem>
Nov 28 20:06:55 user nova-compute[75571]:     <tpm supported='yes'>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='model'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-tis</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>tpm-crb</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:       <enum name='backendModel'>
Nov 28 20:06:55 user nova-compute[75571]:         <value>passthrough</value>
Nov 28 20:06:55 user nova-compute[75571]:         <value>emulator</value>
Nov 28 20:06:55 user nova-compute[75571]:       </enum>
Nov 28 20:06:55 user nova-compute[75571]:     </tpm>
Nov 28 20:06:55 user nova-compute[75571]:   </devices>
Nov 28 20:06:55 user nova-compute[75571]:   <features>
Nov 28 20:06:55 user nova-compute[75571]:     <gic supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:     <vmcoreinfo supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <genid supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backingStoreInput supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <backup supported='yes'/>
Nov 28 20:06:55 user nova-compute[75571]:     <sev supported='no'/>
Nov 28 20:06:55 user nova-compute[75571]:   </features>
Nov 28 20:06:55 user nova-compute[75571]: </domainCapabilities>
Nov 28 20:06:55 user nova-compute[75571]:  {{(pid=75571) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75571) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75571) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Checking secure boot support for host arch (x86_64) {{(pid=75571) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Checking secure boot support for host arch (x86_64) {{(pid=75571) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Checking secure boot support for host arch (x86_64) {{(pid=75571) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Checking secure boot support for host arch (x86_64) {{(pid=75571) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Checking secure boot support for host arch (x86_64) {{(pid=75571) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 20:06:55 user nova-compute[75571]: INFO nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Secure Boot support detected
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] cpu compare xml: <cpu match="exact">
Nov 28 20:06:55 user nova-compute[75571]:   <model>Nehalem</model>
Nov 28 20:06:55 user nova-compute[75571]: </cpu>
Nov 28 20:06:55 user nova-compute[75571]:  {{(pid=75571) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 28 20:06:55 user nova-compute[75571]: INFO nova.virt.node [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Generated node identity 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17
Nov 28 20:06:55 user nova-compute[75571]: INFO nova.virt.node [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Wrote node identity 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 to /opt/stack/data/nova/compute_id
Nov 28 20:06:55 user nova-compute[75571]: WARNING nova.compute.manager [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Compute nodes ['8c29bfe4-6f4c-483e-b64c-ec0ca018cd17'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 28 20:06:55 user nova-compute[75571]: INFO nova.compute.manager [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 28 20:06:55 user nova-compute[75571]: WARNING nova.compute.manager [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 20:06:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:06:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:06:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Hypervisor/Node resource view: name=user free_ram=11007MB free_disk=26.10959243774414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:06:55 user nova-compute[75571]: WARNING nova.compute.resource_tracker [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] No compute node record for user:8c29bfe4-6f4c-483e-b64c-ec0ca018cd17: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 could not be found.
Nov 28 20:06:55 user nova-compute[75571]: INFO nova.compute.resource_tracker [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Compute node record created for user:user with uuid: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:06:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:06:56 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] [req-e8522c78-8b73-4197-ba30-f12da7281a4a] Created resource provider record via placement API for resource provider with UUID 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 and name user.
Nov 28 20:06:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75571) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 28 20:06:56 user nova-compute[75571]: INFO nova.virt.libvirt.host [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] kernel doesn't support AMD SEV
Nov 28 20:06:56 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 20:06:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:06:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Libvirt baseline CPU <cpu>
Nov 28 20:06:56 user nova-compute[75571]:   <arch>x86_64</arch>
Nov 28 20:06:56 user nova-compute[75571]:   <model>Nehalem</model>
Nov 28 20:06:56 user nova-compute[75571]:   <vendor>Intel</vendor>
Nov 28 20:06:56 user nova-compute[75571]:   <topology sockets="6" cores="1" threads="1"/>
Nov 28 20:06:56 user nova-compute[75571]: </cpu>
Nov 28 20:06:56 user nova-compute[75571]:  {{(pid=75571) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 28 20:06:56 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Updated inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 28 20:06:56 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Updating resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 generation from 0 to 1 during operation: update_inventory {{(pid=75571) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 20:06:56 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 20:06:56 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Updating resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 generation from 1 to 2 during operation: update_traits {{(pid=75571) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 20:06:56 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:06:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:06:56 user nova-compute[75571]: DEBUG nova.service [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Creating RPC server for service compute {{(pid=75571) start /opt/stack/nova/nova/service.py:182}}
Nov 28 20:06:56 user nova-compute[75571]: DEBUG nova.service [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] Join ServiceGroup membership for this service compute {{(pid=75571) start /opt/stack/nova/nova/service.py:199}}
Nov 28 20:06:56 user nova-compute[75571]: DEBUG nova.servicegroup.drivers.db [None req-f3fd6e39-66f2-4f34-a858-280a634e7182 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75571) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 28 20:07:12 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:07:12 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:07:47 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:07:47 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:07:47 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=10452MB free_disk=26.013248443603516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:07:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:08:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:08:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:08:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:08:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:08:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 20:08:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:08:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:08:48 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:08:48 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:08:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:08:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:08:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:08:48 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:08:48 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:08:48 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:08:48 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=10369MB free_disk=26.077808380126953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:08:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:08:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:08:48 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:08:48 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:08:48 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:08:48 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:08:48 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:08:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:08:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:08:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:08:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:08:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:08:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:09:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:09:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:09:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:09:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 20:09:48 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:09:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:09:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:09:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:09:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:09:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:09:50 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:09:50 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:09:50 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:09:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:09:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:09:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:09:50 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:09:50 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:09:50 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:09:50 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=10394MB free_disk=25.829933166503906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:09:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:09:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:09:50 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:09:50 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:09:50 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:09:50 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:09:50 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:09:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:10:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:10:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:10:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:10:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:10:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 20:10:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:10:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:10:50 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:10:50 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:10:50 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:10:50 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:10:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:10:52 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:10:52 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:10:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:10:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:10:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:10:52 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:10:52 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:10:52 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:10:52 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9655MB free_disk=25.849868774414062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:10:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:10:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:10:52 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:10:52 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:10:52 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:10:52 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:10:52 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:10:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:10:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "42d7a4d5-4d2a-4803-b253-b656aec16f69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:10:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:10:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:10:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:10:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:10:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:10:57 user nova-compute[75571]: INFO nova.compute.claims [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Claim successful on node user
Nov 28 20:10:58 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:10:58 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:10:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:10:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:10:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:10:58 user nova-compute[75571]: DEBUG nova.network.neutron [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:10:58 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:10:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:10:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:10:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:10:58 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Creating image(s)
Nov 28 20:10:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "/opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:10:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "/opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:10:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "/opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:10:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:10:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:10:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b.part --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:10:59 user nova-compute[75571]: DEBUG nova.policy [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '830afb679e5d46cca73c2ad15c3ae83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23adb107ea2450687260c6260f14a9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:11:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:00 user nova-compute[75571]: DEBUG nova.virt.images [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] 77b9e284-7155-4207-b748-934c25ce18d0 was qcow2, converting to raw {{(pid=75571) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 20:11:00 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:11:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b.part /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b.converted {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b.part /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b.converted" returned: 0 in 0.323s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b.converted --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.872s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:00 user nova-compute[75571]: INFO oslo.privsep.daemon [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpnuj15vlo/privsep.sock']
Nov 28 20:11:00 user sudo[84860]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpnuj15vlo/privsep.sock
Nov 28 20:11:00 user sudo[84860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 20:11:02 user sudo[84860]: pam_unix(sudo:session): session closed for user root
Nov 28 20:11:02 user nova-compute[75571]: INFO oslo.privsep.daemon [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Spawned new privsep daemon via rootwrap
Nov 28 20:11:02 user nova-compute[75571]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 20:11:02 user nova-compute[75571]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 20:11:02 user nova-compute[75571]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 28 20:11:02 user nova-compute[75571]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84884
Nov 28 20:11:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:02 user nova-compute[75571]: DEBUG nova.network.neutron [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Successfully created port: a382b348-9cff-4cf4-9651-4fd406284eca {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:11:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk 1073741824" returned: 0 in 0.070s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:03 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:11:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:03 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Cannot resize image /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:11:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:11:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Ensure instance console log exists: /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:11:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "3b0d4ca0-b527-4131-97ff-222cd9ced151" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:04 user nova-compute[75571]: DEBUG nova.compute.manager [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:11:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:04 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:11:04 user nova-compute[75571]: INFO nova.compute.claims [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Claim successful on node user
Nov 28 20:11:04 user nova-compute[75571]: DEBUG nova.network.neutron [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Successfully updated port: a382b348-9cff-4cf4-9651-4fd406284eca {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:11:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "refresh_cache-42d7a4d5-4d2a-4803-b253-b656aec16f69" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:11:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquired lock "refresh_cache-42d7a4d5-4d2a-4803-b253-b656aec16f69" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:11:04 user nova-compute[75571]: DEBUG nova.network.neutron [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:11:04 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:11:04 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.network.neutron [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.network.neutron [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:11:05 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-6556816f-6485-4576-b797-b4316c379b86 req-a486d7d0-ad61-4e12-9352-8b3fa5973c23 service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Received event network-changed-a382b348-9cff-4cf4-9651-4fd406284eca {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-6556816f-6485-4576-b797-b4316c379b86 req-a486d7d0-ad61-4e12-9352-8b3fa5973c23 service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Refreshing instance network info cache due to event network-changed-a382b348-9cff-4cf4-9651-4fd406284eca. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6556816f-6485-4576-b797-b4316c379b86 req-a486d7d0-ad61-4e12-9352-8b3fa5973c23 service nova] Acquiring lock "refresh_cache-42d7a4d5-4d2a-4803-b253-b656aec16f69" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.policy [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:11:05 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Creating image(s)
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "/opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "/opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.221s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.network.neutron [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Updating instance_info_cache with network_info: [{"id": "a382b348-9cff-4cf4-9651-4fd406284eca", "address": "fa:16:3e:e8:84:60", "network": {"id": "0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58030690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a23adb107ea2450687260c6260f14a9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa382b348-9c", "ovs_interfaceid": "a382b348-9cff-4cf4-9651-4fd406284eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Releasing lock "refresh_cache-42d7a4d5-4d2a-4803-b253-b656aec16f69" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Instance network_info: |[{"id": "a382b348-9cff-4cf4-9651-4fd406284eca", "address": "fa:16:3e:e8:84:60", "network": {"id": "0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58030690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a23adb107ea2450687260c6260f14a9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa382b348-9c", "ovs_interfaceid": "a382b348-9cff-4cf4-9651-4fd406284eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6556816f-6485-4576-b797-b4316c379b86 req-a486d7d0-ad61-4e12-9352-8b3fa5973c23 service nova] Acquired lock "refresh_cache-42d7a4d5-4d2a-4803-b253-b656aec16f69" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.network.neutron [req-6556816f-6485-4576-b797-b4316c379b86 req-a486d7d0-ad61-4e12-9352-8b3fa5973c23 service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Refreshing network info cache for port a382b348-9cff-4cf4-9651-4fd406284eca {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Start _get_guest_xml network_info=[{"id": "a382b348-9cff-4cf4-9651-4fd406284eca", "address": "fa:16:3e:e8:84:60", "network": {"id": "0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58030690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a23adb107ea2450687260c6260f14a9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa382b348-9c", "ovs_interfaceid": "a382b348-9cff-4cf4-9651-4fd406284eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk 1073741824" returned: 0 in 0.073s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:05 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:05 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:11:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-89090598',display_name='tempest-DeleteServersTestJSON-server-89090598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-89090598',id=1,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a23adb107ea2450687260c6260f14a9e',ramdisk_id='',reservation_id='r-vsl50vbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-246706357',owner_user_name='tempest-DeleteServersTestJSON-246706357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:10:59Z,user_data=None,user_id='830afb679e5d46cca73c2ad15c3ae83b',uuid=42d7a4d5-4d2a-4803-b253-b656aec16f69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a382b348-9cff-4cf4-9651-4fd406284eca", "address": "fa:16:3e:e8:84:60", "network": {"id": "0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58030690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a23adb107ea2450687260c6260f14a9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa382b348-9c", "ovs_interfaceid": "a382b348-9cff-4cf4-9651-4fd406284eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Converting VIF {"id": "a382b348-9cff-4cf4-9651-4fd406284eca", "address": "fa:16:3e:e8:84:60", "network": {"id": "0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58030690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a23adb107ea2450687260c6260f14a9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa382b348-9c", "ovs_interfaceid": "a382b348-9cff-4cf4-9651-4fd406284eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:84:60,bridge_name='br-int',has_traffic_filtering=True,id=a382b348-9cff-4cf4-9651-4fd406284eca,network=Network(0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa382b348-9c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG nova.objects.instance [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lazy-loading 'pci_devices' on Instance uuid 42d7a4d5-4d2a-4803-b253-b656aec16f69 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:11:06 user nova-compute[75571]:   <uuid>42d7a4d5-4d2a-4803-b253-b656aec16f69</uuid>
Nov 28 20:11:06 user nova-compute[75571]:   <name>instance-00000001</name>
Nov 28 20:11:06 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:11:06 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:11:06 user nova-compute[75571]:   <metadata>
Nov 28 20:11:06 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:11:06 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:11:06 user nova-compute[75571]:       <nova:name>tempest-DeleteServersTestJSON-server-89090598</nova:name>
Nov 28 20:11:06 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:11:05</nova:creationTime>
Nov 28 20:11:06 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:11:06 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:11:06 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:11:06 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:11:06 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:11:06 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:11:06 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:11:06 user nova-compute[75571]:       <nova:owner>
Nov 28 20:11:06 user nova-compute[75571]:         <nova:user uuid="830afb679e5d46cca73c2ad15c3ae83b">tempest-DeleteServersTestJSON-246706357-project-member</nova:user>
Nov 28 20:11:06 user nova-compute[75571]:         <nova:project uuid="a23adb107ea2450687260c6260f14a9e">tempest-DeleteServersTestJSON-246706357</nova:project>
Nov 28 20:11:06 user nova-compute[75571]:       </nova:owner>
Nov 28 20:11:06 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:11:06 user nova-compute[75571]:       <nova:ports>
Nov 28 20:11:06 user nova-compute[75571]:         <nova:port uuid="a382b348-9cff-4cf4-9651-4fd406284eca">
Nov 28 20:11:06 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 20:11:06 user nova-compute[75571]:         </nova:port>
Nov 28 20:11:06 user nova-compute[75571]:       </nova:ports>
Nov 28 20:11:06 user nova-compute[75571]:     </nova:instance>
Nov 28 20:11:06 user nova-compute[75571]:   </metadata>
Nov 28 20:11:06 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:11:06 user nova-compute[75571]:     <system>
Nov 28 20:11:06 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:11:06 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:11:06 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:11:06 user nova-compute[75571]:       <entry name="serial">42d7a4d5-4d2a-4803-b253-b656aec16f69</entry>
Nov 28 20:11:06 user nova-compute[75571]:       <entry name="uuid">42d7a4d5-4d2a-4803-b253-b656aec16f69</entry>
Nov 28 20:11:06 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:11:06 user nova-compute[75571]:     </system>
Nov 28 20:11:06 user nova-compute[75571]:   </sysinfo>
Nov 28 20:11:06 user nova-compute[75571]:   <os>
Nov 28 20:11:06 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:11:06 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:11:06 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:11:06 user nova-compute[75571]:   </os>
Nov 28 20:11:06 user nova-compute[75571]:   <features>
Nov 28 20:11:06 user nova-compute[75571]:     <acpi/>
Nov 28 20:11:06 user nova-compute[75571]:     <apic/>
Nov 28 20:11:06 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:11:06 user nova-compute[75571]:   </features>
Nov 28 20:11:06 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:11:06 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:11:06 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:11:06 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:11:06 user nova-compute[75571]:   </clock>
Nov 28 20:11:06 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:11:06 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:11:06 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:11:06 user nova-compute[75571]:   </cpu>
Nov 28 20:11:06 user nova-compute[75571]:   <devices>
Nov 28 20:11:06 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:11:06 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:11:06 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk"/>
Nov 28 20:11:06 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:11:06 user nova-compute[75571]:     </disk>
Nov 28 20:11:06 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:11:06 user nova-compute[75571]:       <mac address="fa:16:3e:e8:84:60"/>
Nov 28 20:11:06 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:11:06 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:11:06 user nova-compute[75571]:       <target dev="tapa382b348-9c"/>
Nov 28 20:11:06 user nova-compute[75571]:     </interface>
Nov 28 20:11:06 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:11:06 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/console.log" append="off"/>
Nov 28 20:11:06 user nova-compute[75571]:     </serial>
Nov 28 20:11:06 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:11:06 user nova-compute[75571]:     <video>
Nov 28 20:11:06 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:11:06 user nova-compute[75571]:     </video>
Nov 28 20:11:06 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:11:06 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:11:06 user nova-compute[75571]:     </rng>
Nov 28 20:11:06 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:11:06 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:11:06 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:11:06 user nova-compute[75571]:     </memballoon>
Nov 28 20:11:06 user nova-compute[75571]:   </devices>
Nov 28 20:11:06 user nova-compute[75571]: </domain>
Nov 28 20:11:06 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-89090598',display_name='tempest-DeleteServersTestJSON-server-89090598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-89090598',id=1,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a23adb107ea2450687260c6260f14a9e',ramdisk_id='',reservation_id='r-vsl50vbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-246706357',owner_user_name='tempest-DeleteServersTestJSON-246706357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:10:59Z,user_data=None,user_id='830afb679e5d46cca73c2ad15c3ae83b',uuid=42d7a4d5-4d2a-4803-b253-b656aec16f69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a382b348-9cff-4cf4-9651-4fd406284eca", "address": "fa:16:3e:e8:84:60", "network": {"id": "0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58030690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a23adb107ea2450687260c6260f14a9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa382b348-9c", "ovs_interfaceid": "a382b348-9cff-4cf4-9651-4fd406284eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Converting VIF {"id": "a382b348-9cff-4cf4-9651-4fd406284eca", "address": "fa:16:3e:e8:84:60", "network": {"id": "0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58030690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a23adb107ea2450687260c6260f14a9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa382b348-9c", "ovs_interfaceid": "a382b348-9cff-4cf4-9651-4fd406284eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:84:60,bridge_name='br-int',has_traffic_filtering=True,id=a382b348-9cff-4cf4-9651-4fd406284eca,network=Network(0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa382b348-9c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG os_vif [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:84:60,bridge_name='br-int',has_traffic_filtering=True,id=a382b348-9cff-4cf4-9651-4fd406284eca,network=Network(0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa382b348-9c') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Created schema index Interface.name {{(pid=75571) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Created schema index Port.name {{(pid=75571) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Created schema index Bridge.name {{(pid=75571) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [POLLOUT] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.312s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e498904f-21ca-5ef7-8d84-dd57eb1705f3', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Cannot resize image /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Ensure instance console log exists: /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:11:06 user nova-compute[75571]: INFO oslo.privsep.daemon [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpglvxqv34/privsep.sock']
Nov 28 20:11:06 user sudo[84936]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpglvxqv34/privsep.sock
Nov 28 20:11:06 user sudo[84936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 20:11:07 user nova-compute[75571]: DEBUG nova.network.neutron [req-6556816f-6485-4576-b797-b4316c379b86 req-a486d7d0-ad61-4e12-9352-8b3fa5973c23 service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Updated VIF entry in instance network info cache for port a382b348-9cff-4cf4-9651-4fd406284eca. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:11:07 user nova-compute[75571]: DEBUG nova.network.neutron [req-6556816f-6485-4576-b797-b4316c379b86 req-a486d7d0-ad61-4e12-9352-8b3fa5973c23 service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Updating instance_info_cache with network_info: [{"id": "a382b348-9cff-4cf4-9651-4fd406284eca", "address": "fa:16:3e:e8:84:60", "network": {"id": "0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58030690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a23adb107ea2450687260c6260f14a9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa382b348-9c", "ovs_interfaceid": "a382b348-9cff-4cf4-9651-4fd406284eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:11:07 user nova-compute[75571]: DEBUG nova.network.neutron [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Successfully created port: ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:11:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6556816f-6485-4576-b797-b4316c379b86 req-a486d7d0-ad61-4e12-9352-8b3fa5973c23 service nova] Releasing lock "refresh_cache-42d7a4d5-4d2a-4803-b253-b656aec16f69" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:11:08 user sudo[84936]: pam_unix(sudo:session): session closed for user root
Nov 28 20:11:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:08 user nova-compute[75571]: INFO oslo.privsep.daemon [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Spawned new privsep daemon via rootwrap
Nov 28 20:11:08 user nova-compute[75571]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 20:11:08 user nova-compute[75571]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 20:11:08 user nova-compute[75571]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 28 20:11:08 user nova-compute[75571]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84952
Nov 28 20:11:08 user nova-compute[75571]: DEBUG nova.network.neutron [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Successfully updated port: ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquired lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG nova.network.neutron [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-f2b21332-d5b7-4245-a8f8-f644d883fa36 req-e82d8b18-5de0-47c4-814a-1ed4da81a3f1 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Received event network-changed-ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-f2b21332-d5b7-4245-a8f8-f644d883fa36 req-e82d8b18-5de0-47c4-814a-1ed4da81a3f1 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Refreshing instance network info cache due to event network-changed-ba72889d-186f-4e53-893b-5509d0882a6a. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f2b21332-d5b7-4245-a8f8-f644d883fa36 req-e82d8b18-5de0-47c4-814a-1ed4da81a3f1 service nova] Acquiring lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG nova.network.neutron [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa382b348-9c, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa382b348-9c, col_values=(('qos', UUID('6a2e8617-67ad-452b-933b-8bce8e6aea75')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa382b348-9c, col_values=(('external_ids', {'iface-id': 'a382b348-9cff-4cf4-9651-4fd406284eca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:84:60', 'vm-uuid': '42d7a4d5-4d2a-4803-b253-b656aec16f69'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:08 user nova-compute[75571]: INFO os_vif [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:84:60,bridge_name='br-int',has_traffic_filtering=True,id=a382b348-9cff-4cf4-9651-4fd406284eca,network=Network(0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa382b348-9c')
Nov 28 20:11:08 user nova-compute[75571]: DEBUG nova.network.neutron [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updating instance_info_cache with network_info: [{"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] No VIF found with MAC fa:16:3e:e8:84:60, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Releasing lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:11:08 user nova-compute[75571]: DEBUG nova.compute.manager [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Instance network_info: |[{"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f2b21332-d5b7-4245-a8f8-f644d883fa36 req-e82d8b18-5de0-47c4-814a-1ed4da81a3f1 service nova] Acquired lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.network.neutron [req-f2b21332-d5b7-4245-a8f8-f644d883fa36 req-e82d8b18-5de0-47c4-814a-1ed4da81a3f1 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Refreshing network info cache for port ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Start _get_guest_xml network_info=[{"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:11:09 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:09 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-397313947',display_name='tempest-ServerActionsTestOtherA-server-397313947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-397313947',id=2,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORLi9cBeKxwKZF2rkLIldgYbs91Se5SaovgAyOLlR1LAXkmJO85TwVIU01jacVfp8MokOP7s1wTMn2ItcMxD1z+b2y7pkirDp4yb/pOf68MDBPxyqhiOej8r0TiPf6AAg==',key_name='tempest-keypair-344088806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a85595c9e1704e71903d25a65f5b696c',ramdisk_id='',reservation_id='r-0pkty9pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-390918760',owner_user_name='tempest-ServerActionsTestOtherA-390918760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098319d33fa243f5a044cf3f3c9f983c',uuid=3b0d4ca0-b527-4131-97ff-222cd9ced151,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converting VIF {"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=ba72889d-186f-4e53-893b-5509d0882a6a,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba72889d-18') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.objects.instance [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b0d4ca0-b527-4131-97ff-222cd9ced151 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:11:09 user nova-compute[75571]:   <uuid>3b0d4ca0-b527-4131-97ff-222cd9ced151</uuid>
Nov 28 20:11:09 user nova-compute[75571]:   <name>instance-00000002</name>
Nov 28 20:11:09 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:11:09 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:11:09 user nova-compute[75571]:   <metadata>
Nov 28 20:11:09 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:11:09 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:11:09 user nova-compute[75571]:       <nova:name>tempest-ServerActionsTestOtherA-server-397313947</nova:name>
Nov 28 20:11:09 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:11:09</nova:creationTime>
Nov 28 20:11:09 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:11:09 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:11:09 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:11:09 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:11:09 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:11:09 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:11:09 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:11:09 user nova-compute[75571]:       <nova:owner>
Nov 28 20:11:09 user nova-compute[75571]:         <nova:user uuid="098319d33fa243f5a044cf3f3c9f983c">tempest-ServerActionsTestOtherA-390918760-project-member</nova:user>
Nov 28 20:11:09 user nova-compute[75571]:         <nova:project uuid="a85595c9e1704e71903d25a65f5b696c">tempest-ServerActionsTestOtherA-390918760</nova:project>
Nov 28 20:11:09 user nova-compute[75571]:       </nova:owner>
Nov 28 20:11:09 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:11:09 user nova-compute[75571]:       <nova:ports>
Nov 28 20:11:09 user nova-compute[75571]:         <nova:port uuid="ba72889d-186f-4e53-893b-5509d0882a6a">
Nov 28 20:11:09 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 20:11:09 user nova-compute[75571]:         </nova:port>
Nov 28 20:11:09 user nova-compute[75571]:       </nova:ports>
Nov 28 20:11:09 user nova-compute[75571]:     </nova:instance>
Nov 28 20:11:09 user nova-compute[75571]:   </metadata>
Nov 28 20:11:09 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:11:09 user nova-compute[75571]:     <system>
Nov 28 20:11:09 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:11:09 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:11:09 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:11:09 user nova-compute[75571]:       <entry name="serial">3b0d4ca0-b527-4131-97ff-222cd9ced151</entry>
Nov 28 20:11:09 user nova-compute[75571]:       <entry name="uuid">3b0d4ca0-b527-4131-97ff-222cd9ced151</entry>
Nov 28 20:11:09 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:11:09 user nova-compute[75571]:     </system>
Nov 28 20:11:09 user nova-compute[75571]:   </sysinfo>
Nov 28 20:11:09 user nova-compute[75571]:   <os>
Nov 28 20:11:09 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:11:09 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:11:09 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:11:09 user nova-compute[75571]:   </os>
Nov 28 20:11:09 user nova-compute[75571]:   <features>
Nov 28 20:11:09 user nova-compute[75571]:     <acpi/>
Nov 28 20:11:09 user nova-compute[75571]:     <apic/>
Nov 28 20:11:09 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:11:09 user nova-compute[75571]:   </features>
Nov 28 20:11:09 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:11:09 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:11:09 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:11:09 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:11:09 user nova-compute[75571]:   </clock>
Nov 28 20:11:09 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:11:09 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:11:09 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:11:09 user nova-compute[75571]:   </cpu>
Nov 28 20:11:09 user nova-compute[75571]:   <devices>
Nov 28 20:11:09 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:11:09 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:11:09 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk"/>
Nov 28 20:11:09 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:11:09 user nova-compute[75571]:     </disk>
Nov 28 20:11:09 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:11:09 user nova-compute[75571]:       <mac address="fa:16:3e:e8:68:9b"/>
Nov 28 20:11:09 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:11:09 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:11:09 user nova-compute[75571]:       <target dev="tapba72889d-18"/>
Nov 28 20:11:09 user nova-compute[75571]:     </interface>
Nov 28 20:11:09 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:11:09 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/console.log" append="off"/>
Nov 28 20:11:09 user nova-compute[75571]:     </serial>
Nov 28 20:11:09 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:11:09 user nova-compute[75571]:     <video>
Nov 28 20:11:09 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:11:09 user nova-compute[75571]:     </video>
Nov 28 20:11:09 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:11:09 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:11:09 user nova-compute[75571]:     </rng>
Nov 28 20:11:09 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:11:09 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:11:09 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:11:09 user nova-compute[75571]:     </memballoon>
Nov 28 20:11:09 user nova-compute[75571]:   </devices>
Nov 28 20:11:09 user nova-compute[75571]: </domain>
Nov 28 20:11:09 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-397313947',display_name='tempest-ServerActionsTestOtherA-server-397313947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-397313947',id=2,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORLi9cBeKxwKZF2rkLIldgYbs91Se5SaovgAyOLlR1LAXkmJO85TwVIU01jacVfp8MokOP7s1wTMn2ItcMxD1z+b2y7pkirDp4yb/pOf68MDBPxyqhiOej8r0TiPf6AAg==',key_name='tempest-keypair-344088806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a85595c9e1704e71903d25a65f5b696c',ramdisk_id='',reservation_id='r-0pkty9pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-390918760',owner_user_name='tempest-ServerActionsTestOtherA-390918760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098319d33fa243f5a044cf3f3c9f983c',uuid=3b0d4ca0-b527-4131-97ff-222cd9ced151,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converting VIF {"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=ba72889d-186f-4e53-893b-5509d0882a6a,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba72889d-18') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG os_vif [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=ba72889d-186f-4e53-893b-5509d0882a6a,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba72889d-18') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1a8c022-06a5-5fef-91ae-48efa251fb6f', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba72889d-18, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba72889d-18, col_values=(('qos', UUID('1f8e4631-edd3-4b06-910b-58eaf0b3ba4c')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba72889d-18, col_values=(('external_ids', {'iface-id': 'ba72889d-186f-4e53-893b-5509d0882a6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:68:9b', 'vm-uuid': '3b0d4ca0-b527-4131-97ff-222cd9ced151'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:09 user nova-compute[75571]: INFO os_vif [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=ba72889d-186f-4e53-893b-5509d0882a6a,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba72889d-18')
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] No VIF found with MAC fa:16:3e:e8:68:9b, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.network.neutron [req-f2b21332-d5b7-4245-a8f8-f644d883fa36 req-e82d8b18-5de0-47c4-814a-1ed4da81a3f1 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updated VIF entry in instance network info cache for port ba72889d-186f-4e53-893b-5509d0882a6a. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG nova.network.neutron [req-f2b21332-d5b7-4245-a8f8-f644d883fa36 req-e82d8b18-5de0-47c4-814a-1ed4da81a3f1 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updating instance_info_cache with network_info: [{"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f2b21332-d5b7-4245-a8f8-f644d883fa36 req-e82d8b18-5de0-47c4-814a-1ed4da81a3f1 service nova] Releasing lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:11:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "fe726611-331a-495f-a6bd-ced2d1a305b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:11:13 user nova-compute[75571]: INFO nova.compute.claims [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Claim successful on node user
Nov 28 20:11:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG nova.network.neutron [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:11:13 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:11:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG nova.policy [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d747c1fd611452f8d0e6ee1b423cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ff2e349b40430a91730a22fd4a0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:11:13 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Creating image(s)
Nov 28 20:11:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "/opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "/opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.compute.manager [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:11:14 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Instance spawned successfully.
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.compute.manager [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:14 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Instance spawned successfully.
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.288s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:14 user nova-compute[75571]: INFO nova.compute.manager [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Took 8.93 seconds to spawn the instance on the hypervisor.
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.compute.manager [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:11:14 user nova-compute[75571]: INFO nova.compute.manager [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Took 15.72 seconds to spawn the instance on the hypervisor.
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.compute.manager [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.278s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:14 user nova-compute[75571]: INFO nova.compute.manager [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Took 10.25 seconds to build instance.
Nov 28 20:11:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk 1073741824" returned: 0 in 0.136s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.420s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.628s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "958252cc-398e-4cc6-bd8d-937c99ef2b70" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:14 user nova-compute[75571]: INFO nova.compute.manager [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Took 17.04 seconds to build instance.
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.compute.manager [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.497s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.326s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:11:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG nova.network.neutron [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Successfully created port: 4ccfe8e6-0fe8-4546-8469-9c0634eaf74c {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:11:15 user nova-compute[75571]: INFO nova.compute.claims [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Claim successful on node user
Nov 28 20:11:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json" returned: 0 in 0.377s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Cannot resize image /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Ensure instance console log exists: /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG nova.compute.manager [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG nova.compute.manager [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:11:15 user nova-compute[75571]: DEBUG nova.network.neutron [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:11:15 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 28 20:11:15 user nova-compute[75571]: DEBUG nova.compute.manager [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:11:16 user nova-compute[75571]: DEBUG nova.policy [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56dee3003b03497db332c4719be3a045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b4be41b8c4b2d83a6ea935a176a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:11:16 user nova-compute[75571]: DEBUG nova.compute.manager [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:11:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:11:16 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Creating image(s)
Nov 28 20:11:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "/opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "/opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "/opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "211aeae282eb575dacf914f800a848e0fa0b293d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "211aeae282eb575dacf914f800a848e0fa0b293d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d.part --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:16 user nova-compute[75571]: DEBUG nova.network.neutron [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Successfully updated port: 4ccfe8e6-0fe8-4546-8469-9c0634eaf74c {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:11:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "refresh_cache-fe726611-331a-495f-a6bd-ced2d1a305b2" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:11:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquired lock "refresh_cache-fe726611-331a-495f-a6bd-ced2d1a305b2" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:11:16 user nova-compute[75571]: DEBUG nova.network.neutron [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:11:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d.part --force-share --output=json" returned: 0 in 0.258s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:17 user nova-compute[75571]: DEBUG nova.virt.images [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 0fe13e33-5c27-4eb1-8948-21098291272a was qcow2, converting to raw {{(pid=75571) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 20:11:17 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:11:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d.part /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d.converted {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:17 user nova-compute[75571]: DEBUG nova.network.neutron [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:11:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-3825ac38-da16-4495-a277-f77b18504aca req-3a9ab95d-6d8d-4ad6-9d7a-8aa01e6a7a99 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Received event network-changed-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-3825ac38-da16-4495-a277-f77b18504aca req-3a9ab95d-6d8d-4ad6-9d7a-8aa01e6a7a99 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Refreshing instance network info cache due to event network-changed-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:11:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3825ac38-da16-4495-a277-f77b18504aca req-3a9ab95d-6d8d-4ad6-9d7a-8aa01e6a7a99 service nova] Acquiring lock "refresh_cache-fe726611-331a-495f-a6bd-ced2d1a305b2" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:11:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d.part /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d.converted" returned: 0 in 0.441s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d.converted --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d.converted --force-share --output=json" returned: 0 in 0.272s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "211aeae282eb575dacf914f800a848e0fa0b293d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.675s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d --force-share --output=json" returned: 0 in 0.313s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "211aeae282eb575dacf914f800a848e0fa0b293d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "211aeae282eb575dacf914f800a848e0fa0b293d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.network.neutron [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Updating instance_info_cache with network_info: [{"id": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "address": "fa:16:3e:e6:89:ea", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccfe8e6-0f", "ovs_interfaceid": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d --force-share --output=json" returned: 0 in 0.376s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d,backing_fmt=raw /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Releasing lock "refresh_cache-fe726611-331a-495f-a6bd-ced2d1a305b2" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Instance network_info: |[{"id": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "address": "fa:16:3e:e6:89:ea", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccfe8e6-0f", "ovs_interfaceid": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3825ac38-da16-4495-a277-f77b18504aca req-3a9ab95d-6d8d-4ad6-9d7a-8aa01e6a7a99 service nova] Acquired lock "refresh_cache-fe726611-331a-495f-a6bd-ced2d1a305b2" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.network.neutron [req-3825ac38-da16-4495-a277-f77b18504aca req-3a9ab95d-6d8d-4ad6-9d7a-8aa01e6a7a99 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Refreshing network info cache for port 4ccfe8e6-0fe8-4546-8469-9c0634eaf74c {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Start _get_guest_xml network_info=[{"id": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "address": "fa:16:3e:e6:89:ea", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccfe8e6-0f", "ovs_interfaceid": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d,backing_fmt=raw /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk 1073741824" returned: 0 in 0.086s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "211aeae282eb575dacf914f800a848e0fa0b293d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.469s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-ed1ada1b-8de4-4d68-b440-ac99e505d9dd req-8a2309a5-9562-4dbd-8632-d7afa9a3b81d service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Received event network-vif-plugged-a382b348-9cff-4cf4-9651-4fd406284eca {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ed1ada1b-8de4-4d68-b440-ac99e505d9dd req-8a2309a5-9562-4dbd-8632-d7afa9a3b81d service nova] Acquiring lock "42d7a4d5-4d2a-4803-b253-b656aec16f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ed1ada1b-8de4-4d68-b440-ac99e505d9dd req-8a2309a5-9562-4dbd-8632-d7afa9a3b81d service nova] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ed1ada1b-8de4-4d68-b440-ac99e505d9dd req-8a2309a5-9562-4dbd-8632-d7afa9a3b81d service nova] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-ed1ada1b-8de4-4d68-b440-ac99e505d9dd req-8a2309a5-9562-4dbd-8632-d7afa9a3b81d service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] No waiting events found dispatching network-vif-plugged-a382b348-9cff-4cf4-9651-4fd406284eca {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:11:18 user nova-compute[75571]: WARNING nova.compute.manager [req-ed1ada1b-8de4-4d68-b440-ac99e505d9dd req-8a2309a5-9562-4dbd-8632-d7afa9a3b81d service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Received unexpected event network-vif-plugged-a382b348-9cff-4cf4-9651-4fd406284eca for instance with vm_state active and task_state None.
Nov 28 20:11:18 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:18 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1008982212',display_name='tempest-VolumesAdminNegativeTest-server-1008982212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1008982212',id=3,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB0OWWjuQd4dE5X2vm7yGb7xHx1upquomwhP+UabKwHK/1IkwgHLB9I3shvhWsJDuCJ6hKzLOm3A0CdQ0ZQQ0iJnqZ7fpxVqH2XiGfl3IXWC5JhikZD7HWo0MKm5CNeOQ==',key_name='tempest-keypair-1745238648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63ff2e349b40430a91730a22fd4a0487',ramdisk_id='',reservation_id='r-1pi00vjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1106730846',owner_user_name='tempest-VolumesAdminNegativeTest-1106730846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d747c1fd611452f8d0e6ee1b423cd2c',uuid=fe726611-331a-495f-a6bd-ced2d1a305b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "address": "fa:16:3e:e6:89:ea", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccfe8e6-0f", "ovs_interfaceid": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Converting VIF {"id": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "address": "fa:16:3e:e6:89:ea", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccfe8e6-0f", "ovs_interfaceid": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:89:ea,bridge_name='br-int',has_traffic_filtering=True,id=4ccfe8e6-0fe8-4546-8469-9c0634eaf74c,network=Network(3b3bc160-310f-422a-ab1d-d8090334b344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccfe8e6-0f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.objects.instance [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lazy-loading 'pci_devices' on Instance uuid fe726611-331a-495f-a6bd-ced2d1a305b2 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:11:18 user nova-compute[75571]:   <uuid>fe726611-331a-495f-a6bd-ced2d1a305b2</uuid>
Nov 28 20:11:18 user nova-compute[75571]:   <name>instance-00000003</name>
Nov 28 20:11:18 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:11:18 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:11:18 user nova-compute[75571]:   <metadata>
Nov 28 20:11:18 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:11:18 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:11:18 user nova-compute[75571]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1008982212</nova:name>
Nov 28 20:11:18 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:11:18</nova:creationTime>
Nov 28 20:11:18 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:11:18 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:11:18 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:11:18 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:11:18 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:11:18 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:11:18 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:11:18 user nova-compute[75571]:       <nova:owner>
Nov 28 20:11:18 user nova-compute[75571]:         <nova:user uuid="0d747c1fd611452f8d0e6ee1b423cd2c">tempest-VolumesAdminNegativeTest-1106730846-project-member</nova:user>
Nov 28 20:11:18 user nova-compute[75571]:         <nova:project uuid="63ff2e349b40430a91730a22fd4a0487">tempest-VolumesAdminNegativeTest-1106730846</nova:project>
Nov 28 20:11:18 user nova-compute[75571]:       </nova:owner>
Nov 28 20:11:18 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:11:18 user nova-compute[75571]:       <nova:ports>
Nov 28 20:11:18 user nova-compute[75571]:         <nova:port uuid="4ccfe8e6-0fe8-4546-8469-9c0634eaf74c">
Nov 28 20:11:18 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 20:11:18 user nova-compute[75571]:         </nova:port>
Nov 28 20:11:18 user nova-compute[75571]:       </nova:ports>
Nov 28 20:11:18 user nova-compute[75571]:     </nova:instance>
Nov 28 20:11:18 user nova-compute[75571]:   </metadata>
Nov 28 20:11:18 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:11:18 user nova-compute[75571]:     <system>
Nov 28 20:11:18 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:11:18 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:11:18 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:11:18 user nova-compute[75571]:       <entry name="serial">fe726611-331a-495f-a6bd-ced2d1a305b2</entry>
Nov 28 20:11:18 user nova-compute[75571]:       <entry name="uuid">fe726611-331a-495f-a6bd-ced2d1a305b2</entry>
Nov 28 20:11:18 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:11:18 user nova-compute[75571]:     </system>
Nov 28 20:11:18 user nova-compute[75571]:   </sysinfo>
Nov 28 20:11:18 user nova-compute[75571]:   <os>
Nov 28 20:11:18 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:11:18 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:11:18 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:11:18 user nova-compute[75571]:   </os>
Nov 28 20:11:18 user nova-compute[75571]:   <features>
Nov 28 20:11:18 user nova-compute[75571]:     <acpi/>
Nov 28 20:11:18 user nova-compute[75571]:     <apic/>
Nov 28 20:11:18 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:11:18 user nova-compute[75571]:   </features>
Nov 28 20:11:18 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:11:18 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:11:18 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:11:18 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:11:18 user nova-compute[75571]:   </clock>
Nov 28 20:11:18 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:11:18 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:11:18 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:11:18 user nova-compute[75571]:   </cpu>
Nov 28 20:11:18 user nova-compute[75571]:   <devices>
Nov 28 20:11:18 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:11:18 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:11:18 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk"/>
Nov 28 20:11:18 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:11:18 user nova-compute[75571]:     </disk>
Nov 28 20:11:18 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:11:18 user nova-compute[75571]:       <mac address="fa:16:3e:e6:89:ea"/>
Nov 28 20:11:18 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:11:18 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:11:18 user nova-compute[75571]:       <target dev="tap4ccfe8e6-0f"/>
Nov 28 20:11:18 user nova-compute[75571]:     </interface>
Nov 28 20:11:18 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:11:18 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/console.log" append="off"/>
Nov 28 20:11:18 user nova-compute[75571]:     </serial>
Nov 28 20:11:18 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:11:18 user nova-compute[75571]:     <video>
Nov 28 20:11:18 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:11:18 user nova-compute[75571]:     </video>
Nov 28 20:11:18 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:11:18 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:11:18 user nova-compute[75571]:     </rng>
Nov 28 20:11:18 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:11:18 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:11:18 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:11:18 user nova-compute[75571]:     </memballoon>
Nov 28 20:11:18 user nova-compute[75571]:   </devices>
Nov 28 20:11:18 user nova-compute[75571]: </domain>
Nov 28 20:11:18 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1008982212',display_name='tempest-VolumesAdminNegativeTest-server-1008982212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1008982212',id=3,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB0OWWjuQd4dE5X2vm7yGb7xHx1upquomwhP+UabKwHK/1IkwgHLB9I3shvhWsJDuCJ6hKzLOm3A0CdQ0ZQQ0iJnqZ7fpxVqH2XiGfl3IXWC5JhikZD7HWo0MKm5CNeOQ==',key_name='tempest-keypair-1745238648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63ff2e349b40430a91730a22fd4a0487',ramdisk_id='',reservation_id='r-1pi00vjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1106730846',owner_user_name='tempest-VolumesAdminNegativeTest-1106730846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d747c1fd611452f8d0e6ee1b423cd2c',uuid=fe726611-331a-495f-a6bd-ced2d1a305b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "address": "fa:16:3e:e6:89:ea", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccfe8e6-0f", "ovs_interfaceid": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Converting VIF {"id": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "address": "fa:16:3e:e6:89:ea", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccfe8e6-0f", "ovs_interfaceid": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:89:ea,bridge_name='br-int',has_traffic_filtering=True,id=4ccfe8e6-0fe8-4546-8469-9c0634eaf74c,network=Network(3b3bc160-310f-422a-ab1d-d8090334b344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccfe8e6-0f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG os_vif [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:89:ea,bridge_name='br-int',has_traffic_filtering=True,id=4ccfe8e6-0fe8-4546-8469-9c0634eaf74c,network=Network(3b3bc160-310f-422a-ab1d-d8090334b344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccfe8e6-0f') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cef65a49-6ac7-5711-8bf9-05a6e775fefa', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ccfe8e6-0f, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ccfe8e6-0f, col_values=(('qos', UUID('b36fcd25-4acb-4c6a-b47c-0cedf5dd3990')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ccfe8e6-0f, col_values=(('external_ids', {'iface-id': '4ccfe8e6-0fe8-4546-8469-9c0634eaf74c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:89:ea', 'vm-uuid': 'fe726611-331a-495f-a6bd-ced2d1a305b2'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d --force-share --output=json" returned: 0 in 0.245s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Checking if we can resize image /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:18 user nova-compute[75571]: INFO os_vif [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:89:ea,bridge_name='br-int',has_traffic_filtering=True,id=4ccfe8e6-0fe8-4546-8469-9c0634eaf74c,network=Network(3b3bc160-310f-422a-ab1d-d8090334b344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccfe8e6-0f')
Nov 28 20:11:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:11:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] No VIF found with MAC fa:16:3e:e6:89:ea, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:11:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:19 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Cannot resize image /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:11:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:11:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Ensure instance console log exists: /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:11:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:19 user nova-compute[75571]: DEBUG nova.network.neutron [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Successfully created port: 0fd6ab13-839a-4071-a3d1-60b901aea40f {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:11:19 user nova-compute[75571]: DEBUG nova.network.neutron [req-3825ac38-da16-4495-a277-f77b18504aca req-3a9ab95d-6d8d-4ad6-9d7a-8aa01e6a7a99 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Updated VIF entry in instance network info cache for port 4ccfe8e6-0fe8-4546-8469-9c0634eaf74c. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:11:19 user nova-compute[75571]: DEBUG nova.network.neutron [req-3825ac38-da16-4495-a277-f77b18504aca req-3a9ab95d-6d8d-4ad6-9d7a-8aa01e6a7a99 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Updating instance_info_cache with network_info: [{"id": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "address": "fa:16:3e:e6:89:ea", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccfe8e6-0f", "ovs_interfaceid": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:11:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3825ac38-da16-4495-a277-f77b18504aca req-3a9ab95d-6d8d-4ad6-9d7a-8aa01e6a7a99 service nova] Releasing lock "refresh_cache-fe726611-331a-495f-a6bd-ced2d1a305b2" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:11:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Successfully updated port: 0fd6ab13-839a-4071-a3d1-60b901aea40f {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "refresh_cache-958252cc-398e-4cc6-bd8d-937c99ef2b70" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquired lock "refresh_cache-958252cc-398e-4cc6-bd8d-937c99ef2b70" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-084e80aa-0b98-4e04-92c2-98031a26174d req-c88fdf86-a4d1-42ce-9427-f0fe5334fcf7 service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Received event network-changed-0fd6ab13-839a-4071-a3d1-60b901aea40f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-084e80aa-0b98-4e04-92c2-98031a26174d req-c88fdf86-a4d1-42ce-9427-f0fe5334fcf7 service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Refreshing instance network info cache due to event network-changed-0fd6ab13-839a-4071-a3d1-60b901aea40f. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-084e80aa-0b98-4e04-92c2-98031a26174d req-c88fdf86-a4d1-42ce-9427-f0fe5334fcf7 service nova] Acquiring lock "refresh_cache-958252cc-398e-4cc6-bd8d-937c99ef2b70" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Updating instance_info_cache with network_info: [{"id": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "address": "fa:16:3e:7b:92:e2", "network": {"id": "b64cd5b4-e6ba-413d-839a-465e577eebb4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1905929996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4b4be41b8c4b2d83a6ea935a176a7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd6ab13-83", "ovs_interfaceid": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Releasing lock "refresh_cache-958252cc-398e-4cc6-bd8d-937c99ef2b70" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Instance network_info: |[{"id": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "address": "fa:16:3e:7b:92:e2", "network": {"id": "b64cd5b4-e6ba-413d-839a-465e577eebb4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1905929996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4b4be41b8c4b2d83a6ea935a176a7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd6ab13-83", "ovs_interfaceid": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-084e80aa-0b98-4e04-92c2-98031a26174d req-c88fdf86-a4d1-42ce-9427-f0fe5334fcf7 service nova] Acquired lock "refresh_cache-958252cc-398e-4cc6-bd8d-937c99ef2b70" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.network.neutron [req-084e80aa-0b98-4e04-92c2-98031a26174d req-c88fdf86-a4d1-42ce-9427-f0fe5334fcf7 service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Refreshing network info cache for port 0fd6ab13-839a-4071-a3d1-60b901aea40f {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Start _get_guest_xml network_info=[{"id": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "address": "fa:16:3e:7b:92:e2", "network": {"id": "b64cd5b4-e6ba-413d-839a-465e577eebb4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1905929996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4b4be41b8c4b2d83a6ea935a176a7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd6ab13-83", "ovs_interfaceid": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:11:06Z,direct_url=<?>,disk_format='qcow2',id=0fe13e33-5c27-4eb1-8948-21098291272a,min_disk=0,min_ram=0,name='',owner='86cfc082dccb47b4862ba46e9ea57cdc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:11:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '0fe13e33-5c27-4eb1-8948-21098291272a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-7fdbb88f-ddd3-4442-9c0a-ff1dc2bcab18 req-3e207a93-519a-4d6f-a6aa-43996ab59c0c service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Received event network-vif-plugged-a382b348-9cff-4cf4-9651-4fd406284eca {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7fdbb88f-ddd3-4442-9c0a-ff1dc2bcab18 req-3e207a93-519a-4d6f-a6aa-43996ab59c0c service nova] Acquiring lock "42d7a4d5-4d2a-4803-b253-b656aec16f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7fdbb88f-ddd3-4442-9c0a-ff1dc2bcab18 req-3e207a93-519a-4d6f-a6aa-43996ab59c0c service nova] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7fdbb88f-ddd3-4442-9c0a-ff1dc2bcab18 req-3e207a93-519a-4d6f-a6aa-43996ab59c0c service nova] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-7fdbb88f-ddd3-4442-9c0a-ff1dc2bcab18 req-3e207a93-519a-4d6f-a6aa-43996ab59c0c service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] No waiting events found dispatching network-vif-plugged-a382b348-9cff-4cf4-9651-4fd406284eca {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:11:20 user nova-compute[75571]: WARNING nova.compute.manager [req-7fdbb88f-ddd3-4442-9c0a-ff1dc2bcab18 req-3e207a93-519a-4d6f-a6aa-43996ab59c0c service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Received unexpected event network-vif-plugged-a382b348-9cff-4cf4-9651-4fd406284eca for instance with vm_state active and task_state None.
Nov 28 20:11:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:20 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:20 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:11:06Z,direct_url=<?>,disk_format='qcow2',id=0fe13e33-5c27-4eb1-8948-21098291272a,min_disk=0,min_ram=0,name='',owner='86cfc082dccb47b4862ba46e9ea57cdc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:11:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-34592518',display_name='tempest-AttachSCSIVolumeTestJSON-server-34592518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-34592518',id=4,image_ref='0fe13e33-5c27-4eb1-8948-21098291272a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYplXzwET4VCxpdXETVYQ20/108yZbkDYnBL+bsxPCGkwSbdM1+M+pvjeXnNj257ALlRgNAx6Chap7EsPxZI+6RHrK5yLGGnnoitoanfrSqV2YSww6dqblLCraEp0Kt8A==',key_name='tempest-keypair-1011383959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed4b4be41b8c4b2d83a6ea935a176a7e',ramdisk_id='',reservation_id='r-0bcn38w4',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0fe13e33-5c27-4eb1-8948-21098291272a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2114135896',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2114135896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:11:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56dee3003b03497db332c4719be3a045',uuid=958252cc-398e-4cc6-bd8d-937c99ef2b70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "address": "fa:16:3e:7b:92:e2", "network": {"id": "b64cd5b4-e6ba-413d-839a-465e577eebb4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1905929996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4b4be41b8c4b2d83a6ea935a176a7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd6ab13-83", "ovs_interfaceid": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Converting VIF {"id": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "address": "fa:16:3e:7b:92:e2", "network": {"id": "b64cd5b4-e6ba-413d-839a-465e577eebb4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1905929996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4b4be41b8c4b2d83a6ea935a176a7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd6ab13-83", "ovs_interfaceid": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:92:e2,bridge_name='br-int',has_traffic_filtering=True,id=0fd6ab13-839a-4071-a3d1-60b901aea40f,network=Network(b64cd5b4-e6ba-413d-839a-465e577eebb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd6ab13-83') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:11:20 user nova-compute[75571]: DEBUG nova.objects.instance [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lazy-loading 'pci_devices' on Instance uuid 958252cc-398e-4cc6-bd8d-937c99ef2b70 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:11:21 user nova-compute[75571]:   <uuid>958252cc-398e-4cc6-bd8d-937c99ef2b70</uuid>
Nov 28 20:11:21 user nova-compute[75571]:   <name>instance-00000004</name>
Nov 28 20:11:21 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:11:21 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:11:21 user nova-compute[75571]:   <metadata>
Nov 28 20:11:21 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:11:21 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:11:21 user nova-compute[75571]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-34592518</nova:name>
Nov 28 20:11:21 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:11:20</nova:creationTime>
Nov 28 20:11:21 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:11:21 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:11:21 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:11:21 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:11:21 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:11:21 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:11:21 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:11:21 user nova-compute[75571]:       <nova:owner>
Nov 28 20:11:21 user nova-compute[75571]:         <nova:user uuid="56dee3003b03497db332c4719be3a045">tempest-AttachSCSIVolumeTestJSON-2114135896-project-member</nova:user>
Nov 28 20:11:21 user nova-compute[75571]:         <nova:project uuid="ed4b4be41b8c4b2d83a6ea935a176a7e">tempest-AttachSCSIVolumeTestJSON-2114135896</nova:project>
Nov 28 20:11:21 user nova-compute[75571]:       </nova:owner>
Nov 28 20:11:21 user nova-compute[75571]:       <nova:root type="image" uuid="0fe13e33-5c27-4eb1-8948-21098291272a"/>
Nov 28 20:11:21 user nova-compute[75571]:       <nova:ports>
Nov 28 20:11:21 user nova-compute[75571]:         <nova:port uuid="0fd6ab13-839a-4071-a3d1-60b901aea40f">
Nov 28 20:11:21 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 20:11:21 user nova-compute[75571]:         </nova:port>
Nov 28 20:11:21 user nova-compute[75571]:       </nova:ports>
Nov 28 20:11:21 user nova-compute[75571]:     </nova:instance>
Nov 28 20:11:21 user nova-compute[75571]:   </metadata>
Nov 28 20:11:21 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:11:21 user nova-compute[75571]:     <system>
Nov 28 20:11:21 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:11:21 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:11:21 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:11:21 user nova-compute[75571]:       <entry name="serial">958252cc-398e-4cc6-bd8d-937c99ef2b70</entry>
Nov 28 20:11:21 user nova-compute[75571]:       <entry name="uuid">958252cc-398e-4cc6-bd8d-937c99ef2b70</entry>
Nov 28 20:11:21 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:11:21 user nova-compute[75571]:     </system>
Nov 28 20:11:21 user nova-compute[75571]:   </sysinfo>
Nov 28 20:11:21 user nova-compute[75571]:   <os>
Nov 28 20:11:21 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:11:21 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:11:21 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:11:21 user nova-compute[75571]:   </os>
Nov 28 20:11:21 user nova-compute[75571]:   <features>
Nov 28 20:11:21 user nova-compute[75571]:     <acpi/>
Nov 28 20:11:21 user nova-compute[75571]:     <apic/>
Nov 28 20:11:21 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:11:21 user nova-compute[75571]:   </features>
Nov 28 20:11:21 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:11:21 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:11:21 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:11:21 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:11:21 user nova-compute[75571]:   </clock>
Nov 28 20:11:21 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:11:21 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:11:21 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:11:21 user nova-compute[75571]:   </cpu>
Nov 28 20:11:21 user nova-compute[75571]:   <devices>
Nov 28 20:11:21 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:11:21 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:11:21 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk"/>
Nov 28 20:11:21 user nova-compute[75571]:       <target dev="sda" bus="scsi"/>
Nov 28 20:11:21 user nova-compute[75571]:       <address type="drive" controller="0" unit="0"/>
Nov 28 20:11:21 user nova-compute[75571]:     </disk>
Nov 28 20:11:21 user nova-compute[75571]:     <disk type="file" device="cdrom">
Nov 28 20:11:21 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 20:11:21 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk.config"/>
Nov 28 20:11:21 user nova-compute[75571]:       <target dev="sdb" bus="scsi"/>
Nov 28 20:11:21 user nova-compute[75571]:       <address type="drive" controller="0" unit="1"/>
Nov 28 20:11:21 user nova-compute[75571]:     </disk>
Nov 28 20:11:21 user nova-compute[75571]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 28 20:11:21 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:11:21 user nova-compute[75571]:       <mac address="fa:16:3e:7b:92:e2"/>
Nov 28 20:11:21 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:11:21 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:11:21 user nova-compute[75571]:       <target dev="tap0fd6ab13-83"/>
Nov 28 20:11:21 user nova-compute[75571]:     </interface>
Nov 28 20:11:21 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:11:21 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/console.log" append="off"/>
Nov 28 20:11:21 user nova-compute[75571]:     </serial>
Nov 28 20:11:21 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:11:21 user nova-compute[75571]:     <video>
Nov 28 20:11:21 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:11:21 user nova-compute[75571]:     </video>
Nov 28 20:11:21 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:11:21 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:11:21 user nova-compute[75571]:     </rng>
Nov 28 20:11:21 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:11:21 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:11:21 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:11:21 user nova-compute[75571]:     </memballoon>
Nov 28 20:11:21 user nova-compute[75571]:   </devices>
Nov 28 20:11:21 user nova-compute[75571]: </domain>
Nov 28 20:11:21 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-34592518',display_name='tempest-AttachSCSIVolumeTestJSON-server-34592518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-34592518',id=4,image_ref='0fe13e33-5c27-4eb1-8948-21098291272a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYplXzwET4VCxpdXETVYQ20/108yZbkDYnBL+bsxPCGkwSbdM1+M+pvjeXnNj257ALlRgNAx6Chap7EsPxZI+6RHrK5yLGGnnoitoanfrSqV2YSww6dqblLCraEp0Kt8A==',key_name='tempest-keypair-1011383959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed4b4be41b8c4b2d83a6ea935a176a7e',ramdisk_id='',reservation_id='r-0bcn38w4',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0fe13e33-5c27-4eb1-8948-21098291272a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2114135896',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2114135896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:11:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56dee3003b03497db332c4719be3a045',uuid=958252cc-398e-4cc6-bd8d-937c99ef2b70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "address": "fa:16:3e:7b:92:e2", "network": {"id": "b64cd5b4-e6ba-413d-839a-465e577eebb4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1905929996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4b4be41b8c4b2d83a6ea935a176a7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd6ab13-83", "ovs_interfaceid": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Converting VIF {"id": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "address": "fa:16:3e:7b:92:e2", "network": {"id": "b64cd5b4-e6ba-413d-839a-465e577eebb4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1905929996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4b4be41b8c4b2d83a6ea935a176a7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd6ab13-83", "ovs_interfaceid": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:92:e2,bridge_name='br-int',has_traffic_filtering=True,id=0fd6ab13-839a-4071-a3d1-60b901aea40f,network=Network(b64cd5b4-e6ba-413d-839a-465e577eebb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd6ab13-83') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG os_vif [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:92:e2,bridge_name='br-int',has_traffic_filtering=True,id=0fd6ab13-839a-4071-a3d1-60b901aea40f,network=Network(b64cd5b4-e6ba-413d-839a-465e577eebb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd6ab13-83') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a64c7cec-3944-531a-a810-eead51fbca51', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fd6ab13-83, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fd6ab13-83, col_values=(('qos', UUID('14b3eaf2-8611-459b-a546-b011223ba9ad')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fd6ab13-83, col_values=(('external_ids', {'iface-id': '0fd6ab13-839a-4071-a3d1-60b901aea40f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:92:e2', 'vm-uuid': '958252cc-398e-4cc6-bd8d-937c99ef2b70'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:21 user nova-compute[75571]: INFO os_vif [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:92:e2,bridge_name='br-int',has_traffic_filtering=True,id=0fd6ab13-839a-4071-a3d1-60b901aea40f,network=Network(b64cd5b4-e6ba-413d-839a-465e577eebb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd6ab13-83')
Nov 28 20:11:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] No BDM found with device name sda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:11:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] No VIF found with MAC fa:16:3e:7b:92:e2, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:11:21 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Using config drive
Nov 28 20:11:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:22 user nova-compute[75571]: DEBUG nova.network.neutron [req-084e80aa-0b98-4e04-92c2-98031a26174d req-c88fdf86-a4d1-42ce-9427-f0fe5334fcf7 service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Updated VIF entry in instance network info cache for port 0fd6ab13-839a-4071-a3d1-60b901aea40f. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:11:22 user nova-compute[75571]: DEBUG nova.network.neutron [req-084e80aa-0b98-4e04-92c2-98031a26174d req-c88fdf86-a4d1-42ce-9427-f0fe5334fcf7 service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Updating instance_info_cache with network_info: [{"id": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "address": "fa:16:3e:7b:92:e2", "network": {"id": "b64cd5b4-e6ba-413d-839a-465e577eebb4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1905929996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4b4be41b8c4b2d83a6ea935a176a7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd6ab13-83", "ovs_interfaceid": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:11:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-084e80aa-0b98-4e04-92c2-98031a26174d req-c88fdf86-a4d1-42ce-9427-f0fe5334fcf7 service nova] Releasing lock "refresh_cache-958252cc-398e-4cc6-bd8d-937c99ef2b70" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:11:22 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Creating config drive at /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk.config
Nov 28 20:11:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjrkjkryh {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjrkjkryh" returned: 0 in 0.076s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:11:23 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Instance spawned successfully.
Nov 28 20:11:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:11:23 user nova-compute[75571]: INFO nova.compute.manager [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Took 10.07 seconds to spawn the instance on the hypervisor.
Nov 28 20:11:23 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:23 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:11:23 user nova-compute[75571]: INFO nova.compute.claims [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Claim successful on node user
Nov 28 20:11:24 user nova-compute[75571]: INFO nova.compute.manager [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Took 11.13 seconds to build instance.
Nov 28 20:11:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.383s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:24 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:11:24 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:11:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.784s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:24 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:11:25 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:11:25 user nova-compute[75571]: DEBUG nova.network.neutron [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:11:25 user nova-compute[75571]: DEBUG nova.policy [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c5dbb5a65014af3b72843ad4fccd06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356c386b1804c90ad27fd57bf6961ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:11:25 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:11:25 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:11:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:25 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:11:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:11:25 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Creating image(s)
Nov 28 20:11:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "/opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "/opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.288s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.238s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk 1073741824" returned: 0 in 0.087s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG nova.network.neutron [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Successfully created port: 6ec42ed1-ea9b-462e-b695-22222a022c1d {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-7c445e01-f5f8-4168-b43e-610a043e85a0 req-9a7fde26-2765-4349-bc4a-3008890ea74e service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Received event network-vif-plugged-ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7c445e01-f5f8-4168-b43e-610a043e85a0 req-9a7fde26-2765-4349-bc4a-3008890ea74e service nova] Acquiring lock "3b0d4ca0-b527-4131-97ff-222cd9ced151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7c445e01-f5f8-4168-b43e-610a043e85a0 req-9a7fde26-2765-4349-bc4a-3008890ea74e service nova] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7c445e01-f5f8-4168-b43e-610a043e85a0 req-9a7fde26-2765-4349-bc4a-3008890ea74e service nova] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-7c445e01-f5f8-4168-b43e-610a043e85a0 req-9a7fde26-2765-4349-bc4a-3008890ea74e service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] No waiting events found dispatching network-vif-plugged-ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:11:26 user nova-compute[75571]: WARNING nova.compute.manager [req-7c445e01-f5f8-4168-b43e-610a043e85a0 req-9a7fde26-2765-4349-bc4a-3008890ea74e service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Received unexpected event network-vif-plugged-ba72889d-186f-4e53-893b-5509d0882a6a for instance with vm_state active and task_state None.
Nov 28 20:11:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.392s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:11:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Cannot resize image /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Ensure instance console log exists: /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-1b227e69-0da0-4575-8cea-76136db85ebb req-15dd6927-ce3a-44d4-bfbb-f01336247982 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Received event network-vif-plugged-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1b227e69-0da0-4575-8cea-76136db85ebb req-15dd6927-ce3a-44d4-bfbb-f01336247982 service nova] Acquiring lock "fe726611-331a-495f-a6bd-ced2d1a305b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1b227e69-0da0-4575-8cea-76136db85ebb req-15dd6927-ce3a-44d4-bfbb-f01336247982 service nova] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1b227e69-0da0-4575-8cea-76136db85ebb req-15dd6927-ce3a-44d4-bfbb-f01336247982 service nova] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-1b227e69-0da0-4575-8cea-76136db85ebb req-15dd6927-ce3a-44d4-bfbb-f01336247982 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] No waiting events found dispatching network-vif-plugged-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:11:27 user nova-compute[75571]: WARNING nova.compute.manager [req-1b227e69-0da0-4575-8cea-76136db85ebb req-15dd6927-ce3a-44d4-bfbb-f01336247982 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Received unexpected event network-vif-plugged-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c for instance with vm_state active and task_state None.
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.network.neutron [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Successfully updated port: 6ec42ed1-ea9b-462e-b695-22222a022c1d {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "refresh_cache-a3084b80-68e5-44f6-b87d-4f7ad6b31756" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquired lock "refresh_cache-a3084b80-68e5-44f6-b87d-4f7ad6b31756" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.network.neutron [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-7daa70d8-a617-44f4-8a7b-90654e8330c4 req-b9bc5a80-04e6-4ae2-a86f-4f22c5ecf5cd service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Received event network-changed-6ec42ed1-ea9b-462e-b695-22222a022c1d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-7daa70d8-a617-44f4-8a7b-90654e8330c4 req-b9bc5a80-04e6-4ae2-a86f-4f22c5ecf5cd service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Refreshing instance network info cache due to event network-changed-6ec42ed1-ea9b-462e-b695-22222a022c1d. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7daa70d8-a617-44f4-8a7b-90654e8330c4 req-b9bc5a80-04e6-4ae2-a86f-4f22c5ecf5cd service nova] Acquiring lock "refresh_cache-a3084b80-68e5-44f6-b87d-4f7ad6b31756" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.compute.manager [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:11:27 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Instance spawned successfully.
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:27 user nova-compute[75571]: DEBUG nova.network.neutron [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:11:28 user nova-compute[75571]: INFO nova.compute.manager [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Took 11.97 seconds to spawn the instance on the hypervisor.
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:11:28 user nova-compute[75571]: INFO nova.compute.manager [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Took 13.33 seconds to build instance.
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.681s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.network.neutron [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Updating instance_info_cache with network_info: [{"id": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "address": "fa:16:3e:a2:d7:f5", "network": {"id": "3c7d9d10-c298-4672-8ae8-c59553384435", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1579611606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f356c386b1804c90ad27fd57bf6961ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec42ed1-ea", "ovs_interfaceid": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Releasing lock "refresh_cache-a3084b80-68e5-44f6-b87d-4f7ad6b31756" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Instance network_info: |[{"id": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "address": "fa:16:3e:a2:d7:f5", "network": {"id": "3c7d9d10-c298-4672-8ae8-c59553384435", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1579611606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f356c386b1804c90ad27fd57bf6961ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec42ed1-ea", "ovs_interfaceid": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7daa70d8-a617-44f4-8a7b-90654e8330c4 req-b9bc5a80-04e6-4ae2-a86f-4f22c5ecf5cd service nova] Acquired lock "refresh_cache-a3084b80-68e5-44f6-b87d-4f7ad6b31756" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.network.neutron [req-7daa70d8-a617-44f4-8a7b-90654e8330c4 req-b9bc5a80-04e6-4ae2-a86f-4f22c5ecf5cd service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Refreshing network info cache for port 6ec42ed1-ea9b-462e-b695-22222a022c1d {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Start _get_guest_xml network_info=[{"id": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "address": "fa:16:3e:a2:d7:f5", "network": {"id": "3c7d9d10-c298-4672-8ae8-c59553384435", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1579611606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f356c386b1804c90ad27fd57bf6961ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec42ed1-ea", "ovs_interfaceid": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:11:28 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:28 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1477944076',display_name='tempest-TestVolumeSwap-server-1477944076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1477944076',id=5,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8qccgJ5L8n2VbmiZBJmXIcygNAyfnrvdVnhom0xN/KuMQ/b/tRiFbGabtnWwx5S33ukRea3zF/Z2zg9/+kWuwckhkbdQ/DMvabwXKP+5ly21Od6ocu0Es/N0ywrUvRAA==',key_name='tempest-keypair-1029990611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f356c386b1804c90ad27fd57bf6961ce',ramdisk_id='',reservation_id='r-tf9tgnu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2014144021',owner_user_name='tempest-TestVolumeSwap-2014144021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:11:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c5dbb5a65014af3b72843ad4fccd06f',uuid=a3084b80-68e5-44f6-b87d-4f7ad6b31756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "address": "fa:16:3e:a2:d7:f5", "network": {"id": "3c7d9d10-c298-4672-8ae8-c59553384435", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1579611606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f356c386b1804c90ad27fd57bf6961ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec42ed1-ea", "ovs_interfaceid": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Converting VIF {"id": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "address": "fa:16:3e:a2:d7:f5", "network": {"id": "3c7d9d10-c298-4672-8ae8-c59553384435", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1579611606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f356c386b1804c90ad27fd57bf6961ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec42ed1-ea", "ovs_interfaceid": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d7:f5,bridge_name='br-int',has_traffic_filtering=True,id=6ec42ed1-ea9b-462e-b695-22222a022c1d,network=Network(3c7d9d10-c298-4672-8ae8-c59553384435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ec42ed1-ea') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.objects.instance [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lazy-loading 'pci_devices' on Instance uuid a3084b80-68e5-44f6-b87d-4f7ad6b31756 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:11:28 user nova-compute[75571]:   <uuid>a3084b80-68e5-44f6-b87d-4f7ad6b31756</uuid>
Nov 28 20:11:28 user nova-compute[75571]:   <name>instance-00000005</name>
Nov 28 20:11:28 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:11:28 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:11:28 user nova-compute[75571]:   <metadata>
Nov 28 20:11:28 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:11:28 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:11:28 user nova-compute[75571]:       <nova:name>tempest-TestVolumeSwap-server-1477944076</nova:name>
Nov 28 20:11:28 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:11:28</nova:creationTime>
Nov 28 20:11:28 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:11:28 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:11:28 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:11:28 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:11:28 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:11:28 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:11:28 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:11:28 user nova-compute[75571]:       <nova:owner>
Nov 28 20:11:28 user nova-compute[75571]:         <nova:user uuid="8c5dbb5a65014af3b72843ad4fccd06f">tempest-TestVolumeSwap-2014144021-project-member</nova:user>
Nov 28 20:11:28 user nova-compute[75571]:         <nova:project uuid="f356c386b1804c90ad27fd57bf6961ce">tempest-TestVolumeSwap-2014144021</nova:project>
Nov 28 20:11:28 user nova-compute[75571]:       </nova:owner>
Nov 28 20:11:28 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:11:28 user nova-compute[75571]:       <nova:ports>
Nov 28 20:11:28 user nova-compute[75571]:         <nova:port uuid="6ec42ed1-ea9b-462e-b695-22222a022c1d">
Nov 28 20:11:28 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 20:11:28 user nova-compute[75571]:         </nova:port>
Nov 28 20:11:28 user nova-compute[75571]:       </nova:ports>
Nov 28 20:11:28 user nova-compute[75571]:     </nova:instance>
Nov 28 20:11:28 user nova-compute[75571]:   </metadata>
Nov 28 20:11:28 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:11:28 user nova-compute[75571]:     <system>
Nov 28 20:11:28 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:11:28 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:11:28 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:11:28 user nova-compute[75571]:       <entry name="serial">a3084b80-68e5-44f6-b87d-4f7ad6b31756</entry>
Nov 28 20:11:28 user nova-compute[75571]:       <entry name="uuid">a3084b80-68e5-44f6-b87d-4f7ad6b31756</entry>
Nov 28 20:11:28 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:11:28 user nova-compute[75571]:     </system>
Nov 28 20:11:28 user nova-compute[75571]:   </sysinfo>
Nov 28 20:11:28 user nova-compute[75571]:   <os>
Nov 28 20:11:28 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:11:28 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:11:28 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:11:28 user nova-compute[75571]:   </os>
Nov 28 20:11:28 user nova-compute[75571]:   <features>
Nov 28 20:11:28 user nova-compute[75571]:     <acpi/>
Nov 28 20:11:28 user nova-compute[75571]:     <apic/>
Nov 28 20:11:28 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:11:28 user nova-compute[75571]:   </features>
Nov 28 20:11:28 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:11:28 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:11:28 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:11:28 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:11:28 user nova-compute[75571]:   </clock>
Nov 28 20:11:28 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:11:28 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:11:28 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:11:28 user nova-compute[75571]:   </cpu>
Nov 28 20:11:28 user nova-compute[75571]:   <devices>
Nov 28 20:11:28 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:11:28 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:11:28 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk"/>
Nov 28 20:11:28 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:11:28 user nova-compute[75571]:     </disk>
Nov 28 20:11:28 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:11:28 user nova-compute[75571]:       <mac address="fa:16:3e:a2:d7:f5"/>
Nov 28 20:11:28 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:11:28 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:11:28 user nova-compute[75571]:       <target dev="tap6ec42ed1-ea"/>
Nov 28 20:11:28 user nova-compute[75571]:     </interface>
Nov 28 20:11:28 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:11:28 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/console.log" append="off"/>
Nov 28 20:11:28 user nova-compute[75571]:     </serial>
Nov 28 20:11:28 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:11:28 user nova-compute[75571]:     <video>
Nov 28 20:11:28 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:11:28 user nova-compute[75571]:     </video>
Nov 28 20:11:28 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:11:28 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:11:28 user nova-compute[75571]:     </rng>
Nov 28 20:11:28 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:11:28 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:11:28 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:11:28 user nova-compute[75571]:     </memballoon>
Nov 28 20:11:28 user nova-compute[75571]:   </devices>
Nov 28 20:11:28 user nova-compute[75571]: </domain>
Nov 28 20:11:28 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1477944076',display_name='tempest-TestVolumeSwap-server-1477944076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1477944076',id=5,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8qccgJ5L8n2VbmiZBJmXIcygNAyfnrvdVnhom0xN/KuMQ/b/tRiFbGabtnWwx5S33ukRea3zF/Z2zg9/+kWuwckhkbdQ/DMvabwXKP+5ly21Od6ocu0Es/N0ywrUvRAA==',key_name='tempest-keypair-1029990611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f356c386b1804c90ad27fd57bf6961ce',ramdisk_id='',reservation_id='r-tf9tgnu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2014144021',owner_user_name='tempest-TestVolumeSwap-2014144021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:11:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c5dbb5a65014af3b72843ad4fccd06f',uuid=a3084b80-68e5-44f6-b87d-4f7ad6b31756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "address": "fa:16:3e:a2:d7:f5", "network": {"id": "3c7d9d10-c298-4672-8ae8-c59553384435", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1579611606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f356c386b1804c90ad27fd57bf6961ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec42ed1-ea", "ovs_interfaceid": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Converting VIF {"id": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "address": "fa:16:3e:a2:d7:f5", "network": {"id": "3c7d9d10-c298-4672-8ae8-c59553384435", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1579611606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f356c386b1804c90ad27fd57bf6961ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec42ed1-ea", "ovs_interfaceid": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d7:f5,bridge_name='br-int',has_traffic_filtering=True,id=6ec42ed1-ea9b-462e-b695-22222a022c1d,network=Network(3c7d9d10-c298-4672-8ae8-c59553384435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ec42ed1-ea') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG os_vif [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d7:f5,bridge_name='br-int',has_traffic_filtering=True,id=6ec42ed1-ea9b-462e-b695-22222a022c1d,network=Network(3c7d9d10-c298-4672-8ae8-c59553384435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ec42ed1-ea') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be558122-6ac3-5d20-bcdf-4ca01da53b6d', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ec42ed1-ea, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ec42ed1-ea, col_values=(('qos', UUID('70c5c99b-3606-4948-8d2b-fa8737e3beba')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ec42ed1-ea, col_values=(('external_ids', {'iface-id': '6ec42ed1-ea9b-462e-b695-22222a022c1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:d7:f5', 'vm-uuid': 'a3084b80-68e5-44f6-b87d-4f7ad6b31756'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:28 user nova-compute[75571]: INFO os_vif [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d7:f5,bridge_name='br-int',has_traffic_filtering=True,id=6ec42ed1-ea9b-462e-b695-22222a022c1d,network=Network(3c7d9d10-c298-4672-8ae8-c59553384435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ec42ed1-ea')
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] No VIF found with MAC fa:16:3e:a2:d7:f5, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-42a3570d-a5ec-4cd3-84c7-b9b760da7861 req-233f880d-eb58-42ac-a052-97e71ff59697 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Received event network-vif-plugged-ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-42a3570d-a5ec-4cd3-84c7-b9b760da7861 req-233f880d-eb58-42ac-a052-97e71ff59697 service nova] Acquiring lock "3b0d4ca0-b527-4131-97ff-222cd9ced151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-42a3570d-a5ec-4cd3-84c7-b9b760da7861 req-233f880d-eb58-42ac-a052-97e71ff59697 service nova] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-42a3570d-a5ec-4cd3-84c7-b9b760da7861 req-233f880d-eb58-42ac-a052-97e71ff59697 service nova] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-42a3570d-a5ec-4cd3-84c7-b9b760da7861 req-233f880d-eb58-42ac-a052-97e71ff59697 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] No waiting events found dispatching network-vif-plugged-ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:11:29 user nova-compute[75571]: WARNING nova.compute.manager [req-42a3570d-a5ec-4cd3-84c7-b9b760da7861 req-233f880d-eb58-42ac-a052-97e71ff59697 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Received unexpected event network-vif-plugged-ba72889d-186f-4e53-893b-5509d0882a6a for instance with vm_state active and task_state None.
Nov 28 20:11:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG nova.network.neutron [req-7daa70d8-a617-44f4-8a7b-90654e8330c4 req-b9bc5a80-04e6-4ae2-a86f-4f22c5ecf5cd service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Updated VIF entry in instance network info cache for port 6ec42ed1-ea9b-462e-b695-22222a022c1d. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG nova.network.neutron [req-7daa70d8-a617-44f4-8a7b-90654e8330c4 req-b9bc5a80-04e6-4ae2-a86f-4f22c5ecf5cd service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Updating instance_info_cache with network_info: [{"id": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "address": "fa:16:3e:a2:d7:f5", "network": {"id": "3c7d9d10-c298-4672-8ae8-c59553384435", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1579611606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f356c386b1804c90ad27fd57bf6961ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec42ed1-ea", "ovs_interfaceid": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7daa70d8-a617-44f4-8a7b-90654e8330c4 req-b9bc5a80-04e6-4ae2-a86f-4f22c5ecf5cd service nova] Releasing lock "refresh_cache-a3084b80-68e5-44f6-b87d-4f7ad6b31756" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Received event network-vif-plugged-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Acquiring lock "fe726611-331a-495f-a6bd-ced2d1a305b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] No waiting events found dispatching network-vif-plugged-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:11:29 user nova-compute[75571]: WARNING nova.compute.manager [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Received unexpected event network-vif-plugged-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c for instance with vm_state active and task_state None.
Nov 28 20:11:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Received event network-vif-plugged-0fd6ab13-839a-4071-a3d1-60b901aea40f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Acquiring lock "958252cc-398e-4cc6-bd8d-937c99ef2b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] No waiting events found dispatching network-vif-plugged-0fd6ab13-839a-4071-a3d1-60b901aea40f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:11:29 user nova-compute[75571]: WARNING nova.compute.manager [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Received unexpected event network-vif-plugged-0fd6ab13-839a-4071-a3d1-60b901aea40f for instance with vm_state active and task_state None.
Nov 28 20:11:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Received event network-vif-plugged-0fd6ab13-839a-4071-a3d1-60b901aea40f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Acquiring lock "958252cc-398e-4cc6-bd8d-937c99ef2b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] No waiting events found dispatching network-vif-plugged-0fd6ab13-839a-4071-a3d1-60b901aea40f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:11:29 user nova-compute[75571]: WARNING nova.compute.manager [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Received unexpected event network-vif-plugged-0fd6ab13-839a-4071-a3d1-60b901aea40f for instance with vm_state active and task_state None.
Nov 28 20:11:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:31 user nova-compute[75571]: DEBUG nova.compute.manager [req-ea5b9b52-901c-4777-80f8-ee7f774bee7e req-e3b38e4e-acdc-4681-9065-32940d5e2555 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Received event network-vif-plugged-6ec42ed1-ea9b-462e-b695-22222a022c1d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ea5b9b52-901c-4777-80f8-ee7f774bee7e req-e3b38e4e-acdc-4681-9065-32940d5e2555 service nova] Acquiring lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ea5b9b52-901c-4777-80f8-ee7f774bee7e req-e3b38e4e-acdc-4681-9065-32940d5e2555 service nova] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ea5b9b52-901c-4777-80f8-ee7f774bee7e req-e3b38e4e-acdc-4681-9065-32940d5e2555 service nova] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:31 user nova-compute[75571]: DEBUG nova.compute.manager [req-ea5b9b52-901c-4777-80f8-ee7f774bee7e req-e3b38e4e-acdc-4681-9065-32940d5e2555 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] No waiting events found dispatching network-vif-plugged-6ec42ed1-ea9b-462e-b695-22222a022c1d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:11:31 user nova-compute[75571]: WARNING nova.compute.manager [req-ea5b9b52-901c-4777-80f8-ee7f774bee7e req-e3b38e4e-acdc-4681-9065-32940d5e2555 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Received unexpected event network-vif-plugged-6ec42ed1-ea9b-462e-b695-22222a022c1d for instance with vm_state building and task_state spawning.
Nov 28 20:11:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:34 user nova-compute[75571]: DEBUG nova.compute.manager [req-42f4901d-d008-4921-b014-1acc09de72bd req-3790dff0-66cf-4648-a4d4-6a7bd6f99752 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Received event network-vif-plugged-6ec42ed1-ea9b-462e-b695-22222a022c1d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-42f4901d-d008-4921-b014-1acc09de72bd req-3790dff0-66cf-4648-a4d4-6a7bd6f99752 service nova] Acquiring lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-42f4901d-d008-4921-b014-1acc09de72bd req-3790dff0-66cf-4648-a4d4-6a7bd6f99752 service nova] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-42f4901d-d008-4921-b014-1acc09de72bd req-3790dff0-66cf-4648-a4d4-6a7bd6f99752 service nova] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:34 user nova-compute[75571]: DEBUG nova.compute.manager [req-42f4901d-d008-4921-b014-1acc09de72bd req-3790dff0-66cf-4648-a4d4-6a7bd6f99752 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] No waiting events found dispatching network-vif-plugged-6ec42ed1-ea9b-462e-b695-22222a022c1d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:11:34 user nova-compute[75571]: WARNING nova.compute.manager [req-42f4901d-d008-4921-b014-1acc09de72bd req-3790dff0-66cf-4648-a4d4-6a7bd6f99752 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Received unexpected event network-vif-plugged-6ec42ed1-ea9b-462e-b695-22222a022c1d for instance with vm_state building and task_state spawning.
Nov 28 20:11:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:11:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:11:35 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Instance spawned successfully.
Nov 28 20:11:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:11:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:35 user nova-compute[75571]: INFO nova.compute.manager [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Took 9.59 seconds to spawn the instance on the hypervisor.
Nov 28 20:11:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:11:35 user nova-compute[75571]: INFO nova.compute.manager [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Took 11.60 seconds to build instance.
Nov 28 20:11:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.759s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "415392e8-bf6c-433e-a4f5-be3d99419710" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "415392e8-bf6c-433e-a4f5-be3d99419710" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:11:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:37 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:11:37 user nova-compute[75571]: INFO nova.compute.claims [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Claim successful on node user
Nov 28 20:11:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:38 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:11:38 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:11:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:11:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:11:38 user nova-compute[75571]: DEBUG nova.network.neutron [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:11:38 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:11:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:11:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:11:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:11:38 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Creating image(s)
Nov 28 20:11:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "/opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "/opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "/opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.027s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:38 user nova-compute[75571]: DEBUG nova.policy [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac5d0e5911d94f0c96e5065db9729740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b1448d67fd4c94a0d1374ed792b428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:11:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.281s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.335s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk 1073741824" returned: 0 in 0.075s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.419s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:39 user nova-compute[75571]: DEBUG nova.network.neutron [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Successfully created port: 317f4a0e-b709-4696-9a61-0c8067789331 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:11:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.323s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:39 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Checking if we can resize image /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:11:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:40 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Cannot resize image /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:11:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:11:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Ensure instance console log exists: /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:11:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Successfully updated port: 317f4a0e-b709-4696-9a61-0c8067789331 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "refresh_cache-415392e8-bf6c-433e-a4f5-be3d99419710" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquired lock "refresh_cache-415392e8-bf6c-433e-a4f5-be3d99419710" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-1d9e2d5c-b77a-4211-86d6-a1bec47ef490 req-83bef32e-7b90-4113-8db9-07b21fa05ffb service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Received event network-changed-317f4a0e-b709-4696-9a61-0c8067789331 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-1d9e2d5c-b77a-4211-86d6-a1bec47ef490 req-83bef32e-7b90-4113-8db9-07b21fa05ffb service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Refreshing instance network info cache due to event network-changed-317f4a0e-b709-4696-9a61-0c8067789331. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1d9e2d5c-b77a-4211-86d6-a1bec47ef490 req-83bef32e-7b90-4113-8db9-07b21fa05ffb service nova] Acquiring lock "refresh_cache-415392e8-bf6c-433e-a4f5-be3d99419710" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Updating instance_info_cache with network_info: [{"id": "317f4a0e-b709-4696-9a61-0c8067789331", "address": "fa:16:3e:d0:dd:5e", "network": {"id": "af31f11d-7ec4-4cc7-b346-0acf29157d15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-444410556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b1448d67fd4c94a0d1374ed792b428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f4a0e-b7", "ovs_interfaceid": "317f4a0e-b709-4696-9a61-0c8067789331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Releasing lock "refresh_cache-415392e8-bf6c-433e-a4f5-be3d99419710" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Instance network_info: |[{"id": "317f4a0e-b709-4696-9a61-0c8067789331", "address": "fa:16:3e:d0:dd:5e", "network": {"id": "af31f11d-7ec4-4cc7-b346-0acf29157d15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-444410556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b1448d67fd4c94a0d1374ed792b428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f4a0e-b7", "ovs_interfaceid": "317f4a0e-b709-4696-9a61-0c8067789331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1d9e2d5c-b77a-4211-86d6-a1bec47ef490 req-83bef32e-7b90-4113-8db9-07b21fa05ffb service nova] Acquired lock "refresh_cache-415392e8-bf6c-433e-a4f5-be3d99419710" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.network.neutron [req-1d9e2d5c-b77a-4211-86d6-a1bec47ef490 req-83bef32e-7b90-4113-8db9-07b21fa05ffb service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Refreshing network info cache for port 317f4a0e-b709-4696-9a61-0c8067789331 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Start _get_guest_xml network_info=[{"id": "317f4a0e-b709-4696-9a61-0c8067789331", "address": "fa:16:3e:d0:dd:5e", "network": {"id": "af31f11d-7ec4-4cc7-b346-0acf29157d15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-444410556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b1448d67fd4c94a0d1374ed792b428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f4a0e-b7", "ovs_interfaceid": "317f4a0e-b709-4696-9a61-0c8067789331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:11:41 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:41 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:11:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-42165751',display_name='tempest-VolumesAssistedSnapshotsTest-server-42165751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-42165751',id=6,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG6Xb2b289i94kzq7mRKEPfFFFiPwMG1Ax8zd+3NfUydS8o64GAfxeGZLhx6dUt1q6V5b8gVKa4LMu8Qe11Hu8MDVA+VA1GLE3Pw67neyU87X6frDyM9AaWBV48vqdSfw==',key_name='tempest-keypair-448215708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16b1448d67fd4c94a0d1374ed792b428',ramdisk_id='',reservation_id='r-3mfm29ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1397496501',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1397496501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac5d0e5911d94f0c96e5065db9729740',uuid=415392e8-bf6c-433e-a4f5-be3d99419710,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "317f4a0e-b709-4696-9a61-0c8067789331", "address": "fa:16:3e:d0:dd:5e", "network": {"id": "af31f11d-7ec4-4cc7-b346-0acf29157d15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-444410556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b1448d67fd4c94a0d1374ed792b428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f4a0e-b7", "ovs_interfaceid": "317f4a0e-b709-4696-9a61-0c8067789331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Converting VIF {"id": "317f4a0e-b709-4696-9a61-0c8067789331", "address": "fa:16:3e:d0:dd:5e", "network": {"id": "af31f11d-7ec4-4cc7-b346-0acf29157d15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-444410556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b1448d67fd4c94a0d1374ed792b428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f4a0e-b7", "ovs_interfaceid": "317f4a0e-b709-4696-9a61-0c8067789331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=317f4a0e-b709-4696-9a61-0c8067789331,network=Network(af31f11d-7ec4-4cc7-b346-0acf29157d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317f4a0e-b7') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG nova.objects.instance [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lazy-loading 'pci_devices' on Instance uuid 415392e8-bf6c-433e-a4f5-be3d99419710 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:11:42 user nova-compute[75571]:   <uuid>415392e8-bf6c-433e-a4f5-be3d99419710</uuid>
Nov 28 20:11:42 user nova-compute[75571]:   <name>instance-00000006</name>
Nov 28 20:11:42 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:11:42 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:11:42 user nova-compute[75571]:   <metadata>
Nov 28 20:11:42 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:11:42 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:11:42 user nova-compute[75571]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-42165751</nova:name>
Nov 28 20:11:42 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:11:41</nova:creationTime>
Nov 28 20:11:42 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:11:42 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:11:42 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:11:42 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:11:42 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:11:42 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:11:42 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:11:42 user nova-compute[75571]:       <nova:owner>
Nov 28 20:11:42 user nova-compute[75571]:         <nova:user uuid="ac5d0e5911d94f0c96e5065db9729740">tempest-VolumesAssistedSnapshotsTest-1397496501-project-member</nova:user>
Nov 28 20:11:42 user nova-compute[75571]:         <nova:project uuid="16b1448d67fd4c94a0d1374ed792b428">tempest-VolumesAssistedSnapshotsTest-1397496501</nova:project>
Nov 28 20:11:42 user nova-compute[75571]:       </nova:owner>
Nov 28 20:11:42 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:11:42 user nova-compute[75571]:       <nova:ports>
Nov 28 20:11:42 user nova-compute[75571]:         <nova:port uuid="317f4a0e-b709-4696-9a61-0c8067789331">
Nov 28 20:11:42 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:11:42 user nova-compute[75571]:         </nova:port>
Nov 28 20:11:42 user nova-compute[75571]:       </nova:ports>
Nov 28 20:11:42 user nova-compute[75571]:     </nova:instance>
Nov 28 20:11:42 user nova-compute[75571]:   </metadata>
Nov 28 20:11:42 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:11:42 user nova-compute[75571]:     <system>
Nov 28 20:11:42 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:11:42 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:11:42 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:11:42 user nova-compute[75571]:       <entry name="serial">415392e8-bf6c-433e-a4f5-be3d99419710</entry>
Nov 28 20:11:42 user nova-compute[75571]:       <entry name="uuid">415392e8-bf6c-433e-a4f5-be3d99419710</entry>
Nov 28 20:11:42 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:11:42 user nova-compute[75571]:     </system>
Nov 28 20:11:42 user nova-compute[75571]:   </sysinfo>
Nov 28 20:11:42 user nova-compute[75571]:   <os>
Nov 28 20:11:42 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:11:42 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:11:42 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:11:42 user nova-compute[75571]:   </os>
Nov 28 20:11:42 user nova-compute[75571]:   <features>
Nov 28 20:11:42 user nova-compute[75571]:     <acpi/>
Nov 28 20:11:42 user nova-compute[75571]:     <apic/>
Nov 28 20:11:42 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:11:42 user nova-compute[75571]:   </features>
Nov 28 20:11:42 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:11:42 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:11:42 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:11:42 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:11:42 user nova-compute[75571]:   </clock>
Nov 28 20:11:42 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:11:42 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:11:42 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:11:42 user nova-compute[75571]:   </cpu>
Nov 28 20:11:42 user nova-compute[75571]:   <devices>
Nov 28 20:11:42 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:11:42 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:11:42 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk"/>
Nov 28 20:11:42 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:11:42 user nova-compute[75571]:     </disk>
Nov 28 20:11:42 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:11:42 user nova-compute[75571]:       <mac address="fa:16:3e:d0:dd:5e"/>
Nov 28 20:11:42 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:11:42 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:11:42 user nova-compute[75571]:       <target dev="tap317f4a0e-b7"/>
Nov 28 20:11:42 user nova-compute[75571]:     </interface>
Nov 28 20:11:42 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:11:42 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/console.log" append="off"/>
Nov 28 20:11:42 user nova-compute[75571]:     </serial>
Nov 28 20:11:42 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:11:42 user nova-compute[75571]:     <video>
Nov 28 20:11:42 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:11:42 user nova-compute[75571]:     </video>
Nov 28 20:11:42 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:11:42 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:11:42 user nova-compute[75571]:     </rng>
Nov 28 20:11:42 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:11:42 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:11:42 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:11:42 user nova-compute[75571]:     </memballoon>
Nov 28 20:11:42 user nova-compute[75571]:   </devices>
Nov 28 20:11:42 user nova-compute[75571]: </domain>
Nov 28 20:11:42 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-42165751',display_name='tempest-VolumesAssistedSnapshotsTest-server-42165751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-42165751',id=6,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG6Xb2b289i94kzq7mRKEPfFFFiPwMG1Ax8zd+3NfUydS8o64GAfxeGZLhx6dUt1q6V5b8gVKa4LMu8Qe11Hu8MDVA+VA1GLE3Pw67neyU87X6frDyM9AaWBV48vqdSfw==',key_name='tempest-keypair-448215708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16b1448d67fd4c94a0d1374ed792b428',ramdisk_id='',reservation_id='r-3mfm29ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1397496501',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1397496501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac5d0e5911d94f0c96e5065db9729740',uuid=415392e8-bf6c-433e-a4f5-be3d99419710,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "317f4a0e-b709-4696-9a61-0c8067789331", "address": "fa:16:3e:d0:dd:5e", "network": {"id": "af31f11d-7ec4-4cc7-b346-0acf29157d15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-444410556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b1448d67fd4c94a0d1374ed792b428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f4a0e-b7", "ovs_interfaceid": "317f4a0e-b709-4696-9a61-0c8067789331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Converting VIF {"id": "317f4a0e-b709-4696-9a61-0c8067789331", "address": "fa:16:3e:d0:dd:5e", "network": {"id": "af31f11d-7ec4-4cc7-b346-0acf29157d15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-444410556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b1448d67fd4c94a0d1374ed792b428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f4a0e-b7", "ovs_interfaceid": "317f4a0e-b709-4696-9a61-0c8067789331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=317f4a0e-b709-4696-9a61-0c8067789331,network=Network(af31f11d-7ec4-4cc7-b346-0acf29157d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317f4a0e-b7') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG os_vif [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=317f4a0e-b709-4696-9a61-0c8067789331,network=Network(af31f11d-7ec4-4cc7-b346-0acf29157d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317f4a0e-b7') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '482b47af-69b1-5b37-a997-3862a30768fe', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap317f4a0e-b7, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap317f4a0e-b7, col_values=(('qos', UUID('101b4e8e-b2cd-45f7-a98e-7ec0cda32971')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap317f4a0e-b7, col_values=(('external_ids', {'iface-id': '317f4a0e-b709-4696-9a61-0c8067789331', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:dd:5e', 'vm-uuid': '415392e8-bf6c-433e-a4f5-be3d99419710'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:42 user nova-compute[75571]: INFO os_vif [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=317f4a0e-b709-4696-9a61-0c8067789331,network=Network(af31f11d-7ec4-4cc7-b346-0acf29157d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317f4a0e-b7')
Nov 28 20:11:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] No VIF found with MAC fa:16:3e:d0:dd:5e, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "59a360a3-bce3-4673-b79e-cd0460d2a69a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG nova.network.neutron [req-1d9e2d5c-b77a-4211-86d6-a1bec47ef490 req-83bef32e-7b90-4113-8db9-07b21fa05ffb service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Updated VIF entry in instance network info cache for port 317f4a0e-b709-4696-9a61-0c8067789331. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG nova.network.neutron [req-1d9e2d5c-b77a-4211-86d6-a1bec47ef490 req-83bef32e-7b90-4113-8db9-07b21fa05ffb service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Updating instance_info_cache with network_info: [{"id": "317f4a0e-b709-4696-9a61-0c8067789331", "address": "fa:16:3e:d0:dd:5e", "network": {"id": "af31f11d-7ec4-4cc7-b346-0acf29157d15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-444410556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b1448d67fd4c94a0d1374ed792b428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f4a0e-b7", "ovs_interfaceid": "317f4a0e-b709-4696-9a61-0c8067789331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1d9e2d5c-b77a-4211-86d6-a1bec47ef490 req-83bef32e-7b90-4113-8db9-07b21fa05ffb service nova] Releasing lock "refresh_cache-415392e8-bf6c-433e-a4f5-be3d99419710" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:42 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:11:42 user nova-compute[75571]: INFO nova.compute.claims [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Claim successful on node user
Nov 28 20:11:43 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:11:43 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:11:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:43 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:11:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:43 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:11:43 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:11:43 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:11:43 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:11:43 user nova-compute[75571]: INFO nova.virt.block_device [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Booting with volume fa0184f2-4a56-4d02-95cb-f5b41506ed72 at /dev/vda
Nov 28 20:11:43 user nova-compute[75571]: DEBUG nova.policy [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:11:43 user nova-compute[75571]: DEBUG os_brick.utils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:11:43 user nova-compute[75571]: INFO oslo.privsep.daemon [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpa8exsac7/privsep.sock']
Nov 28 20:11:43 user sudo[85882]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpa8exsac7/privsep.sock
Nov 28 20:11:43 user sudo[85882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 20:11:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:44 user nova-compute[75571]: DEBUG nova.compute.manager [req-43ee1ac9-202a-4fc4-a3f3-b5e1ee622700 req-e5425dff-c575-4f1b-af4e-ac58a44357b6 service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Received event network-vif-plugged-317f4a0e-b709-4696-9a61-0c8067789331 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-43ee1ac9-202a-4fc4-a3f3-b5e1ee622700 req-e5425dff-c575-4f1b-af4e-ac58a44357b6 service nova] Acquiring lock "415392e8-bf6c-433e-a4f5-be3d99419710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-43ee1ac9-202a-4fc4-a3f3-b5e1ee622700 req-e5425dff-c575-4f1b-af4e-ac58a44357b6 service nova] Lock "415392e8-bf6c-433e-a4f5-be3d99419710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-43ee1ac9-202a-4fc4-a3f3-b5e1ee622700 req-e5425dff-c575-4f1b-af4e-ac58a44357b6 service nova] Lock "415392e8-bf6c-433e-a4f5-be3d99419710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:44 user nova-compute[75571]: DEBUG nova.compute.manager [req-43ee1ac9-202a-4fc4-a3f3-b5e1ee622700 req-e5425dff-c575-4f1b-af4e-ac58a44357b6 service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] No waiting events found dispatching network-vif-plugged-317f4a0e-b709-4696-9a61-0c8067789331 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:11:44 user nova-compute[75571]: WARNING nova.compute.manager [req-43ee1ac9-202a-4fc4-a3f3-b5e1ee622700 req-e5425dff-c575-4f1b-af4e-ac58a44357b6 service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Received unexpected event network-vif-plugged-317f4a0e-b709-4696-9a61-0c8067789331 for instance with vm_state building and task_state spawning.
Nov 28 20:11:45 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Successfully created port: d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:11:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:46 user nova-compute[75571]: INFO oslo.privsep.daemon [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Spawned new privsep daemon via rootwrap
Nov 28 20:11:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Successfully updated port: d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:11:46 user sudo[85882]: pam_unix(sudo:session): session closed for user root
Nov 28 20:11:46 user nova-compute[75571]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 20:11:46 user nova-compute[75571]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 20:11:46 user nova-compute[75571]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 28 20:11:46 user nova-compute[75571]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86013
Nov 28 20:11:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-fdad6e4d-d916-44ed-bd17-bda7ded42516 req-d407cfdd-fb01-4eca-ba8c-4393149f13a8 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received event network-changed-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-fdad6e4d-d916-44ed-bd17-bda7ded42516 req-d407cfdd-fb01-4eca-ba8c-4393149f13a8 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Refreshing instance network info cache due to event network-changed-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fdad6e4d-d916-44ed-bd17-bda7ded42516 req-d407cfdd-fb01-4eca-ba8c-4393149f13a8 service nova] Acquiring lock "refresh_cache-59a360a3-bce3-4673-b79e-cd0460d2a69a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fdad6e4d-d916-44ed-bd17-bda7ded42516 req-d407cfdd-fb01-4eca-ba8c-4393149f13a8 service nova] Acquired lock "refresh_cache-59a360a3-bce3-4673-b79e-cd0460d2a69a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG nova.network.neutron [req-fdad6e4d-d916-44ed-bd17-bda7ded42516 req-d407cfdd-fb01-4eca-ba8c-4393149f13a8 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Refreshing network info cache for port d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8c0734-4ab5-4c81-ba2c-cec6df840db2]: (2,) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-02bb7f55-1879-45c2-8b9d-bb7a14c413c2 req-ed85a0ee-7092-4d05-adf9-898dbfa266ed service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Received event network-vif-plugged-317f4a0e-b709-4696-9a61-0c8067789331 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-02bb7f55-1879-45c2-8b9d-bb7a14c413c2 req-ed85a0ee-7092-4d05-adf9-898dbfa266ed service nova] Acquiring lock "415392e8-bf6c-433e-a4f5-be3d99419710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-02bb7f55-1879-45c2-8b9d-bb7a14c413c2 req-ed85a0ee-7092-4d05-adf9-898dbfa266ed service nova] Lock "415392e8-bf6c-433e-a4f5-be3d99419710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-02bb7f55-1879-45c2-8b9d-bb7a14c413c2 req-ed85a0ee-7092-4d05-adf9-898dbfa266ed service nova] Lock "415392e8-bf6c-433e-a4f5-be3d99419710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-02bb7f55-1879-45c2-8b9d-bb7a14c413c2 req-ed85a0ee-7092-4d05-adf9-898dbfa266ed service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] No waiting events found dispatching network-vif-plugged-317f4a0e-b709-4696-9a61-0c8067789331 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:11:46 user nova-compute[75571]: WARNING nova.compute.manager [req-02bb7f55-1879-45c2-8b9d-bb7a14c413c2 req-ed85a0ee-7092-4d05-adf9-898dbfa266ed service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Received unexpected event network-vif-plugged-317f4a0e-b709-4696-9a61-0c8067789331 for instance with vm_state building and task_state spawning.
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "refresh_cache-59a360a3-bce3-4673-b79e-cd0460d2a69a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.040s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d997bdd0-3f07-4041-a923-a05469a68087]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:46 user nova-compute[75571]: WARNING os_brick.initiator.connectors.nvmeof [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a17ef5e-9101-4a5c-aebd-3f9aaf5f04bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG nova.network.neutron [req-fdad6e4d-d916-44ed-bd17-bda7ded42516 req-d407cfdd-fb01-4eca-ba8c-4393149f13a8 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32ad652-1689-42f3-bfb6-fe977172d074]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e26785-7501-4962-b36d-3ac1e3935531]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:11:46 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:11:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef26086e-143b-4ecd-b9cc-05aa5ed3648d]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG os_brick.utils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] <== get_connector_properties: return (3028ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:11:46 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Updating existing volume attachment record: eea69796-5505-473b-961b-6d8dbc5b314b {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.network.neutron [req-fdad6e4d-d916-44ed-bd17-bda7ded42516 req-d407cfdd-fb01-4eca-ba8c-4393149f13a8 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fdad6e4d-d916-44ed-bd17-bda7ded42516 req-d407cfdd-fb01-4eca-ba8c-4393149f13a8 service nova] Releasing lock "refresh_cache-59a360a3-bce3-4673-b79e-cd0460d2a69a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquired lock "refresh_cache-59a360a3-bce3-4673-b79e-cd0460d2a69a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] There are 0 instances to clean {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75571) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:11:47 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Instance spawned successfully.
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Updating instance_info_cache with network_info: [{"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Releasing lock "refresh_cache-59a360a3-bce3-4673-b79e-cd0460d2a69a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Instance network_info: |[{"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:11:47 user nova-compute[75571]: INFO nova.compute.manager [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Took 9.04 seconds to spawn the instance on the hypervisor.
Nov 28 20:11:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:11:48 user nova-compute[75571]: INFO nova.compute.manager [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Took 10.10 seconds to build instance.
Nov 28 20:11:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "415392e8-bf6c-433e-a4f5-be3d99419710" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.285s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:11:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:11:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:11:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Skipping network cache update for instance because it is Building. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 20:11:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-42d7a4d5-4d2a-4803-b253-b656aec16f69" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:11:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-42d7a4d5-4d2a-4803-b253-b656aec16f69" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:11:49 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:11:49 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 42d7a4d5-4d2a-4803-b253-b656aec16f69 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:11:50 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Updating instance_info_cache with network_info: [{"id": "a382b348-9cff-4cf4-9651-4fd406284eca", "address": "fa:16:3e:e8:84:60", "network": {"id": "0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58030690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a23adb107ea2450687260c6260f14a9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa382b348-9c", "ovs_interfaceid": "a382b348-9cff-4cf4-9651-4fd406284eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:11:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-42d7a4d5-4d2a-4803-b253-b656aec16f69" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:11:50 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:11:50 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:11:50 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:11:50 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:11:50 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:11:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:11:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:52 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:11:53 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:11:53 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:11:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:54 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:11:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:54 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:11:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:11:55 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Creating image(s)
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Ensure instance console log exists: /opt/stack/data/nova/instances/59a360a3-bce3-4673-b79e-cd0460d2a69a/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Start _get_guest_xml network_info=[{"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLvfdWST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '59a360a3-bce3-4673-b79e-cd0460d2a69a', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa0184f2-4a56-4d02-95cb-f5b41506ed72', 'serial': 'fa0184f2-4a56-4d02-95cb-f5b41506ed72'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'eea69796-5505-473b-961b-6d8dbc5b314b', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:11:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG os_brick.initiator.connector [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Factory for ISCSI on None {{(pid=75571) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLvfdWST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:11:55 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:11:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:11:55 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:11:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:11:55 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75f46db-3448-4b87-b37b-e2da09915794]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:11:55 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a97269-6bea-4ea1-b4fa-01a200ae0edd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72] added
Nov 28 20:11:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e000ad41-d23d-47d6-92a0-61190fa56d0a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[907fa9f2-dd58-469a-b7d3-8479949082b4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLvfdWST {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLvfdWST" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dd7ea9-93cd-4cc7-979f-8148b7a57f52]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XLvfdWST'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02f1f0e-f438-42ce-b4f1-7e7c2357ea03]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe9d202-1609-4fb1-abee-e092199941be]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:11:55 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:11:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:11:55 user nova-compute[75571]:  {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:11:55 user nova-compute[75571]: WARNING os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 20:11:55 user nova-compute[75571]: 
Nov 28 20:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1f7c12-6f38-4f27-a325-60a75db88a45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260]
Nov 28 20:11:56 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260] successful.
Nov 28 20:11:56 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da2a34a-ecef-4fad-a6b2-f19c784a3e71]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99beda7-0e4e-4234-8ae4-35ecd64f4cba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:11:56 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:11:56 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6478b354-c887-4ae2-a872-3131480cc31d]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLvfdWST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23732623863633531', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732623863633531', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-875799677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-875799677',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6AuAWbbxZ0a6c7k1XS3X9t+pB3TAuStJooLKz16kYFR2aaVuQipo+CXoACBi2Birf2Rm15MEr9uQoGxphTgBDTn1HrWp9mOU4ZppNU69KCYDLZF6bXiACp5QJvGeeHcw==',key_name='tempest-keypair-1302784070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fed1996731e94c8eb5c16e6327b32f39',ramdisk_id='',reservation_id='r-lg4xji60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-323010200',owner_user_name='tempest-ServerActionsV293TestJSON-323010200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:11:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d313e776858a411ea463adecd1f36819',uuid=59a360a3-bce3-4673-b79e-cd0460d2a69a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Converting VIF {"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:9b:4a,bridge_name='br-int',has_traffic_filtering=True,id=d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c,network=Network(8b0c6ae3-604b-433f-920b-f28cc17a9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1934d1e-ff') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lazy-loading 'pci_devices' on Instance uuid 59a360a3-bce3-4673-b79e-cd0460d2a69a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:11:57 user nova-compute[75571]:   <uuid>59a360a3-bce3-4673-b79e-cd0460d2a69a</uuid>
Nov 28 20:11:57 user nova-compute[75571]:   <name>instance-00000007</name>
Nov 28 20:11:57 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:11:57 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:11:57 user nova-compute[75571]:   <metadata>
Nov 28 20:11:57 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:11:57 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:11:57 user nova-compute[75571]:       <nova:name>tempest-ServerActionsV293TestJSON-server-875799677</nova:name>
Nov 28 20:11:57 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:11:55</nova:creationTime>
Nov 28 20:11:57 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:11:57 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:11:57 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:11:57 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:11:57 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:11:57 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:11:57 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:11:57 user nova-compute[75571]:       <nova:owner>
Nov 28 20:11:57 user nova-compute[75571]:         <nova:user uuid="d313e776858a411ea463adecd1f36819">tempest-ServerActionsV293TestJSON-323010200-project-member</nova:user>
Nov 28 20:11:57 user nova-compute[75571]:         <nova:project uuid="fed1996731e94c8eb5c16e6327b32f39">tempest-ServerActionsV293TestJSON-323010200</nova:project>
Nov 28 20:11:57 user nova-compute[75571]:       </nova:owner>
Nov 28 20:11:57 user nova-compute[75571]:       <nova:ports>
Nov 28 20:11:57 user nova-compute[75571]:         <nova:port uuid="d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c">
Nov 28 20:11:57 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 20:11:57 user nova-compute[75571]:         </nova:port>
Nov 28 20:11:57 user nova-compute[75571]:       </nova:ports>
Nov 28 20:11:57 user nova-compute[75571]:     </nova:instance>
Nov 28 20:11:57 user nova-compute[75571]:   </metadata>
Nov 28 20:11:57 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:11:57 user nova-compute[75571]:     <system>
Nov 28 20:11:57 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:11:57 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:11:57 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:11:57 user nova-compute[75571]:       <entry name="serial">59a360a3-bce3-4673-b79e-cd0460d2a69a</entry>
Nov 28 20:11:57 user nova-compute[75571]:       <entry name="uuid">59a360a3-bce3-4673-b79e-cd0460d2a69a</entry>
Nov 28 20:11:57 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:11:57 user nova-compute[75571]:     </system>
Nov 28 20:11:57 user nova-compute[75571]:   </sysinfo>
Nov 28 20:11:57 user nova-compute[75571]:   <os>
Nov 28 20:11:57 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:11:57 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:11:57 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:11:57 user nova-compute[75571]:   </os>
Nov 28 20:11:57 user nova-compute[75571]:   <features>
Nov 28 20:11:57 user nova-compute[75571]:     <acpi/>
Nov 28 20:11:57 user nova-compute[75571]:     <apic/>
Nov 28 20:11:57 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:11:57 user nova-compute[75571]:   </features>
Nov 28 20:11:57 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:11:57 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:11:57 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:11:57 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:11:57 user nova-compute[75571]:   </clock>
Nov 28 20:11:57 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:11:57 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:11:57 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:11:57 user nova-compute[75571]:   </cpu>
Nov 28 20:11:57 user nova-compute[75571]:   <devices>
Nov 28 20:11:57 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:11:57 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:11:57 user nova-compute[75571]:       <source dev="/dev/sdb"/>
Nov 28 20:11:57 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:11:57 user nova-compute[75571]:       <serial>fa0184f2-4a56-4d02-95cb-f5b41506ed72</serial>
Nov 28 20:11:57 user nova-compute[75571]:     </disk>
Nov 28 20:11:57 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:11:57 user nova-compute[75571]:       <mac address="fa:16:3e:23:9b:4a"/>
Nov 28 20:11:57 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:11:57 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:11:57 user nova-compute[75571]:       <target dev="tapd1934d1e-ff"/>
Nov 28 20:11:57 user nova-compute[75571]:     </interface>
Nov 28 20:11:57 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:11:57 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/59a360a3-bce3-4673-b79e-cd0460d2a69a/console.log" append="off"/>
Nov 28 20:11:57 user nova-compute[75571]:     </serial>
Nov 28 20:11:57 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:11:57 user nova-compute[75571]:     <video>
Nov 28 20:11:57 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:11:57 user nova-compute[75571]:     </video>
Nov 28 20:11:57 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:11:57 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:11:57 user nova-compute[75571]:     </rng>
Nov 28 20:11:57 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:11:57 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:11:57 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:11:57 user nova-compute[75571]:     </memballoon>
Nov 28 20:11:57 user nova-compute[75571]:   </devices>
Nov 28 20:11:57 user nova-compute[75571]: </domain>
Nov 28 20:11:57 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-875799677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-875799677',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6AuAWbbxZ0a6c7k1XS3X9t+pB3TAuStJooLKz16kYFR2aaVuQipo+CXoACBi2Birf2Rm15MEr9uQoGxphTgBDTn1HrWp9mOU4ZppNU69KCYDLZF6bXiACp5QJvGeeHcw==',key_name='tempest-keypair-1302784070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fed1996731e94c8eb5c16e6327b32f39',ramdisk_id='',reservation_id='r-lg4xji60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-323010200',owner_user_name='tempest-ServerActionsV293TestJSON-323010200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:11:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d313e776858a411ea463adecd1f36819',uuid=59a360a3-bce3-4673-b79e-cd0460d2a69a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Converting VIF {"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:9b:4a,bridge_name='br-int',has_traffic_filtering=True,id=d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c,network=Network(8b0c6ae3-604b-433f-920b-f28cc17a9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1934d1e-ff') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG os_vif [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:9b:4a,bridge_name='br-int',has_traffic_filtering=True,id=d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c,network=Network(8b0c6ae3-604b-433f-920b-f28cc17a9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1934d1e-ff') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ef79a64-a373-59eb-ad25-cd233370f2f2', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1934d1e-ff, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1934d1e-ff, col_values=(('qos', UUID('f51604a4-ebe9-4873-a01c-76d9451fa1fb')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1934d1e-ff, col_values=(('external_ids', {'iface-id': 'd1934d1e-ff23-4c6f-bec5-cb3289ae0d0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:9b:4a', 'vm-uuid': '59a360a3-bce3-4673-b79e-cd0460d2a69a'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:11:57 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:57 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:11:57 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=7959MB free_disk=25.578060150146484GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:57 user nova-compute[75571]: INFO os_vif [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:9b:4a,bridge_name='br-int',has_traffic_filtering=True,id=d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c,network=Network(8b0c6ae3-604b-433f-920b-f28cc17a9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1934d1e-ff')
Nov 28 20:11:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:11:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] No VIF found with MAC fa:16:3e:23:9b:4a, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance fe726611-331a-495f-a6bd-ced2d1a305b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 415392e8-bf6c-433e-a4f5-be3d99419710 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 59a360a3-bce3-4673-b79e-cd0460d2a69a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing inventories for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating ProviderTree inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing aggregate associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, aggregates: None {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing trait associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:11:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.986s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:11:59 user nova-compute[75571]: DEBUG nova.compute.manager [req-18c0d84a-f037-45fd-a58d-8bc48ede33e5 req-5da64f9c-8ada-4e98-9828-9b6cfe430c72 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received event network-vif-plugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:11:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-18c0d84a-f037-45fd-a58d-8bc48ede33e5 req-5da64f9c-8ada-4e98-9828-9b6cfe430c72 service nova] Acquiring lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:11:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-18c0d84a-f037-45fd-a58d-8bc48ede33e5 req-5da64f9c-8ada-4e98-9828-9b6cfe430c72 service nova] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:11:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-18c0d84a-f037-45fd-a58d-8bc48ede33e5 req-5da64f9c-8ada-4e98-9828-9b6cfe430c72 service nova] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:11:59 user nova-compute[75571]: DEBUG nova.compute.manager [req-18c0d84a-f037-45fd-a58d-8bc48ede33e5 req-5da64f9c-8ada-4e98-9828-9b6cfe430c72 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] No waiting events found dispatching network-vif-plugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:11:59 user nova-compute[75571]: WARNING nova.compute.manager [req-18c0d84a-f037-45fd-a58d-8bc48ede33e5 req-5da64f9c-8ada-4e98-9828-9b6cfe430c72 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received unexpected event network-vif-plugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c for instance with vm_state building and task_state spawning.
Nov 28 20:12:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:01 user nova-compute[75571]: DEBUG nova.compute.manager [req-67815bb1-03ac-4569-be91-1015933f564d req-f6504b42-e95c-4c98-8c59-a2a8085e99e9 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received event network-vif-plugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-67815bb1-03ac-4569-be91-1015933f564d req-f6504b42-e95c-4c98-8c59-a2a8085e99e9 service nova] Acquiring lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-67815bb1-03ac-4569-be91-1015933f564d req-f6504b42-e95c-4c98-8c59-a2a8085e99e9 service nova] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-67815bb1-03ac-4569-be91-1015933f564d req-f6504b42-e95c-4c98-8c59-a2a8085e99e9 service nova] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:01 user nova-compute[75571]: DEBUG nova.compute.manager [req-67815bb1-03ac-4569-be91-1015933f564d req-f6504b42-e95c-4c98-8c59-a2a8085e99e9 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] No waiting events found dispatching network-vif-plugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:01 user nova-compute[75571]: WARNING nova.compute.manager [req-67815bb1-03ac-4569-be91-1015933f564d req-f6504b42-e95c-4c98-8c59-a2a8085e99e9 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received unexpected event network-vif-plugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c for instance with vm_state building and task_state spawning.
Nov 28 20:12:01 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:12:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:12:01 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Instance spawned successfully.
Nov 28 20:12:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:12:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:02 user nova-compute[75571]: INFO nova.compute.manager [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Took 6.54 seconds to spawn the instance on the hypervisor.
Nov 28 20:12:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:12:02 user nova-compute[75571]: INFO nova.compute.manager [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Took 19.62 seconds to build instance.
Nov 28 20:12:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.836s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:10 user nova-compute[75571]: DEBUG nova.compute.manager [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:12:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:10 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:12:10 user nova-compute[75571]: INFO nova.compute.claims [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Claim successful on node user
Nov 28 20:12:10 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:12:10 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:12:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:10 user nova-compute[75571]: DEBUG nova.compute.manager [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:12:10 user nova-compute[75571]: DEBUG nova.compute.manager [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:12:10 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:12:10 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:12:10 user nova-compute[75571]: DEBUG nova.compute.manager [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:12:11 user nova-compute[75571]: INFO nova.virt.block_device [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Booting with volume 268567d9-8c0c-46d9-8bc0-70157c860620 at /dev/vda
Nov 28 20:12:11 user nova-compute[75571]: DEBUG os_brick.utils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG nova.policy [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be9e9698937848dbb2b073607f73af64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1a4972442f432da170242f18d528e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3704fb0b-b455-4225-b734-7fa3667f2ded]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ab637b-db3e-4776-b609-46ba39bfce01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f526477-6f42-4269-9d62-45f3be7b49da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e90f45-ed34-44e0-8498-d026aed01806]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:12:11 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:12:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad93c1c-d315-499b-b854-ecb9a03fb6be]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG os_brick.utils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating existing volume attachment record: 8fa5e190-d35e-409b-b642-87773cec8f93 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:12:11 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Successfully created port: 84e4f0c4-3f04-4c12-8691-9751c9f48d88 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:12:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Successfully created port: e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:12:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:13 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Successfully created port: 83928471-88d4-4e3f-bebd-40d53fcfd576 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:12:14 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Successfully created port: a5c9d8f5-1111-4aa6-a962-1f7136a267b0 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:12:14 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Successfully created port: fe80e513-5da6-4885-8fce-0bc941bf6b4a {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:12:15 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Successfully updated port: 84e4f0c4-3f04-4c12-8691-9751c9f48d88 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:12:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-da0e82e1-da17-4f3f-9a51-e7ac7c80c3b5 req-0ae776b2-0c61-4661-a591-eb41e0e7bff5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-changed-84e4f0c4-3f04-4c12-8691-9751c9f48d88 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-da0e82e1-da17-4f3f-9a51-e7ac7c80c3b5 req-0ae776b2-0c61-4661-a591-eb41e0e7bff5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing instance network info cache due to event network-changed-84e4f0c4-3f04-4c12-8691-9751c9f48d88. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:12:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-da0e82e1-da17-4f3f-9a51-e7ac7c80c3b5 req-0ae776b2-0c61-4661-a591-eb41e0e7bff5 service nova] Acquiring lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:12:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-da0e82e1-da17-4f3f-9a51-e7ac7c80c3b5 req-0ae776b2-0c61-4661-a591-eb41e0e7bff5 service nova] Acquired lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:12:15 user nova-compute[75571]: DEBUG nova.network.neutron [req-da0e82e1-da17-4f3f-9a51-e7ac7c80c3b5 req-0ae776b2-0c61-4661-a591-eb41e0e7bff5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing network info cache for port 84e4f0c4-3f04-4c12-8691-9751c9f48d88 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:12:15 user nova-compute[75571]: DEBUG nova.network.neutron [req-da0e82e1-da17-4f3f-9a51-e7ac7c80c3b5 req-0ae776b2-0c61-4661-a591-eb41e0e7bff5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:12:15 user nova-compute[75571]: DEBUG nova.network.neutron [req-da0e82e1-da17-4f3f-9a51-e7ac7c80c3b5 req-0ae776b2-0c61-4661-a591-eb41e0e7bff5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:12:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-da0e82e1-da17-4f3f-9a51-e7ac7c80c3b5 req-0ae776b2-0c61-4661-a591-eb41e0e7bff5 service nova] Releasing lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:12:16 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Successfully updated port: 5bdfc240-06a9-47c2-b496-bda3e4931c80 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:12:16 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Successfully updated port: 1732200a-bf2a-477a-b72e-7191f2ccfb4e {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:12:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-changed-5bdfc240-06a9-47c2-b496-bda3e4931c80 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing instance network info cache due to event network-changed-5bdfc240-06a9-47c2-b496-bda3e4931c80. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] Acquiring lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] Acquired lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:12:17 user nova-compute[75571]: DEBUG nova.network.neutron [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing network info cache for port 5bdfc240-06a9-47c2-b496-bda3e4931c80 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:12:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:17 user nova-compute[75571]: DEBUG nova.network.neutron [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:12:17 user nova-compute[75571]: DEBUG nova.network.neutron [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:12:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] Releasing lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:12:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-changed-1732200a-bf2a-477a-b72e-7191f2ccfb4e {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing instance network info cache due to event network-changed-1732200a-bf2a-477a-b72e-7191f2ccfb4e. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:12:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] Acquiring lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:12:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] Acquired lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:12:18 user nova-compute[75571]: DEBUG nova.network.neutron [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing network info cache for port 1732200a-bf2a-477a-b72e-7191f2ccfb4e {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:12:18 user nova-compute[75571]: DEBUG nova.network.neutron [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:12:18 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Successfully updated port: e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:12:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:18 user nova-compute[75571]: DEBUG nova.network.neutron [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:12:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] Releasing lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:12:18 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Successfully updated port: 83928471-88d4-4e3f-bebd-40d53fcfd576 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:12:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-changed-e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing instance network info cache due to event network-changed-e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:12:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] Acquiring lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:12:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] Acquired lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:12:19 user nova-compute[75571]: DEBUG nova.network.neutron [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing network info cache for port e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:12:19 user nova-compute[75571]: DEBUG nova.network.neutron [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:12:19 user nova-compute[75571]: DEBUG nova.network.neutron [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:12:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] Releasing lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:12:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-changed-83928471-88d4-4e3f-bebd-40d53fcfd576 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing instance network info cache due to event network-changed-83928471-88d4-4e3f-bebd-40d53fcfd576. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:12:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] Acquiring lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:12:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] Acquired lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:12:19 user nova-compute[75571]: DEBUG nova.network.neutron [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing network info cache for port 83928471-88d4-4e3f-bebd-40d53fcfd576 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG nova.network.neutron [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Successfully updated port: a5c9d8f5-1111-4aa6-a962-1f7136a267b0 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:12:20 user nova-compute[75571]: INFO nova.virt.block_device [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Booting with volume 69f15c27-93a6-49d9-8e7c-b001e771f4f3 at /dev/vdb
Nov 28 20:12:20 user nova-compute[75571]: DEBUG os_brick.utils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[477c3a84-eaef-4c28-85fb-120fbc4bc462]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb77c635-5adc-44dc-a284-d774c6156c83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbd1cd6-30a7-4d52-b26a-4a73d872c502]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[681362b3-edba-4c60-9cbb-a43c59f0a1a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG nova.network.neutron [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] Releasing lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:12:20 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0727ee-134f-48af-9d6f-b2feaa76913b]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG os_brick.utils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating existing volume attachment record: 288bd58c-e409-43ef-9a17-961dc01cb244 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Successfully updated port: fe80e513-5da6-4885-8fce-0bc941bf6b4a {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquired lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:12:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:12:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-changed-a5c9d8f5-1111-4aa6-a962-1f7136a267b0 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing instance network info cache due to event network-changed-a5c9d8f5-1111-4aa6-a962-1f7136a267b0. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:12:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] Acquiring lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:12:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:22 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating instance_info_cache with network_info: [{"id": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "address": "fa:16:3e:24:b8:3a", "network": {"id": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959537065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e4f0c4-3f", "ovs_interfaceid": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "address": "fa:16:3e:a5:09:85", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f10eb6-f4", "ovs_interfaceid": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83928471-88d4-4e3f-bebd-40d53fcfd576", "address": "fa:16:3e:79:c8:db", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83928471-88", "ovs_interfaceid": "83928471-88d4-4e3f-bebd-40d53fcfd576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "address": "fa:16:3e:53:ba:54", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c9d8f5-11", "ovs_interfaceid": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:12:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Releasing lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:12:22 user nova-compute[75571]: DEBUG nova.compute.manager [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Instance network_info: |[{"id": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "address": "fa:16:3e:24:b8:3a", "network": {"id": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959537065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e4f0c4-3f", "ovs_interfaceid": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "address": "fa:16:3e:a5:09:85", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f10eb6-f4", "ovs_interfaceid": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83928471-88d4-4e3f-bebd-40d53fcfd576", "address": "fa:16:3e:79:c8:db", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83928471-88", "ovs_interfaceid": "83928471-88d4-4e3f-bebd-40d53fcfd576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "address": "fa:16:3e:53:ba:54", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c9d8f5-11", "ovs_interfaceid": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:12:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] Acquired lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:12:22 user nova-compute[75571]: DEBUG nova.network.neutron [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing network info cache for port a5c9d8f5-1111-4aa6-a962-1f7136a267b0 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:12:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:23 user nova-compute[75571]: DEBUG nova.network.neutron [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updated VIF entry in instance network info cache for port a5c9d8f5-1111-4aa6-a962-1f7136a267b0. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:12:23 user nova-compute[75571]: DEBUG nova.network.neutron [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating instance_info_cache with network_info: [{"id": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "address": "fa:16:3e:24:b8:3a", "network": {"id": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959537065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e4f0c4-3f", "ovs_interfaceid": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "address": "fa:16:3e:a5:09:85", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f10eb6-f4", "ovs_interfaceid": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83928471-88d4-4e3f-bebd-40d53fcfd576", "address": "fa:16:3e:79:c8:db", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83928471-88", "ovs_interfaceid": "83928471-88d4-4e3f-bebd-40d53fcfd576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "address": "fa:16:3e:53:ba:54", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c9d8f5-11", "ovs_interfaceid": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:12:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] Releasing lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:12:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-changed-fe80e513-5da6-4885-8fce-0bc941bf6b4a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing instance network info cache due to event network-changed-fe80e513-5da6-4885-8fce-0bc941bf6b4a. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:12:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] Acquiring lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:12:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] Acquired lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:12:23 user nova-compute[75571]: DEBUG nova.network.neutron [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing network info cache for port fe80e513-5da6-4885-8fce-0bc941bf6b4a {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:12:23 user nova-compute[75571]: DEBUG nova.network.neutron [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updated VIF entry in instance network info cache for port fe80e513-5da6-4885-8fce-0bc941bf6b4a. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:12:23 user nova-compute[75571]: DEBUG nova.network.neutron [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating instance_info_cache with network_info: [{"id": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "address": "fa:16:3e:24:b8:3a", "network": {"id": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959537065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e4f0c4-3f", "ovs_interfaceid": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "address": "fa:16:3e:a5:09:85", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f10eb6-f4", "ovs_interfaceid": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83928471-88d4-4e3f-bebd-40d53fcfd576", "address": "fa:16:3e:79:c8:db", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83928471-88", "ovs_interfaceid": "83928471-88d4-4e3f-bebd-40d53fcfd576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "address": "fa:16:3e:53:ba:54", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c9d8f5-11", "ovs_interfaceid": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:12:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] Releasing lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:12:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:27 user nova-compute[75571]: INFO nova.virt.block_device [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Booting with volume b91bfea3-75ee-40af-b479-01a81b104cc5 at /dev/vdc
Nov 28 20:12:27 user nova-compute[75571]: DEBUG os_brick.utils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c987ba-9076-41c7-93f3-050d0d7cf037]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0fd0b4-8a32-40e2-aaf5-ce3e407088ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb74238e-c2bd-4228-881a-cfe08a4a290e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[497f67a9-c6c0-4427-96a1-bfc3a2c90a65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:12:28 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:12:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4779de-1e19-4e33-bd50-955fdf31f439]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG os_brick.utils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating existing volume attachment record: 1ff5907b-0906-460c-a178-f301faf83409 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:12:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "e902b4e2-d53e-459f-a10e-bcbba4fc2317" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "e902b4e2-d53e-459f-a10e-bcbba4fc2317" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:29 user nova-compute[75571]: DEBUG nova.compute.manager [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:12:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:29 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:12:29 user nova-compute[75571]: INFO nova.compute.claims [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Claim successful on node user
Nov 28 20:12:30 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG nova.network.neutron [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:12:30 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:12:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:12:30 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Creating image(s)
Nov 28 20:12:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "/opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "/opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "/opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG nova.policy [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '637fd3a4988b4f5cbb9507b3e850effa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bbaa4bb5b47668fa7beddd9dbcb69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.183s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.187s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk 1073741824" returned: 0 in 0.054s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.204s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:31 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:12:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:31 user nova-compute[75571]: DEBUG nova.network.neutron [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Successfully created port: 3eabc9ee-0a3a-48ec-8956-6036d0217183 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:12:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:31 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Cannot resize image /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:12:31 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:12:31 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Ensure instance console log exists: /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:12:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:32 user nova-compute[75571]: DEBUG nova.network.neutron [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Successfully updated port: 3eabc9ee-0a3a-48ec-8956-6036d0217183 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:12:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "refresh_cache-e902b4e2-d53e-459f-a10e-bcbba4fc2317" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:12:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquired lock "refresh_cache-e902b4e2-d53e-459f-a10e-bcbba4fc2317" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:12:32 user nova-compute[75571]: DEBUG nova.network.neutron [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:12:32 user nova-compute[75571]: DEBUG nova.compute.manager [req-e6fbf2fc-dd96-487d-b4cf-0d96f125726d req-becee24d-cd77-4846-b38d-0fb4364c03cd service nova] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Received event network-changed-3eabc9ee-0a3a-48ec-8956-6036d0217183 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:32 user nova-compute[75571]: DEBUG nova.compute.manager [req-e6fbf2fc-dd96-487d-b4cf-0d96f125726d req-becee24d-cd77-4846-b38d-0fb4364c03cd service nova] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Refreshing instance network info cache due to event network-changed-3eabc9ee-0a3a-48ec-8956-6036d0217183. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:12:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e6fbf2fc-dd96-487d-b4cf-0d96f125726d req-becee24d-cd77-4846-b38d-0fb4364c03cd service nova] Acquiring lock "refresh_cache-e902b4e2-d53e-459f-a10e-bcbba4fc2317" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:12:32 user nova-compute[75571]: DEBUG nova.network.neutron [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:12:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.network.neutron [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Updating instance_info_cache with network_info: [{"id": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "address": "fa:16:3e:da:da:c7", "network": {"id": "55a74e7f-c346-450d-a844-21d692c92df5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a3f68630a9a04ebebd5c4eab29a79ef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eabc9ee-0a", "ovs_interfaceid": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Releasing lock "refresh_cache-e902b4e2-d53e-459f-a10e-bcbba4fc2317" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.compute.manager [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Instance network_info: |[{"id": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "address": "fa:16:3e:da:da:c7", "network": {"id": "55a74e7f-c346-450d-a844-21d692c92df5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a3f68630a9a04ebebd5c4eab29a79ef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eabc9ee-0a", "ovs_interfaceid": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e6fbf2fc-dd96-487d-b4cf-0d96f125726d req-becee24d-cd77-4846-b38d-0fb4364c03cd service nova] Acquired lock "refresh_cache-e902b4e2-d53e-459f-a10e-bcbba4fc2317" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-e6fbf2fc-dd96-487d-b4cf-0d96f125726d req-becee24d-cd77-4846-b38d-0fb4364c03cd service nova] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Refreshing network info cache for port 3eabc9ee-0a3a-48ec-8956-6036d0217183 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Start _get_guest_xml network_info=[{"id": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "address": "fa:16:3e:da:da:c7", "network": {"id": "55a74e7f-c346-450d-a844-21d692c92df5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a3f68630a9a04ebebd5c4eab29a79ef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eabc9ee-0a", "ovs_interfaceid": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:12:33 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:12:33 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:12:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2082525117',display_name='tempest-VolumesNegativeTest-instance-2082525117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2082525117',id=9,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b6bbaa4bb5b47668fa7beddd9dbcb69',ramdisk_id='',reservation_id='r-xt6mzy6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-300076032',owner_user_name='tempest-VolumesNegativeTest-300076032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:30Z,user_data=None,user_id='637fd3a4988b4f5cbb9507b3e850effa',uuid=e902b4e2-d53e-459f-a10e-bcbba4fc2317,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "address": "fa:16:3e:da:da:c7", "network": {"id": "55a74e7f-c346-450d-a844-21d692c92df5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a3f68630a9a04ebebd5c4eab29a79ef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eabc9ee-0a", "ovs_interfaceid": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Converting VIF {"id": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "address": "fa:16:3e:da:da:c7", "network": {"id": "55a74e7f-c346-450d-a844-21d692c92df5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a3f68630a9a04ebebd5c4eab29a79ef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eabc9ee-0a", "ovs_interfaceid": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:da:c7,bridge_name='br-int',has_traffic_filtering=True,id=3eabc9ee-0a3a-48ec-8956-6036d0217183,network=Network(55a74e7f-c346-450d-a844-21d692c92df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eabc9ee-0a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.objects.instance [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lazy-loading 'pci_devices' on Instance uuid e902b4e2-d53e-459f-a10e-bcbba4fc2317 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:12:33 user nova-compute[75571]:   <uuid>e902b4e2-d53e-459f-a10e-bcbba4fc2317</uuid>
Nov 28 20:12:33 user nova-compute[75571]:   <name>instance-00000009</name>
Nov 28 20:12:33 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:12:33 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:12:33 user nova-compute[75571]:   <metadata>
Nov 28 20:12:33 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:12:33 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:12:33 user nova-compute[75571]:       <nova:name>tempest-VolumesNegativeTest-instance-2082525117</nova:name>
Nov 28 20:12:33 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:12:33</nova:creationTime>
Nov 28 20:12:33 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:12:33 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:12:33 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:12:33 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:12:33 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:12:33 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:12:33 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:12:33 user nova-compute[75571]:       <nova:owner>
Nov 28 20:12:33 user nova-compute[75571]:         <nova:user uuid="637fd3a4988b4f5cbb9507b3e850effa">tempest-VolumesNegativeTest-300076032-project-member</nova:user>
Nov 28 20:12:33 user nova-compute[75571]:         <nova:project uuid="4b6bbaa4bb5b47668fa7beddd9dbcb69">tempest-VolumesNegativeTest-300076032</nova:project>
Nov 28 20:12:33 user nova-compute[75571]:       </nova:owner>
Nov 28 20:12:33 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:12:33 user nova-compute[75571]:       <nova:ports>
Nov 28 20:12:33 user nova-compute[75571]:         <nova:port uuid="3eabc9ee-0a3a-48ec-8956-6036d0217183">
Nov 28 20:12:33 user nova-compute[75571]:           <nova:ip type="fixed" address="192.168.233.225" ipVersion="4"/>
Nov 28 20:12:33 user nova-compute[75571]:         </nova:port>
Nov 28 20:12:33 user nova-compute[75571]:       </nova:ports>
Nov 28 20:12:33 user nova-compute[75571]:     </nova:instance>
Nov 28 20:12:33 user nova-compute[75571]:   </metadata>
Nov 28 20:12:33 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:12:33 user nova-compute[75571]:     <system>
Nov 28 20:12:33 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:12:33 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:12:33 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:12:33 user nova-compute[75571]:       <entry name="serial">e902b4e2-d53e-459f-a10e-bcbba4fc2317</entry>
Nov 28 20:12:33 user nova-compute[75571]:       <entry name="uuid">e902b4e2-d53e-459f-a10e-bcbba4fc2317</entry>
Nov 28 20:12:33 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:12:33 user nova-compute[75571]:     </system>
Nov 28 20:12:33 user nova-compute[75571]:   </sysinfo>
Nov 28 20:12:33 user nova-compute[75571]:   <os>
Nov 28 20:12:33 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:12:33 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:12:33 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:12:33 user nova-compute[75571]:   </os>
Nov 28 20:12:33 user nova-compute[75571]:   <features>
Nov 28 20:12:33 user nova-compute[75571]:     <acpi/>
Nov 28 20:12:33 user nova-compute[75571]:     <apic/>
Nov 28 20:12:33 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:12:33 user nova-compute[75571]:   </features>
Nov 28 20:12:33 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:12:33 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:12:33 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:12:33 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:12:33 user nova-compute[75571]:   </clock>
Nov 28 20:12:33 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:12:33 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:12:33 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:12:33 user nova-compute[75571]:   </cpu>
Nov 28 20:12:33 user nova-compute[75571]:   <devices>
Nov 28 20:12:33 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:12:33 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:12:33 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk"/>
Nov 28 20:12:33 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:12:33 user nova-compute[75571]:     </disk>
Nov 28 20:12:33 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:12:33 user nova-compute[75571]:       <mac address="fa:16:3e:da:da:c7"/>
Nov 28 20:12:33 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:12:33 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:12:33 user nova-compute[75571]:       <target dev="tap3eabc9ee-0a"/>
Nov 28 20:12:33 user nova-compute[75571]:     </interface>
Nov 28 20:12:33 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:12:33 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/console.log" append="off"/>
Nov 28 20:12:33 user nova-compute[75571]:     </serial>
Nov 28 20:12:33 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:12:33 user nova-compute[75571]:     <video>
Nov 28 20:12:33 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:12:33 user nova-compute[75571]:     </video>
Nov 28 20:12:33 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:12:33 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:12:33 user nova-compute[75571]:     </rng>
Nov 28 20:12:33 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:12:33 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:12:33 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:12:33 user nova-compute[75571]:     </memballoon>
Nov 28 20:12:33 user nova-compute[75571]:   </devices>
Nov 28 20:12:33 user nova-compute[75571]: </domain>
Nov 28 20:12:33 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:12:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2082525117',display_name='tempest-VolumesNegativeTest-instance-2082525117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2082525117',id=9,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b6bbaa4bb5b47668fa7beddd9dbcb69',ramdisk_id='',reservation_id='r-xt6mzy6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-300076032',owner_user_name='tempest-VolumesNegativeTest-300076032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:30Z,user_data=None,user_id='637fd3a4988b4f5cbb9507b3e850effa',uuid=e902b4e2-d53e-459f-a10e-bcbba4fc2317,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "address": "fa:16:3e:da:da:c7", "network": {"id": "55a74e7f-c346-450d-a844-21d692c92df5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a3f68630a9a04ebebd5c4eab29a79ef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eabc9ee-0a", "ovs_interfaceid": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Converting VIF {"id": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "address": "fa:16:3e:da:da:c7", "network": {"id": "55a74e7f-c346-450d-a844-21d692c92df5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a3f68630a9a04ebebd5c4eab29a79ef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eabc9ee-0a", "ovs_interfaceid": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:da:c7,bridge_name='br-int',has_traffic_filtering=True,id=3eabc9ee-0a3a-48ec-8956-6036d0217183,network=Network(55a74e7f-c346-450d-a844-21d692c92df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eabc9ee-0a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG os_vif [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:da:c7,bridge_name='br-int',has_traffic_filtering=True,id=3eabc9ee-0a3a-48ec-8956-6036d0217183,network=Network(55a74e7f-c346-450d-a844-21d692c92df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eabc9ee-0a') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd84efb34-5534-51b2-85ec-82c35d7e7417', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3eabc9ee-0a, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3eabc9ee-0a, col_values=(('qos', UUID('27288913-357d-45bc-8f27-aa561ea0f997')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3eabc9ee-0a, col_values=(('external_ids', {'iface-id': '3eabc9ee-0a3a-48ec-8956-6036d0217183', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:da:c7', 'vm-uuid': 'e902b4e2-d53e-459f-a10e-bcbba4fc2317'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:33 user nova-compute[75571]: INFO os_vif [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:da:c7,bridge_name='br-int',has_traffic_filtering=True,id=3eabc9ee-0a3a-48ec-8956-6036d0217183,network=Network(55a74e7f-c346-450d-a844-21d692c92df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eabc9ee-0a')
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] No VIF found with MAC fa:16:3e:da:da:c7, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-e6fbf2fc-dd96-487d-b4cf-0d96f125726d req-becee24d-cd77-4846-b38d-0fb4364c03cd service nova] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Updated VIF entry in instance network info cache for port 3eabc9ee-0a3a-48ec-8956-6036d0217183. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-e6fbf2fc-dd96-487d-b4cf-0d96f125726d req-becee24d-cd77-4846-b38d-0fb4364c03cd service nova] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Updating instance_info_cache with network_info: [{"id": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "address": "fa:16:3e:da:da:c7", "network": {"id": "55a74e7f-c346-450d-a844-21d692c92df5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a3f68630a9a04ebebd5c4eab29a79ef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eabc9ee-0a", "ovs_interfaceid": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:12:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e6fbf2fc-dd96-487d-b4cf-0d96f125726d req-becee24d-cd77-4846-b38d-0fb4364c03cd service nova] Releasing lock "refresh_cache-e902b4e2-d53e-459f-a10e-bcbba4fc2317" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:12:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:34 user nova-compute[75571]: DEBUG nova.compute.manager [req-2591c7c0-d0de-497a-bad9-e3ae2c57a181 req-cd9c4875-3041-436e-89ed-b8117ef0cd18 service nova] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Received event network-vif-plugged-3eabc9ee-0a3a-48ec-8956-6036d0217183 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2591c7c0-d0de-497a-bad9-e3ae2c57a181 req-cd9c4875-3041-436e-89ed-b8117ef0cd18 service nova] Acquiring lock "e902b4e2-d53e-459f-a10e-bcbba4fc2317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2591c7c0-d0de-497a-bad9-e3ae2c57a181 req-cd9c4875-3041-436e-89ed-b8117ef0cd18 service nova] Lock "e902b4e2-d53e-459f-a10e-bcbba4fc2317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2591c7c0-d0de-497a-bad9-e3ae2c57a181 req-cd9c4875-3041-436e-89ed-b8117ef0cd18 service nova] Lock "e902b4e2-d53e-459f-a10e-bcbba4fc2317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:34 user nova-compute[75571]: DEBUG nova.compute.manager [req-2591c7c0-d0de-497a-bad9-e3ae2c57a181 req-cd9c4875-3041-436e-89ed-b8117ef0cd18 service nova] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] No waiting events found dispatching network-vif-plugged-3eabc9ee-0a3a-48ec-8956-6036d0217183 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:34 user nova-compute[75571]: WARNING nova.compute.manager [req-2591c7c0-d0de-497a-bad9-e3ae2c57a181 req-cd9c4875-3041-436e-89ed-b8117ef0cd18 service nova] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Received unexpected event network-vif-plugged-3eabc9ee-0a3a-48ec-8956-6036d0217183 for instance with vm_state building and task_state spawning.
Nov 28 20:12:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.compute.manager [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:12:36 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Creating image(s)
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Ensure instance console log exists: /opt/stack/data/nova/instances/55765bf6-ce98-4e44-b444-afcb250dc54d/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Start _get_guest_xml network_info=[{"id": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "address": "fa:16:3e:24:b8:3a", "network": {"id": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959537065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e4f0c4-3f", "ovs_interfaceid": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "address": "fa:16:3e:a5:09:85", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f10eb6-f4", "ovs_interfaceid": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83928471-88d4-4e3f-bebd-40d53fcfd576", "address": "fa:16:3e:79:c8:db", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83928471-88", "ovs_interfaceid": "83928471-88d4-4e3f-bebd-40d53fcfd576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "address": "fa:16:3e:53:ba:54", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c9d8f5-11", "ovs_interfaceid": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtYvXSdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '55765bf6-ce98-4e44-b444-afcb250dc54d', 'attached_at': '', 'detached_at': '', 'volume_id': '268567d9-8c0c-46d9-8bc0-70157c860620', 'serial': '268567d9-8c0c-46d9-8bc0-70157c860620'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '8fa5e190-d35e-409b-b642-87773cec8f93', 'mount_device': '/dev/vda', 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndAivaMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '55765bf6-ce98-4e44-b444-afcb250dc54d', 'attached_at': '', 'detached_at': '', 'volume_id': '69f15c27-93a6-49d9-8e7c-b001e771f4f3', 'serial': '69f15c27-93a6-49d9-8e7c-b001e771f4f3'}, 'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '288bd58c-e409-43ef-9a17-961dc01cb244', 'mount_device': '/dev/vdb', 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzFaMTov', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '55765bf6-ce98-4e44-b444-afcb250dc54d', 'attached_at': '', 'detached_at': '', 'volume_id': 'b91bfea3-75ee-40af-b479-01a81b104cc5', 'serial': 'b91bfea3-75ee-40af-b479-01a81b104cc5'}, 'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '1ff5907b-0906-460c-a178-f301faf83409', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:12:36 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:12:36 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtYvXSdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:12:36 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:12:36 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:12:36 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f31a1b-7f88-4bda-8105-9a7d81516ba8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:12:36 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c44d8b-2339-4928-92ad-c0352341d012]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620] added
Nov 28 20:12:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea6fb7d-e74e-4f37-a97e-e4ba2104086c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[41927438-e50c-4511-86ad-3256367a3fc5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rtYvXSdl {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rtYvXSdl" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[af03b479-5fee-415a-aa55-1b6c5aaab59a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rtYvXSdl'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[360b621b-34eb-4662-a769-4cf43ed73956]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb82801b-619a-49c8-a146-4ad42375ce23]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:12:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:12:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d245be-93e7-494e-8b35-f9a5d3410988]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620, portal: 172.16.0.220,3260]
Nov 28 20:12:36 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620, portal: 172.16.0.220,3260] successful.
Nov 28 20:12:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7e19b5-5fd9-4583-a7a4-5e0b85542a76]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b2b577-fcd3-4e4e-b92f-8e80ac5acaa9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:12:36 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:12:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:12:36 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:12:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c18a32f-bb25-4618-9d94-c211c32a4f17]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtYvXSdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.compute.manager [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:12:36 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Instance spawned successfully.
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:36 user nova-compute[75571]: INFO nova.compute.manager [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.compute.manager [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG nova.compute.manager [req-98fea834-761c-4ed5-806e-d95cc48af511 req-5a7266e4-7adb-4633-9d32-b6b334e65088 service nova] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Received event network-vif-plugged-3eabc9ee-0a3a-48ec-8956-6036d0217183 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-98fea834-761c-4ed5-806e-d95cc48af511 req-5a7266e4-7adb-4633-9d32-b6b334e65088 service nova] Acquiring lock "e902b4e2-d53e-459f-a10e-bcbba4fc2317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-98fea834-761c-4ed5-806e-d95cc48af511 req-5a7266e4-7adb-4633-9d32-b6b334e65088 service nova] Lock "e902b4e2-d53e-459f-a10e-bcbba4fc2317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-98fea834-761c-4ed5-806e-d95cc48af511 req-5a7266e4-7adb-4633-9d32-b6b334e65088 service nova] Lock "e902b4e2-d53e-459f-a10e-bcbba4fc2317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-98fea834-761c-4ed5-806e-d95cc48af511 req-5a7266e4-7adb-4633-9d32-b6b334e65088 service nova] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] No waiting events found dispatching network-vif-plugged-3eabc9ee-0a3a-48ec-8956-6036d0217183 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:37 user nova-compute[75571]: WARNING nova.compute.manager [req-98fea834-761c-4ed5-806e-d95cc48af511 req-5a7266e4-7adb-4633-9d32-b6b334e65088 service nova] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Received unexpected event network-vif-plugged-3eabc9ee-0a3a-48ec-8956-6036d0217183 for instance with vm_state building and task_state spawning.
Nov 28 20:12:37 user nova-compute[75571]: INFO nova.compute.manager [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Took 7.13 seconds to build instance.
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "e902b4e2-d53e-459f-a10e-bcbba4fc2317" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.228s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26264613630663063', 'path': '/dev/sdc'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264613630663063', 'path': '/dev/sdc'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndAivaMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:12:37 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:12:37 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:12:37 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac79e8e-a69b-48fe-b4e3-e98cdf8740d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:12:37 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d208e4a0-ae79-4f00-8148-74628c357495]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3] added
Nov 28 20:12:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a2ed7d-7ee0-45fa-9771-981a4e654cc0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[770473d1-f98a-44e9-8a0d-c5b3c596431d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ndAivaMm {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ndAivaMm" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8b4e77-b852-4d0d-98cc-251724ee587b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ndAivaMm'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fe8b47-9a3d-4e21-bf10-510b41087d3a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f440f4-8418-4b04-b894-86e36d5875c0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:12:37 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:12:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:12:37 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:12:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ab95ed-2d74-45a4-887d-78b3cb61851e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3, portal: 172.16.0.220,3260]
Nov 28 20:12:37 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3, portal: 172.16.0.220,3260] successful.
Nov 28 20:12:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3084e546-0395-4e78-9424-d2f983b5f6e1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8cb77a-4b40-4deb-8584-47988a9c8007]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:12:37 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:12:37 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:12:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:12:37 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:12:37 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:12:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2947bdb-cd1d-4c09-b785-bd7219c60685]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndAivaMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26331343030653063', 'path': '/dev/sdd'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331343030653063', 'path': '/dev/sdd'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzFaMTov', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:12:38 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:12:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:12:38 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:12:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:12:38 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:12:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbce0d4-6b4a-4fd6-99c6-afeb2bd3363f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:12:38 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dd8965-2aa1-49bb-9cf4-7f6e2f6f9808]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5] added
Nov 28 20:12:38 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[135b4a04-f662-4efd-b5d4-a473af1f72e2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb9666a-af8e-4a0a-91af-8512a9a3bac6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XzFaMTov {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XzFaMTov" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[86374ab1-c294-4b3d-b268-5ee68c4c623f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XzFaMTov'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b7103c-d33a-47db-b1bc-7c425e154665]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ea936f-1bed-4126-a8b7-07af760ab0c8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:12:39 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:12:39 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:12:39 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:12:39 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:12:39 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:12:39 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5061c4-5299-4924-9896-c64d7848a8a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5, portal: 172.16.0.220,3260]
Nov 28 20:12:39 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5, portal: 172.16.0.220,3260] successful.
Nov 28 20:12:39 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8043495c-fd5c-4984-a14a-d3e00a5894c9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d404ace-91ba-4508-af39-7259135672cf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:12:39 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:12:39 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:12:39 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:12:39 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:12:39 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:12:39 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:12:39 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:12:39 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd478d5a-40a4-43ce-a697-e446223fff6b]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:12:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzFaMTov', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23439383334303763', 'path': '/dev/sde'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439383334303763', 'path': '/dev/sde'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "address": "fa:16:3e:24:b8:3a", "network": {"id": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959537065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e4f0c4-3f", "ovs_interfaceid": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "address": "fa:16:3e:24:b8:3a", "network": {"id": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959537065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e4f0c4-3f", "ovs_interfaceid": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:b8:3a,bridge_name='br-int',has_traffic_filtering=True,id=84e4f0c4-3f04-4c12-8691-9751c9f48d88,network=Network(8ac9ca6d-d1f1-4241-ae50-c00452fb1fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e4f0c4-3f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=5bdfc240-06a9-47c2-b496-bda3e4931c80,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bdfc240-06') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:be:81,bridge_name='br-int',has_traffic_filtering=True,id=1732200a-bf2a-477a-b72e-7191f2ccfb4e,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1732200a-bf') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "address": "fa:16:3e:a5:09:85", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f10eb6-f4", "ovs_interfaceid": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "address": "fa:16:3e:a5:09:85", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f10eb6-f4", "ovs_interfaceid": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:09:85,bridge_name='br-int',has_traffic_filtering=True,id=e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f10eb6-f4') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83928471-88d4-4e3f-bebd-40d53fcfd576", "address": "fa:16:3e:79:c8:db", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83928471-88", "ovs_interfaceid": "83928471-88d4-4e3f-bebd-40d53fcfd576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "83928471-88d4-4e3f-bebd-40d53fcfd576", "address": "fa:16:3e:79:c8:db", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83928471-88", "ovs_interfaceid": "83928471-88d4-4e3f-bebd-40d53fcfd576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:c8:db,bridge_name='br-int',has_traffic_filtering=True,id=83928471-88d4-4e3f-bebd-40d53fcfd576,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83928471-88') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "address": "fa:16:3e:53:ba:54", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c9d8f5-11", "ovs_interfaceid": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "address": "fa:16:3e:53:ba:54", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c9d8f5-11", "ovs_interfaceid": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ba:54,bridge_name='br-int',has_traffic_filtering=True,id=a5c9d8f5-1111-4aa6-a962-1f7136a267b0,network=Network(93522955-fc00-44c2-b0d9-b7b4bb2f69a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c9d8f5-11') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:20,bridge_name='br-int',has_traffic_filtering=True,id=fe80e513-5da6-4885-8fce-0bc941bf6b4a,network=Network(93522955-fc00-44c2-b0d9-b7b4bb2f69a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe80e513-5d') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.objects.instance [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lazy-loading 'pci_devices' on Instance uuid 55765bf6-ce98-4e44-b444-afcb250dc54d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:12:40 user nova-compute[75571]:   <uuid>55765bf6-ce98-4e44-b444-afcb250dc54d</uuid>
Nov 28 20:12:40 user nova-compute[75571]:   <name>instance-00000008</name>
Nov 28 20:12:40 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:12:40 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:12:40 user nova-compute[75571]:   <metadata>
Nov 28 20:12:40 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:12:40 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:12:40 user nova-compute[75571]:       <nova:name>tempest-device-tagging-server-759809128</nova:name>
Nov 28 20:12:40 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:12:36</nova:creationTime>
Nov 28 20:12:40 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:12:40 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:12:40 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:12:40 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:12:40 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:12:40 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:12:40 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:12:40 user nova-compute[75571]:       <nova:owner>
Nov 28 20:12:40 user nova-compute[75571]:         <nova:user uuid="be9e9698937848dbb2b073607f73af64">tempest-TaggedBootDevicesTest-1933440292-project-member</nova:user>
Nov 28 20:12:40 user nova-compute[75571]:         <nova:project uuid="8d1a4972442f432da170242f18d528e7">tempest-TaggedBootDevicesTest-1933440292</nova:project>
Nov 28 20:12:40 user nova-compute[75571]:       </nova:owner>
Nov 28 20:12:40 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:12:40 user nova-compute[75571]:       <nova:ports>
Nov 28 20:12:40 user nova-compute[75571]:         <nova:port uuid="84e4f0c4-3f04-4c12-8691-9751c9f48d88">
Nov 28 20:12:40 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 20:12:40 user nova-compute[75571]:         </nova:port>
Nov 28 20:12:40 user nova-compute[75571]:         <nova:port uuid="5bdfc240-06a9-47c2-b496-bda3e4931c80">
Nov 28 20:12:40 user nova-compute[75571]:           <nova:ip type="fixed" address="10.1.1.100" ipVersion="4"/>
Nov 28 20:12:40 user nova-compute[75571]:         </nova:port>
Nov 28 20:12:40 user nova-compute[75571]:         <nova:port uuid="1732200a-bf2a-477a-b72e-7191f2ccfb4e">
Nov 28 20:12:40 user nova-compute[75571]:           <nova:ip type="fixed" address="10.1.1.87" ipVersion="4"/>
Nov 28 20:12:40 user nova-compute[75571]:         </nova:port>
Nov 28 20:12:40 user nova-compute[75571]:         <nova:port uuid="e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee">
Nov 28 20:12:40 user nova-compute[75571]:           <nova:ip type="fixed" address="10.1.1.206" ipVersion="4"/>
Nov 28 20:12:40 user nova-compute[75571]:         </nova:port>
Nov 28 20:12:40 user nova-compute[75571]:         <nova:port uuid="83928471-88d4-4e3f-bebd-40d53fcfd576">
Nov 28 20:12:40 user nova-compute[75571]:           <nova:ip type="fixed" address="10.1.1.133" ipVersion="4"/>
Nov 28 20:12:40 user nova-compute[75571]:         </nova:port>
Nov 28 20:12:40 user nova-compute[75571]:         <nova:port uuid="a5c9d8f5-1111-4aa6-a962-1f7136a267b0">
Nov 28 20:12:40 user nova-compute[75571]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 20:12:40 user nova-compute[75571]:         </nova:port>
Nov 28 20:12:40 user nova-compute[75571]:         <nova:port uuid="fe80e513-5da6-4885-8fce-0bc941bf6b4a">
Nov 28 20:12:40 user nova-compute[75571]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 20:12:40 user nova-compute[75571]:         </nova:port>
Nov 28 20:12:40 user nova-compute[75571]:       </nova:ports>
Nov 28 20:12:40 user nova-compute[75571]:     </nova:instance>
Nov 28 20:12:40 user nova-compute[75571]:   </metadata>
Nov 28 20:12:40 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:12:40 user nova-compute[75571]:     <system>
Nov 28 20:12:40 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:12:40 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:12:40 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:12:40 user nova-compute[75571]:       <entry name="serial">55765bf6-ce98-4e44-b444-afcb250dc54d</entry>
Nov 28 20:12:40 user nova-compute[75571]:       <entry name="uuid">55765bf6-ce98-4e44-b444-afcb250dc54d</entry>
Nov 28 20:12:40 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:12:40 user nova-compute[75571]:     </system>
Nov 28 20:12:40 user nova-compute[75571]:   </sysinfo>
Nov 28 20:12:40 user nova-compute[75571]:   <os>
Nov 28 20:12:40 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:12:40 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:12:40 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:12:40 user nova-compute[75571]:   </os>
Nov 28 20:12:40 user nova-compute[75571]:   <features>
Nov 28 20:12:40 user nova-compute[75571]:     <acpi/>
Nov 28 20:12:40 user nova-compute[75571]:     <apic/>
Nov 28 20:12:40 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:12:40 user nova-compute[75571]:   </features>
Nov 28 20:12:40 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:12:40 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:12:40 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:12:40 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:12:40 user nova-compute[75571]:   </clock>
Nov 28 20:12:40 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:12:40 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:12:40 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:12:40 user nova-compute[75571]:   </cpu>
Nov 28 20:12:40 user nova-compute[75571]:   <devices>
Nov 28 20:12:40 user nova-compute[75571]:     <disk type="file" device="cdrom">
Nov 28 20:12:40 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 20:12:40 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/55765bf6-ce98-4e44-b444-afcb250dc54d/disk.config"/>
Nov 28 20:12:40 user nova-compute[75571]:       <target dev="hda" bus="ide"/>
Nov 28 20:12:40 user nova-compute[75571]:     </disk>
Nov 28 20:12:40 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:12:40 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:12:40 user nova-compute[75571]:       <source dev="/dev/sdc"/>
Nov 28 20:12:40 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:12:40 user nova-compute[75571]:       <serial>268567d9-8c0c-46d9-8bc0-70157c860620</serial>
Nov 28 20:12:40 user nova-compute[75571]:     </disk>
Nov 28 20:12:40 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:12:40 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:12:40 user nova-compute[75571]:       <source dev="/dev/sdd"/>
Nov 28 20:12:40 user nova-compute[75571]:       <target dev="vdb" bus="virtio"/>
Nov 28 20:12:40 user nova-compute[75571]:       <serial>69f15c27-93a6-49d9-8e7c-b001e771f4f3</serial>
Nov 28 20:12:40 user nova-compute[75571]:     </disk>
Nov 28 20:12:40 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:12:40 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:12:40 user nova-compute[75571]:       <source dev="/dev/sde"/>
Nov 28 20:12:40 user nova-compute[75571]:       <target dev="vdc" bus="virtio"/>
Nov 28 20:12:40 user nova-compute[75571]:       <serial>b91bfea3-75ee-40af-b479-01a81b104cc5</serial>
Nov 28 20:12:40 user nova-compute[75571]:     </disk>
Nov 28 20:12:40 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:12:40 user nova-compute[75571]:       <mac address="fa:16:3e:24:b8:3a"/>
Nov 28 20:12:40 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:12:40 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:12:40 user nova-compute[75571]:       <target dev="tap84e4f0c4-3f"/>
Nov 28 20:12:40 user nova-compute[75571]:     </interface>
Nov 28 20:12:40 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:12:40 user nova-compute[75571]:       <mac address="fa:16:3e:16:7a:63"/>
Nov 28 20:12:40 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:12:40 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:12:40 user nova-compute[75571]:       <target dev="tap5bdfc240-06"/>
Nov 28 20:12:40 user nova-compute[75571]:     </interface>
Nov 28 20:12:40 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:12:40 user nova-compute[75571]:       <mac address="fa:16:3e:65:be:81"/>
Nov 28 20:12:40 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:12:40 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:12:40 user nova-compute[75571]:       <target dev="tap1732200a-bf"/>
Nov 28 20:12:40 user nova-compute[75571]:     </interface>
Nov 28 20:12:40 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:12:40 user nova-compute[75571]:       <mac address="fa:16:3e:a5:09:85"/>
Nov 28 20:12:40 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:12:40 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:12:40 user nova-compute[75571]:       <target dev="tape7f10eb6-f4"/>
Nov 28 20:12:40 user nova-compute[75571]:     </interface>
Nov 28 20:12:40 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:12:40 user nova-compute[75571]:       <mac address="fa:16:3e:79:c8:db"/>
Nov 28 20:12:40 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:12:40 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:12:40 user nova-compute[75571]:       <target dev="tap83928471-88"/>
Nov 28 20:12:40 user nova-compute[75571]:     </interface>
Nov 28 20:12:40 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:12:40 user nova-compute[75571]:       <mac address="fa:16:3e:53:ba:54"/>
Nov 28 20:12:40 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:12:40 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:12:40 user nova-compute[75571]:       <target dev="tapa5c9d8f5-11"/>
Nov 28 20:12:40 user nova-compute[75571]:     </interface>
Nov 28 20:12:40 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:12:40 user nova-compute[75571]:       <mac address="fa:16:3e:97:15:20"/>
Nov 28 20:12:40 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:12:40 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:12:40 user nova-compute[75571]:       <target dev="tapfe80e513-5d"/>
Nov 28 20:12:40 user nova-compute[75571]:     </interface>
Nov 28 20:12:40 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:12:40 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/55765bf6-ce98-4e44-b444-afcb250dc54d/console.log" append="off"/>
Nov 28 20:12:40 user nova-compute[75571]:     </serial>
Nov 28 20:12:40 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:12:40 user nova-compute[75571]:     <video>
Nov 28 20:12:40 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:12:40 user nova-compute[75571]:     </video>
Nov 28 20:12:40 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:12:40 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:12:40 user nova-compute[75571]:     </rng>
Nov 28 20:12:40 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:12:40 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:12:40 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:12:40 user nova-compute[75571]:     </memballoon>
Nov 28 20:12:40 user nova-compute[75571]:   </devices>
Nov 28 20:12:40 user nova-compute[75571]: </domain>
Nov 28 20:12:40 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "address": "fa:16:3e:24:b8:3a", "network": {"id": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959537065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e4f0c4-3f", "ovs_interfaceid": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "address": "fa:16:3e:24:b8:3a", "network": {"id": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959537065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e4f0c4-3f", "ovs_interfaceid": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:b8:3a,bridge_name='br-int',has_traffic_filtering=True,id=84e4f0c4-3f04-4c12-8691-9751c9f48d88,network=Network(8ac9ca6d-d1f1-4241-ae50-c00452fb1fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e4f0c4-3f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG os_vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:b8:3a,bridge_name='br-int',has_traffic_filtering=True,id=84e4f0c4-3f04-4c12-8691-9751c9f48d88,network=Network(8ac9ca6d-d1f1-4241-ae50-c00452fb1fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e4f0c4-3f') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '467c44a9-d560-532e-9267-47dd6d76d766', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84e4f0c4-3f, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84e4f0c4-3f, col_values=(('qos', UUID('8e521f49-918f-492e-8940-b4741717598b')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84e4f0c4-3f, col_values=(('external_ids', {'iface-id': '84e4f0c4-3f04-4c12-8691-9751c9f48d88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:b8:3a', 'vm-uuid': '55765bf6-ce98-4e44-b444-afcb250dc54d'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: INFO os_vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:b8:3a,bridge_name='br-int',has_traffic_filtering=True,id=84e4f0c4-3f04-4c12-8691-9751c9f48d88,network=Network(8ac9ca6d-d1f1-4241-ae50-c00452fb1fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e4f0c4-3f')
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=5bdfc240-06a9-47c2-b496-bda3e4931c80,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bdfc240-06') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG os_vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=5bdfc240-06a9-47c2-b496-bda3e4931c80,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bdfc240-06') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32ef0d59-dccf-501a-b438-fb7da10544c0', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bdfc240-06, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bdfc240-06, col_values=(('qos', UUID('e1ba20ca-c292-4139-a46d-af8e7b703200')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bdfc240-06, col_values=(('external_ids', {'iface-id': '5bdfc240-06a9-47c2-b496-bda3e4931c80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:7a:63', 'vm-uuid': '55765bf6-ce98-4e44-b444-afcb250dc54d'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: INFO os_vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=5bdfc240-06a9-47c2-b496-bda3e4931c80,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bdfc240-06')
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:be:81,bridge_name='br-int',has_traffic_filtering=True,id=1732200a-bf2a-477a-b72e-7191f2ccfb4e,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1732200a-bf') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG os_vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:be:81,bridge_name='br-int',has_traffic_filtering=True,id=1732200a-bf2a-477a-b72e-7191f2ccfb4e,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1732200a-bf') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'caf00e23-7f61-5ed8-a307-d34245cb54fd', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1732200a-bf, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1732200a-bf, col_values=(('qos', UUID('860dbf06-a243-41a7-8020-6d348bd90bef')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1732200a-bf, col_values=(('external_ids', {'iface-id': '1732200a-bf2a-477a-b72e-7191f2ccfb4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:be:81', 'vm-uuid': '55765bf6-ce98-4e44-b444-afcb250dc54d'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: INFO os_vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:be:81,bridge_name='br-int',has_traffic_filtering=True,id=1732200a-bf2a-477a-b72e-7191f2ccfb4e,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1732200a-bf')
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "address": "fa:16:3e:a5:09:85", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f10eb6-f4", "ovs_interfaceid": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "address": "fa:16:3e:a5:09:85", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f10eb6-f4", "ovs_interfaceid": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:09:85,bridge_name='br-int',has_traffic_filtering=True,id=e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f10eb6-f4') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG os_vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:09:85,bridge_name='br-int',has_traffic_filtering=True,id=e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f10eb6-f4') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '518be4e8-c1fe-580d-8974-4e8af61ffb00', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7f10eb6-f4, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7f10eb6-f4, col_values=(('qos', UUID('1473951b-0032-443c-9cbc-8bfd305b117f')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7f10eb6-f4, col_values=(('external_ids', {'iface-id': 'e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:09:85', 'vm-uuid': '55765bf6-ce98-4e44-b444-afcb250dc54d'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: INFO os_vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:09:85,bridge_name='br-int',has_traffic_filtering=True,id=e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f10eb6-f4')
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83928471-88d4-4e3f-bebd-40d53fcfd576", "address": "fa:16:3e:79:c8:db", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83928471-88", "ovs_interfaceid": "83928471-88d4-4e3f-bebd-40d53fcfd576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "83928471-88d4-4e3f-bebd-40d53fcfd576", "address": "fa:16:3e:79:c8:db", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83928471-88", "ovs_interfaceid": "83928471-88d4-4e3f-bebd-40d53fcfd576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:c8:db,bridge_name='br-int',has_traffic_filtering=True,id=83928471-88d4-4e3f-bebd-40d53fcfd576,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83928471-88') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG os_vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:c8:db,bridge_name='br-int',has_traffic_filtering=True,id=83928471-88d4-4e3f-bebd-40d53fcfd576,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83928471-88') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00a1cd7d-ad4f-59cf-8988-62b3fd26b9dd', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83928471-88, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83928471-88, col_values=(('qos', UUID('cafae07a-4653-4409-80c0-08dc2c89dc2c')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83928471-88, col_values=(('external_ids', {'iface-id': '83928471-88d4-4e3f-bebd-40d53fcfd576', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:c8:db', 'vm-uuid': '55765bf6-ce98-4e44-b444-afcb250dc54d'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: INFO os_vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:c8:db,bridge_name='br-int',has_traffic_filtering=True,id=83928471-88d4-4e3f-bebd-40d53fcfd576,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83928471-88')
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "address": "fa:16:3e:53:ba:54", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c9d8f5-11", "ovs_interfaceid": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "address": "fa:16:3e:53:ba:54", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c9d8f5-11", "ovs_interfaceid": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ba:54,bridge_name='br-int',has_traffic_filtering=True,id=a5c9d8f5-1111-4aa6-a962-1f7136a267b0,network=Network(93522955-fc00-44c2-b0d9-b7b4bb2f69a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c9d8f5-11') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG os_vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ba:54,bridge_name='br-int',has_traffic_filtering=True,id=a5c9d8f5-1111-4aa6-a962-1f7136a267b0,network=Network(93522955-fc00-44c2-b0d9-b7b4bb2f69a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c9d8f5-11') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51188589-994b-5b5b-b094-62a21f49099f', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5c9d8f5-11, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5c9d8f5-11, col_values=(('qos', UUID('0b8a874f-8810-4018-96d5-616ba7915d0d')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5c9d8f5-11, col_values=(('external_ids', {'iface-id': 'a5c9d8f5-1111-4aa6-a962-1f7136a267b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:ba:54', 'vm-uuid': '55765bf6-ce98-4e44-b444-afcb250dc54d'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: INFO os_vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ba:54,bridge_name='br-int',has_traffic_filtering=True,id=a5c9d8f5-1111-4aa6-a962-1f7136a267b0,network=Network(93522955-fc00-44c2-b0d9-b7b4bb2f69a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c9d8f5-11')
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:20,bridge_name='br-int',has_traffic_filtering=True,id=fe80e513-5da6-4885-8fce-0bc941bf6b4a,network=Network(93522955-fc00-44c2-b0d9-b7b4bb2f69a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe80e513-5d') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG os_vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:20,bridge_name='br-int',has_traffic_filtering=True,id=fe80e513-5da6-4885-8fce-0bc941bf6b4a,network=Network(93522955-fc00-44c2-b0d9-b7b4bb2f69a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe80e513-5d') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '927afd9b-12e7-5333-99ea-53a52742d055', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe80e513-5d, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe80e513-5d, col_values=(('qos', UUID('7461c76c-87b9-49e9-be79-8a743c009da9')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe80e513-5d, col_values=(('external_ids', {'iface-id': 'fe80e513-5da6-4885-8fce-0bc941bf6b4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:15:20', 'vm-uuid': '55765bf6-ce98-4e44-b444-afcb250dc54d'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:41 user nova-compute[75571]: INFO os_vif [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:20,bridge_name='br-int',has_traffic_filtering=True,id=fe80e513-5da6-4885-8fce-0bc941bf6b4a,network=Network(93522955-fc00-44c2-b0d9-b7b4bb2f69a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe80e513-5d')
Nov 28 20:12:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] No BDM found with device name hda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:12:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:12:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] No VIF found with MAC fa:16:3e:24:b8:3a, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:12:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] No VIF found with MAC fa:16:3e:79:c8:db, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:12:41 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Using config drive
Nov 28 20:12:41 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Creating config drive at /opt/stack/data/nova/instances/55765bf6-ce98-4e44-b444-afcb250dc54d/disk.config
Nov 28 20:12:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/55765bf6-ce98-4e44-b444-afcb250dc54d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7pgl92se {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/55765bf6-ce98-4e44-b444-afcb250dc54d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7pgl92se" returned: 0 in 0.146s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-f25413f1-b23b-4596-b406-5e3b1c68bf19 req-b8d1a192-d3a0-495e-ac13-487c0ecb191e service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-84e4f0c4-3f04-4c12-8691-9751c9f48d88 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f25413f1-b23b-4596-b406-5e3b1c68bf19 req-b8d1a192-d3a0-495e-ac13-487c0ecb191e service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f25413f1-b23b-4596-b406-5e3b1c68bf19 req-b8d1a192-d3a0-495e-ac13-487c0ecb191e service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f25413f1-b23b-4596-b406-5e3b1c68bf19 req-b8d1a192-d3a0-495e-ac13-487c0ecb191e service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-f25413f1-b23b-4596-b406-5e3b1c68bf19 req-b8d1a192-d3a0-495e-ac13-487c0ecb191e service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-84e4f0c4-3f04-4c12-8691-9751c9f48d88 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:43 user nova-compute[75571]: WARNING nova.compute.manager [req-f25413f1-b23b-4596-b406-5e3b1c68bf19 req-b8d1a192-d3a0-495e-ac13-487c0ecb191e service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-84e4f0c4-3f04-4c12-8691-9751c9f48d88 for instance with vm_state building and task_state spawning.
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG nova.compute.manager [req-11f74d65-5d6a-468d-9e80-4a10321f7bd2 req-52c5c076-c90b-4099-8596-d9ce07643434 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-83928471-88d4-4e3f-bebd-40d53fcfd576 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-11f74d65-5d6a-468d-9e80-4a10321f7bd2 req-52c5c076-c90b-4099-8596-d9ce07643434 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-11f74d65-5d6a-468d-9e80-4a10321f7bd2 req-52c5c076-c90b-4099-8596-d9ce07643434 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-11f74d65-5d6a-468d-9e80-4a10321f7bd2 req-52c5c076-c90b-4099-8596-d9ce07643434 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG nova.compute.manager [req-11f74d65-5d6a-468d-9e80-4a10321f7bd2 req-52c5c076-c90b-4099-8596-d9ce07643434 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-83928471-88d4-4e3f-bebd-40d53fcfd576 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:44 user nova-compute[75571]: WARNING nova.compute.manager [req-11f74d65-5d6a-468d-9e80-4a10321f7bd2 req-52c5c076-c90b-4099-8596-d9ce07643434 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-83928471-88d4-4e3f-bebd-40d53fcfd576 for instance with vm_state building and task_state spawning.
Nov 28 20:12:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG nova.compute.manager [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:12:44 user nova-compute[75571]: INFO nova.compute.claims [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Claim successful on node user
Nov 28 20:12:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-1e5433fb-fca0-42c5-8b9c-ffd52e6f0240 req-15bed0a9-b7c0-4de8-afb6-e90dc5ad9286 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-84e4f0c4-3f04-4c12-8691-9751c9f48d88 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1e5433fb-fca0-42c5-8b9c-ffd52e6f0240 req-15bed0a9-b7c0-4de8-afb6-e90dc5ad9286 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1e5433fb-fca0-42c5-8b9c-ffd52e6f0240 req-15bed0a9-b7c0-4de8-afb6-e90dc5ad9286 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1e5433fb-fca0-42c5-8b9c-ffd52e6f0240 req-15bed0a9-b7c0-4de8-afb6-e90dc5ad9286 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-1e5433fb-fca0-42c5-8b9c-ffd52e6f0240 req-15bed0a9-b7c0-4de8-afb6-e90dc5ad9286 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-84e4f0c4-3f04-4c12-8691-9751c9f48d88 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:45 user nova-compute[75571]: WARNING nova.compute.manager [req-1e5433fb-fca0-42c5-8b9c-ffd52e6f0240 req-15bed0a9-b7c0-4de8-afb6-e90dc5ad9286 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-84e4f0c4-3f04-4c12-8691-9751c9f48d88 for instance with vm_state building and task_state spawning.
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG nova.compute.manager [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG nova.compute.manager [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG nova.network.neutron [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:12:45 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:12:45 user nova-compute[75571]: DEBUG nova.compute.manager [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG nova.policy [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '854e01c9d8d644299bbf6b9a18e00fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed5b9f19e584ca5bd8bf2d75b5ee765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG nova.compute.manager [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:12:45 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Creating image(s)
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "/opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "/opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.191s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-f336bcc6-28d1-4a28-8df2-208443310315 req-f51083da-f13e-41c7-9b00-97236c4ef808 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-5bdfc240-06a9-47c2-b496-bda3e4931c80 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f336bcc6-28d1-4a28-8df2-208443310315 req-f51083da-f13e-41c7-9b00-97236c4ef808 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f336bcc6-28d1-4a28-8df2-208443310315 req-f51083da-f13e-41c7-9b00-97236c4ef808 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f336bcc6-28d1-4a28-8df2-208443310315 req-f51083da-f13e-41c7-9b00-97236c4ef808 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-f336bcc6-28d1-4a28-8df2-208443310315 req-f51083da-f13e-41c7-9b00-97236c4ef808 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-5bdfc240-06a9-47c2-b496-bda3e4931c80 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:45 user nova-compute[75571]: WARNING nova.compute.manager [req-f336bcc6-28d1-4a28-8df2-208443310315 req-f51083da-f13e-41c7-9b00-97236c4ef808 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-5bdfc240-06a9-47c2-b496-bda3e4931c80 for instance with vm_state building and task_state spawning.
Nov 28 20:12:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk 1073741824" returned: 0 in 0.107s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Successfully created port: a1d9020e-bbea-4ca9-8cc9-e4c684b47aac {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.195s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Cannot resize image /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Ensure instance console log exists: /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-83928471-88d4-4e3f-bebd-40d53fcfd576 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-83928471-88d4-4e3f-bebd-40d53fcfd576 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:46 user nova-compute[75571]: WARNING nova.compute.manager [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-83928471-88d4-4e3f-bebd-40d53fcfd576 for instance with vm_state building and task_state spawning.
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-a5c9d8f5-1111-4aa6-a962-1f7136a267b0 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-a5c9d8f5-1111-4aa6-a962-1f7136a267b0 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:46 user nova-compute[75571]: WARNING nova.compute.manager [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-a5c9d8f5-1111-4aa6-a962-1f7136a267b0 for instance with vm_state building and task_state spawning.
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-a5c9d8f5-1111-4aa6-a962-1f7136a267b0 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-a5c9d8f5-1111-4aa6-a962-1f7136a267b0 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:46 user nova-compute[75571]: WARNING nova.compute.manager [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-a5c9d8f5-1111-4aa6-a962-1f7136a267b0 for instance with vm_state building and task_state spawning.
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-fe80e513-5da6-4885-8fce-0bc941bf6b4a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-fe80e513-5da6-4885-8fce-0bc941bf6b4a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:46 user nova-compute[75571]: WARNING nova.compute.manager [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-fe80e513-5da6-4885-8fce-0bc941bf6b4a for instance with vm_state building and task_state spawning.
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-fe80e513-5da6-4885-8fce-0bc941bf6b4a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-fe80e513-5da6-4885-8fce-0bc941bf6b4a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:46 user nova-compute[75571]: WARNING nova.compute.manager [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-fe80e513-5da6-4885-8fce-0bc941bf6b4a for instance with vm_state building and task_state spawning.
Nov 28 20:12:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Successfully updated port: a1d9020e-bbea-4ca9-8cc9-e4c684b47aac {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "refresh_cache-8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquired lock "refresh_cache-8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.network.neutron [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Updating instance_info_cache with network_info: [{"id": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "address": "fa:16:3e:b1:1f:b2", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d9020e-bb", "ovs_interfaceid": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Releasing lock "refresh_cache-8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Instance network_info: |[{"id": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "address": "fa:16:3e:b1:1f:b2", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d9020e-bb", "ovs_interfaceid": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Start _get_guest_xml network_info=[{"id": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "address": "fa:16:3e:b1:1f:b2", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d9020e-bb", "ovs_interfaceid": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:12:47 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:12:47 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1829120743',display_name='tempest-VolumesActionsTest-instance-1829120743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1829120743',id=10,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed5b9f19e584ca5bd8bf2d75b5ee765',ramdisk_id='',reservation_id='r-9lp7rtx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1803837223',owner_user_name='tempest-VolumesActionsTest-1803837223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:45Z,user_data=None,user_id='854e01c9d8d644299bbf6b9a18e00fcd',uuid=8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "address": "fa:16:3e:b1:1f:b2", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d9020e-bb", "ovs_interfaceid": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Converting VIF {"id": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "address": "fa:16:3e:b1:1f:b2", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d9020e-bb", "ovs_interfaceid": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a1d9020e-bbea-4ca9-8cc9-e4c684b47aac,network=Network(00de1a40-1743-4c1d-a032-0ae863c7e009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d9020e-bb') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.objects.instance [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:12:47 user nova-compute[75571]:   <uuid>8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6</uuid>
Nov 28 20:12:47 user nova-compute[75571]:   <name>instance-0000000a</name>
Nov 28 20:12:47 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:12:47 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:12:47 user nova-compute[75571]:   <metadata>
Nov 28 20:12:47 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:12:47 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:12:47 user nova-compute[75571]:       <nova:name>tempest-VolumesActionsTest-instance-1829120743</nova:name>
Nov 28 20:12:47 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:12:47</nova:creationTime>
Nov 28 20:12:47 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:12:47 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:12:47 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:12:47 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:12:47 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:12:47 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:12:47 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:12:47 user nova-compute[75571]:       <nova:owner>
Nov 28 20:12:47 user nova-compute[75571]:         <nova:user uuid="854e01c9d8d644299bbf6b9a18e00fcd">tempest-VolumesActionsTest-1803837223-project-member</nova:user>
Nov 28 20:12:47 user nova-compute[75571]:         <nova:project uuid="bed5b9f19e584ca5bd8bf2d75b5ee765">tempest-VolumesActionsTest-1803837223</nova:project>
Nov 28 20:12:47 user nova-compute[75571]:       </nova:owner>
Nov 28 20:12:47 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:12:47 user nova-compute[75571]:       <nova:ports>
Nov 28 20:12:47 user nova-compute[75571]:         <nova:port uuid="a1d9020e-bbea-4ca9-8cc9-e4c684b47aac">
Nov 28 20:12:47 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 20:12:47 user nova-compute[75571]:         </nova:port>
Nov 28 20:12:47 user nova-compute[75571]:       </nova:ports>
Nov 28 20:12:47 user nova-compute[75571]:     </nova:instance>
Nov 28 20:12:47 user nova-compute[75571]:   </metadata>
Nov 28 20:12:47 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:12:47 user nova-compute[75571]:     <system>
Nov 28 20:12:47 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:12:47 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:12:47 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:12:47 user nova-compute[75571]:       <entry name="serial">8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6</entry>
Nov 28 20:12:47 user nova-compute[75571]:       <entry name="uuid">8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6</entry>
Nov 28 20:12:47 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:12:47 user nova-compute[75571]:     </system>
Nov 28 20:12:47 user nova-compute[75571]:   </sysinfo>
Nov 28 20:12:47 user nova-compute[75571]:   <os>
Nov 28 20:12:47 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:12:47 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:12:47 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:12:47 user nova-compute[75571]:   </os>
Nov 28 20:12:47 user nova-compute[75571]:   <features>
Nov 28 20:12:47 user nova-compute[75571]:     <acpi/>
Nov 28 20:12:47 user nova-compute[75571]:     <apic/>
Nov 28 20:12:47 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:12:47 user nova-compute[75571]:   </features>
Nov 28 20:12:47 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:12:47 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:12:47 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:12:47 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:12:47 user nova-compute[75571]:   </clock>
Nov 28 20:12:47 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:12:47 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:12:47 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:12:47 user nova-compute[75571]:   </cpu>
Nov 28 20:12:47 user nova-compute[75571]:   <devices>
Nov 28 20:12:47 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:12:47 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:12:47 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk"/>
Nov 28 20:12:47 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:12:47 user nova-compute[75571]:     </disk>
Nov 28 20:12:47 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:12:47 user nova-compute[75571]:       <mac address="fa:16:3e:b1:1f:b2"/>
Nov 28 20:12:47 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:12:47 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:12:47 user nova-compute[75571]:       <target dev="tapa1d9020e-bb"/>
Nov 28 20:12:47 user nova-compute[75571]:     </interface>
Nov 28 20:12:47 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:12:47 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/console.log" append="off"/>
Nov 28 20:12:47 user nova-compute[75571]:     </serial>
Nov 28 20:12:47 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:12:47 user nova-compute[75571]:     <video>
Nov 28 20:12:47 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:12:47 user nova-compute[75571]:     </video>
Nov 28 20:12:47 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:12:47 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:12:47 user nova-compute[75571]:     </rng>
Nov 28 20:12:47 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:12:47 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:12:47 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:12:47 user nova-compute[75571]:     </memballoon>
Nov 28 20:12:47 user nova-compute[75571]:   </devices>
Nov 28 20:12:47 user nova-compute[75571]: </domain>
Nov 28 20:12:47 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1829120743',display_name='tempest-VolumesActionsTest-instance-1829120743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1829120743',id=10,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed5b9f19e584ca5bd8bf2d75b5ee765',ramdisk_id='',reservation_id='r-9lp7rtx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1803837223',owner_user_name='tempest-VolumesActionsTest-1803837223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:12:45Z,user_data=None,user_id='854e01c9d8d644299bbf6b9a18e00fcd',uuid=8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "address": "fa:16:3e:b1:1f:b2", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d9020e-bb", "ovs_interfaceid": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Converting VIF {"id": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "address": "fa:16:3e:b1:1f:b2", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d9020e-bb", "ovs_interfaceid": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a1d9020e-bbea-4ca9-8cc9-e4c684b47aac,network=Network(00de1a40-1743-4c1d-a032-0ae863c7e009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d9020e-bb') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG os_vif [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a1d9020e-bbea-4ca9-8cc9-e4c684b47aac,network=Network(00de1a40-1743-4c1d-a032-0ae863c7e009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d9020e-bb') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0642b834-da87-5c0c-9ea7-055bd919d4c6', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1d9020e-bb, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1d9020e-bb, col_values=(('qos', UUID('ae706a84-7962-44d3-92fe-b7255d905270')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1d9020e-bb, col_values=(('external_ids', {'iface-id': 'a1d9020e-bbea-4ca9-8cc9-e4c684b47aac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:1f:b2', 'vm-uuid': '8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:47 user nova-compute[75571]: INFO os_vif [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a1d9020e-bbea-4ca9-8cc9-e4c684b47aac,network=Network(00de1a40-1743-4c1d-a032-0ae863c7e009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d9020e-bb')
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:12:47 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Instance spawned successfully.
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] No VIF found with MAC fa:16:3e:b1:1f:b2, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:12:47 user nova-compute[75571]: INFO nova.compute.manager [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Took 11.43 seconds to spawn the instance on the hypervisor.
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:12:47 user nova-compute[75571]: INFO nova.compute.manager [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Took 37.44 seconds to build instance.
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.568s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-5bdfc240-06a9-47c2-b496-bda3e4931c80 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-5bdfc240-06a9-47c2-b496-bda3e4931c80 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:47 user nova-compute[75571]: WARNING nova.compute.manager [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-5bdfc240-06a9-47c2-b496-bda3e4931c80 for instance with vm_state active and task_state None.
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-1732200a-bf2a-477a-b72e-7191f2ccfb4e {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-1732200a-bf2a-477a-b72e-7191f2ccfb4e {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:47 user nova-compute[75571]: WARNING nova.compute.manager [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-1732200a-bf2a-477a-b72e-7191f2ccfb4e for instance with vm_state active and task_state None.
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-1732200a-bf2a-477a-b72e-7191f2ccfb4e {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-1732200a-bf2a-477a-b72e-7191f2ccfb4e {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:47 user nova-compute[75571]: WARNING nova.compute.manager [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-1732200a-bf2a-477a-b72e-7191f2ccfb4e for instance with vm_state active and task_state None.
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:47 user nova-compute[75571]: WARNING nova.compute.manager [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee for instance with vm_state active and task_state None.
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:47 user nova-compute[75571]: WARNING nova.compute.manager [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee for instance with vm_state active and task_state None.
Nov 28 20:12:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-f109e702-fad5-4d9d-b115-2cd9464a47ba req-01b9babd-98c1-40ef-9549-7b5435cf4236 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Received event network-changed-a1d9020e-bbea-4ca9-8cc9-e4c684b47aac {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-f109e702-fad5-4d9d-b115-2cd9464a47ba req-01b9babd-98c1-40ef-9549-7b5435cf4236 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Refreshing instance network info cache due to event network-changed-a1d9020e-bbea-4ca9-8cc9-e4c684b47aac. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:12:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f109e702-fad5-4d9d-b115-2cd9464a47ba req-01b9babd-98c1-40ef-9549-7b5435cf4236 service nova] Acquiring lock "refresh_cache-8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:12:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f109e702-fad5-4d9d-b115-2cd9464a47ba req-01b9babd-98c1-40ef-9549-7b5435cf4236 service nova] Acquired lock "refresh_cache-8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:12:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-f109e702-fad5-4d9d-b115-2cd9464a47ba req-01b9babd-98c1-40ef-9549-7b5435cf4236 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Refreshing network info cache for port a1d9020e-bbea-4ca9-8cc9-e4c684b47aac {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:12:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:49 user nova-compute[75571]: DEBUG nova.network.neutron [req-f109e702-fad5-4d9d-b115-2cd9464a47ba req-01b9babd-98c1-40ef-9549-7b5435cf4236 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Updated VIF entry in instance network info cache for port a1d9020e-bbea-4ca9-8cc9-e4c684b47aac. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:12:49 user nova-compute[75571]: DEBUG nova.network.neutron [req-f109e702-fad5-4d9d-b115-2cd9464a47ba req-01b9babd-98c1-40ef-9549-7b5435cf4236 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Updating instance_info_cache with network_info: [{"id": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "address": "fa:16:3e:b1:1f:b2", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d9020e-bb", "ovs_interfaceid": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:12:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f109e702-fad5-4d9d-b115-2cd9464a47ba req-01b9babd-98c1-40ef-9549-7b5435cf4236 service nova] Releasing lock "refresh_cache-8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:12:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "42d7a4d5-4d2a-4803-b253-b656aec16f69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG nova.objects.instance [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lazy-loading 'flavor' on Instance uuid 42d7a4d5-4d2a-4803-b253-b656aec16f69 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG nova.compute.manager [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Received event network-vif-plugged-a1d9020e-bbea-4ca9-8cc9-e4c684b47aac {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] Acquiring lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] Lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] Lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG nova.compute.manager [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] No waiting events found dispatching network-vif-plugged-a1d9020e-bbea-4ca9-8cc9-e4c684b47aac {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:50 user nova-compute[75571]: WARNING nova.compute.manager [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Received unexpected event network-vif-plugged-a1d9020e-bbea-4ca9-8cc9-e4c684b47aac for instance with vm_state building and task_state spawning.
Nov 28 20:12:50 user nova-compute[75571]: DEBUG nova.compute.manager [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Received event network-vif-plugged-a1d9020e-bbea-4ca9-8cc9-e4c684b47aac {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] Acquiring lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] Lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] Lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG nova.compute.manager [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] No waiting events found dispatching network-vif-plugged-a1d9020e-bbea-4ca9-8cc9-e4c684b47aac {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:12:50 user nova-compute[75571]: WARNING nova.compute.manager [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Received unexpected event network-vif-plugged-a1d9020e-bbea-4ca9-8cc9-e4c684b47aac for instance with vm_state building and task_state spawning.
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.307s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "42d7a4d5-4d2a-4803-b253-b656aec16f69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:50 user nova-compute[75571]: INFO nova.compute.manager [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Attaching volume b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 to /dev/vdb
Nov 28 20:12:50 user nova-compute[75571]: DEBUG os_brick.utils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eda7111-bdb7-4fc2-bae7-ea2f15f645d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b684bf-aab7-4c9a-bcea-5fe86df1635c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e207de1-c025-44f1-9db3-cd0dfa311a2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dafe09c-d91a-457e-9967-058c9c52ba81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:12:50 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:12:50 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6b77cd-a568-43f1-b548-2ea150541276]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG os_brick.utils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:12:50 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Updating existing volume attachment record: a4e4731f-2946-4bb5-aa6c-867e5bb93fa3 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:12:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:12:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:12:51 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Instance spawned successfully.
Nov 28 20:12:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:12:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:12:51 user nova-compute[75571]: INFO nova.compute.manager [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 28 20:12:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:12:51 user nova-compute[75571]: INFO nova.compute.manager [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Took 7.04 seconds to build instance.
Nov 28 20:12:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.174s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:54 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:12:54 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:12:54 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:12:54 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:12:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:12:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:12:54 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-5b86778b-efd2-4770-a4aa-1fe8c547d37a req-1da056a5-fee0-4916-b00f-3440497aa1a7 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Received event network-changed-ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-5b86778b-efd2-4770-a4aa-1fe8c547d37a req-1da056a5-fee0-4916-b00f-3440497aa1a7 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Refreshing instance network info cache due to event network-changed-ba72889d-186f-4e53-893b-5509d0882a6a. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5b86778b-efd2-4770-a4aa-1fe8c547d37a req-1da056a5-fee0-4916-b00f-3440497aa1a7 service nova] Acquiring lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updating instance_info_cache with network_info: [{"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5b86778b-efd2-4770-a4aa-1fe8c547d37a req-1da056a5-fee0-4916-b00f-3440497aa1a7 service nova] Acquired lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG nova.network.neutron [req-5b86778b-efd2-4770-a4aa-1fe8c547d37a req-1da056a5-fee0-4916-b00f-3440497aa1a7 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Refreshing network info cache for port ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:12:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:56 user nova-compute[75571]: DEBUG nova.network.neutron [req-5b86778b-efd2-4770-a4aa-1fe8c547d37a req-1da056a5-fee0-4916-b00f-3440497aa1a7 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updated VIF entry in instance network info cache for port ba72889d-186f-4e53-893b-5509d0882a6a. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:12:56 user nova-compute[75571]: DEBUG nova.network.neutron [req-5b86778b-efd2-4770-a4aa-1fe8c547d37a req-1da056a5-fee0-4916-b00f-3440497aa1a7 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updating instance_info_cache with network_info: [{"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:12:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5b86778b-efd2-4770-a4aa-1fe8c547d37a req-1da056a5-fee0-4916-b00f-3440497aa1a7 service nova] Releasing lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:12:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk --force-share --output=json" returned: 0 in 0.334s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:12:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:12:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:12:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:58 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:12:58 user nova-compute[75571]: INFO nova.compute.claims [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Claim successful on node user
Nov 28 20:12:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:12:59 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:12:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwrTjybJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:12:59 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:12:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:12:59 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:12:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:12:59 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260" returned: 21 in 0.038s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4cd107-79bc-44f7-8bc6-16aea1827cd2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:12:59 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb764e1e-0a0f-463f-9bd0-38213c4d03d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35] added
Nov 28 20:12:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG nova.policy [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29664fb367db470abbd15cfbf39dd38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742419219fb94804bef60efd10716a41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ea35f2-db46-4ab4-896d-8bb7cd85fade]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[681f4676-83f6-4be3-baf2-e59caf7c8b74]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwrTjybJ {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:12:59 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Creating image(s)
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "/opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "/opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwrTjybJ" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:12:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9cdc22-0f33-460f-a526-496849c6d9f2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EwrTjybJ'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a45b37-5d41-4153-9132-1df8c182cd40]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:00 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:13:00 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=7502MB free_disk=25.492958068847656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eb94a0-eae2-4404-96c0-e01f46fd1e27]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e03c30-8bde-439f-bee0-034dfa0bcb57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35, portal: 172.16.0.220,3260]
Nov 28 20:13:00 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35, portal: 172.16.0.220,3260] successful.
Nov 28 20:13:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79dcd41-7905-4718-af28-3505c7fe37e7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5559ec-eb4c-437e-948a-129da76eaacb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 (non-flash)
Nov 28 20:13:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.783s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b91e7d3-3160-4f4c-8888-d29cf4e38682]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwrTjybJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance fe726611-331a-495f-a6bd-ced2d1a305b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 415392e8-bf6c-433e-a4f5-be3d99419710 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 59a360a3-bce3-4673-b79e-cd0460d2a69a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 55765bf6-ce98-4e44-b444-afcb250dc54d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e902b4e2-d53e-459f-a10e-bcbba4fc2317 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance a8112c4a-cb42-49df-81a7-97b42f5cc87d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk 1073741824" returned: 0 in 0.050s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Successfully created port: 11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Cannot resize image /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Ensure instance console log exists: /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:13:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.810s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Successfully updated port: 11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.839s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] <== connect_volume: return (1841ms) {'type': 'block', 'scsi_wwn': '26662363937623331', 'path': '/dev/sdf'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662363937623331', 'path': '/dev/sdf'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "refresh_cache-a8112c4a-cb42-49df-81a7-97b42f5cc87d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquired lock "refresh_cache-a8112c4a-cb42-49df-81a7-97b42f5cc87d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.objects.instance [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lazy-loading 'flavor' on Instance uuid 42d7a4d5-4d2a-4803-b253-b656aec16f69 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.compute.manager [req-ca951a6a-6e23-426d-a2af-0238deb12a3e req-b863f4d0-f3fb-4c0f-b877-b9f266227651 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received event network-changed-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.compute.manager [req-ca951a6a-6e23-426d-a2af-0238deb12a3e req-b863f4d0-f3fb-4c0f-b877-b9f266227651 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Refreshing instance network info cache due to event network-changed-11217ca7-1cb1-404d-8a7c-a8a33ff80098. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ca951a6a-6e23-426d-a2af-0238deb12a3e req-b863f4d0-f3fb-4c0f-b877-b9f266227651 service nova] Acquiring lock "refresh_cache-a8112c4a-cb42-49df-81a7-97b42f5cc87d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:13:01 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:13:01 user nova-compute[75571]:   <source dev="/dev/sdf"/>
Nov 28 20:13:01 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:13:01 user nova-compute[75571]:   <serial>b5bf0ecc-30b8-40c5-b56b-1a41db2efe35</serial>
Nov 28 20:13:01 user nova-compute[75571]: </disk>
Nov 28 20:13:01 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Updating instance_info_cache with network_info: [{"id": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "address": "fa:16:3e:f7:a3:4b", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11217ca7-1c", "ovs_interfaceid": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Releasing lock "refresh_cache-a8112c4a-cb42-49df-81a7-97b42f5cc87d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Instance network_info: |[{"id": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "address": "fa:16:3e:f7:a3:4b", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11217ca7-1c", "ovs_interfaceid": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ca951a6a-6e23-426d-a2af-0238deb12a3e req-b863f4d0-f3fb-4c0f-b877-b9f266227651 service nova] Acquired lock "refresh_cache-a8112c4a-cb42-49df-81a7-97b42f5cc87d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.network.neutron [req-ca951a6a-6e23-426d-a2af-0238deb12a3e req-b863f4d0-f3fb-4c0f-b877-b9f266227651 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Refreshing network info cache for port 11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Start _get_guest_xml network_info=[{"id": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "address": "fa:16:3e:f7:a3:4b", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11217ca7-1c", "ovs_interfaceid": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:13:01 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:13:01 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-693276343',display_name='tempest-TestStampPattern-server-693276343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-693276343',id=11,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKHSIcqSS6r5Xbk8DWkPtgQAYtxPI66k2MpIys7luJ+eXKJCwl3YX7s+WE2XtlqbyhCHYbp1Jbg6h1ZtUXzTkBXgQiD1zygrVkmZ1u0tehRUXvexgqD4sXlJ9Q5zsLuRw==',key_name='tempest-TestStampPattern-550063434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='742419219fb94804bef60efd10716a41',ramdisk_id='',reservation_id='r-t59romih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-152273837',owner_user_name='tempest-TestStampPattern-152273837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:13:00Z,user_data=None,user_id='29664fb367db470abbd15cfbf39dd38a',uuid=a8112c4a-cb42-49df-81a7-97b42f5cc87d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "address": "fa:16:3e:f7:a3:4b", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11217ca7-1c", "ovs_interfaceid": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Converting VIF {"id": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "address": "fa:16:3e:f7:a3:4b", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11217ca7-1c", "ovs_interfaceid": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a3:4b,bridge_name='br-int',has_traffic_filtering=True,id=11217ca7-1cb1-404d-8a7c-a8a33ff80098,network=Network(3f7305f6-e668-4fc6-82bd-f6f519c2bd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11217ca7-1c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.objects.instance [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lazy-loading 'pci_devices' on Instance uuid a8112c4a-cb42-49df-81a7-97b42f5cc87d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:13:01 user nova-compute[75571]:   <uuid>a8112c4a-cb42-49df-81a7-97b42f5cc87d</uuid>
Nov 28 20:13:01 user nova-compute[75571]:   <name>instance-0000000b</name>
Nov 28 20:13:01 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:13:01 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:13:01 user nova-compute[75571]:   <metadata>
Nov 28 20:13:01 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:13:01 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:13:01 user nova-compute[75571]:       <nova:name>tempest-TestStampPattern-server-693276343</nova:name>
Nov 28 20:13:01 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:13:01</nova:creationTime>
Nov 28 20:13:01 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:13:01 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:13:01 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:13:01 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:13:01 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:13:01 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:13:01 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:13:01 user nova-compute[75571]:       <nova:owner>
Nov 28 20:13:01 user nova-compute[75571]:         <nova:user uuid="29664fb367db470abbd15cfbf39dd38a">tempest-TestStampPattern-152273837-project-member</nova:user>
Nov 28 20:13:01 user nova-compute[75571]:         <nova:project uuid="742419219fb94804bef60efd10716a41">tempest-TestStampPattern-152273837</nova:project>
Nov 28 20:13:01 user nova-compute[75571]:       </nova:owner>
Nov 28 20:13:01 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:13:01 user nova-compute[75571]:       <nova:ports>
Nov 28 20:13:01 user nova-compute[75571]:         <nova:port uuid="11217ca7-1cb1-404d-8a7c-a8a33ff80098">
Nov 28 20:13:01 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 20:13:01 user nova-compute[75571]:         </nova:port>
Nov 28 20:13:01 user nova-compute[75571]:       </nova:ports>
Nov 28 20:13:01 user nova-compute[75571]:     </nova:instance>
Nov 28 20:13:01 user nova-compute[75571]:   </metadata>
Nov 28 20:13:01 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:13:01 user nova-compute[75571]:     <system>
Nov 28 20:13:01 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:13:01 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:13:01 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:13:01 user nova-compute[75571]:       <entry name="serial">a8112c4a-cb42-49df-81a7-97b42f5cc87d</entry>
Nov 28 20:13:01 user nova-compute[75571]:       <entry name="uuid">a8112c4a-cb42-49df-81a7-97b42f5cc87d</entry>
Nov 28 20:13:01 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:13:01 user nova-compute[75571]:     </system>
Nov 28 20:13:01 user nova-compute[75571]:   </sysinfo>
Nov 28 20:13:01 user nova-compute[75571]:   <os>
Nov 28 20:13:01 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:13:01 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:13:01 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:13:01 user nova-compute[75571]:   </os>
Nov 28 20:13:01 user nova-compute[75571]:   <features>
Nov 28 20:13:01 user nova-compute[75571]:     <acpi/>
Nov 28 20:13:01 user nova-compute[75571]:     <apic/>
Nov 28 20:13:01 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:13:01 user nova-compute[75571]:   </features>
Nov 28 20:13:01 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:13:01 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:13:01 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:13:01 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:13:01 user nova-compute[75571]:   </clock>
Nov 28 20:13:01 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:13:01 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:13:01 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:13:01 user nova-compute[75571]:   </cpu>
Nov 28 20:13:01 user nova-compute[75571]:   <devices>
Nov 28 20:13:01 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:13:01 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:13:01 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk"/>
Nov 28 20:13:01 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:13:01 user nova-compute[75571]:     </disk>
Nov 28 20:13:01 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:13:01 user nova-compute[75571]:       <mac address="fa:16:3e:f7:a3:4b"/>
Nov 28 20:13:01 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:13:01 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:13:01 user nova-compute[75571]:       <target dev="tap11217ca7-1c"/>
Nov 28 20:13:01 user nova-compute[75571]:     </interface>
Nov 28 20:13:01 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:13:01 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/console.log" append="off"/>
Nov 28 20:13:01 user nova-compute[75571]:     </serial>
Nov 28 20:13:01 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:13:01 user nova-compute[75571]:     <video>
Nov 28 20:13:01 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:13:01 user nova-compute[75571]:     </video>
Nov 28 20:13:01 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:13:01 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:13:01 user nova-compute[75571]:     </rng>
Nov 28 20:13:01 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:13:01 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:13:01 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:13:01 user nova-compute[75571]:     </memballoon>
Nov 28 20:13:01 user nova-compute[75571]:   </devices>
Nov 28 20:13:01 user nova-compute[75571]: </domain>
Nov 28 20:13:01 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-693276343',display_name='tempest-TestStampPattern-server-693276343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-693276343',id=11,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKHSIcqSS6r5Xbk8DWkPtgQAYtxPI66k2MpIys7luJ+eXKJCwl3YX7s+WE2XtlqbyhCHYbp1Jbg6h1ZtUXzTkBXgQiD1zygrVkmZ1u0tehRUXvexgqD4sXlJ9Q5zsLuRw==',key_name='tempest-TestStampPattern-550063434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='742419219fb94804bef60efd10716a41',ramdisk_id='',reservation_id='r-t59romih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-152273837',owner_user_name='tempest-TestStampPattern-152273837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:13:00Z,user_data=None,user_id='29664fb367db470abbd15cfbf39dd38a',uuid=a8112c4a-cb42-49df-81a7-97b42f5cc87d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "address": "fa:16:3e:f7:a3:4b", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11217ca7-1c", "ovs_interfaceid": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Converting VIF {"id": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "address": "fa:16:3e:f7:a3:4b", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11217ca7-1c", "ovs_interfaceid": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a3:4b,bridge_name='br-int',has_traffic_filtering=True,id=11217ca7-1cb1-404d-8a7c-a8a33ff80098,network=Network(3f7305f6-e668-4fc6-82bd-f6f519c2bd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11217ca7-1c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG os_vif [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a3:4b,bridge_name='br-int',has_traffic_filtering=True,id=11217ca7-1cb1-404d-8a7c-a8a33ff80098,network=Network(3f7305f6-e668-4fc6-82bd-f6f519c2bd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11217ca7-1c') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9842835e-abda-5fef-99ca-e6dff7f2685d', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11217ca7-1c, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11217ca7-1c, col_values=(('qos', UUID('a4a4c230-eef7-4340-89ba-2ecbbb0d6288')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11217ca7-1c, col_values=(('external_ids', {'iface-id': '11217ca7-1cb1-404d-8a7c-a8a33ff80098', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:a3:4b', 'vm-uuid': 'a8112c4a-cb42-49df-81a7-97b42f5cc87d'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:01 user nova-compute[75571]: INFO os_vif [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a3:4b,bridge_name='br-int',has_traffic_filtering=True,id=11217ca7-1cb1-404d-8a7c-a8a33ff80098,network=Network(3f7305f6-e668-4fc6-82bd-f6f519c2bd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11217ca7-1c')
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] No VIF found with MAC fa:16:3e:e8:84:60, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:13:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] No VIF found with MAC fa:16:3e:f7:a3:4b, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:13:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.381s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:02 user nova-compute[75571]: DEBUG nova.network.neutron [req-ca951a6a-6e23-426d-a2af-0238deb12a3e req-b863f4d0-f3fb-4c0f-b877-b9f266227651 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Updated VIF entry in instance network info cache for port 11217ca7-1cb1-404d-8a7c-a8a33ff80098. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:13:02 user nova-compute[75571]: DEBUG nova.network.neutron [req-ca951a6a-6e23-426d-a2af-0238deb12a3e req-b863f4d0-f3fb-4c0f-b877-b9f266227651 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Updating instance_info_cache with network_info: [{"id": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "address": "fa:16:3e:f7:a3:4b", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11217ca7-1c", "ovs_interfaceid": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:13:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ca951a6a-6e23-426d-a2af-0238deb12a3e req-b863f4d0-f3fb-4c0f-b877-b9f266227651 service nova] Releasing lock "refresh_cache-a8112c4a-cb42-49df-81a7-97b42f5cc87d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "42d7a4d5-4d2a-4803-b253-b656aec16f69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "42d7a4d5-4d2a-4803-b253-b656aec16f69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:03 user nova-compute[75571]: INFO nova.compute.manager [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Terminating instance
Nov 28 20:13:03 user nova-compute[75571]: DEBUG nova.compute.manager [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-b919a0c4-ee37-4223-83b0-529de1be336b req-fc438dc3-d304-4588-8295-279b57a0684a service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Received event network-vif-unplugged-a382b348-9cff-4cf4-9651-4fd406284eca {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b919a0c4-ee37-4223-83b0-529de1be336b req-fc438dc3-d304-4588-8295-279b57a0684a service nova] Acquiring lock "42d7a4d5-4d2a-4803-b253-b656aec16f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b919a0c4-ee37-4223-83b0-529de1be336b req-fc438dc3-d304-4588-8295-279b57a0684a service nova] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b919a0c4-ee37-4223-83b0-529de1be336b req-fc438dc3-d304-4588-8295-279b57a0684a service nova] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-b919a0c4-ee37-4223-83b0-529de1be336b req-fc438dc3-d304-4588-8295-279b57a0684a service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] No waiting events found dispatching network-vif-unplugged-a382b348-9cff-4cf4-9651-4fd406284eca {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-b919a0c4-ee37-4223-83b0-529de1be336b req-fc438dc3-d304-4588-8295-279b57a0684a service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Received event network-vif-unplugged-a382b348-9cff-4cf4-9651-4fd406284eca for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-bf292b15-dd88-4800-be4c-95d3c86e7269 req-61046673-2464-4500-8d69-ec32db3715b1 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received event network-vif-plugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bf292b15-dd88-4800-be4c-95d3c86e7269 req-61046673-2464-4500-8d69-ec32db3715b1 service nova] Acquiring lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bf292b15-dd88-4800-be4c-95d3c86e7269 req-61046673-2464-4500-8d69-ec32db3715b1 service nova] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bf292b15-dd88-4800-be4c-95d3c86e7269 req-61046673-2464-4500-8d69-ec32db3715b1 service nova] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-bf292b15-dd88-4800-be4c-95d3c86e7269 req-61046673-2464-4500-8d69-ec32db3715b1 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] No waiting events found dispatching network-vif-plugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:13:03 user nova-compute[75571]: WARNING nova.compute.manager [req-bf292b15-dd88-4800-be4c-95d3c86e7269 req-61046673-2464-4500-8d69-ec32db3715b1 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received unexpected event network-vif-plugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance with vm_state building and task_state spawning.
Nov 28 20:13:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-2ff0bd8e-532d-47b7-ab7a-ef78c9bde525 req-bc78cb9b-6ce6-4c59-bb32-fff4ee64cdf1 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Received event network-changed-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-2ff0bd8e-532d-47b7-ab7a-ef78c9bde525 req-bc78cb9b-6ce6-4c59-bb32-fff4ee64cdf1 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Refreshing instance network info cache due to event network-changed-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2ff0bd8e-532d-47b7-ab7a-ef78c9bde525 req-bc78cb9b-6ce6-4c59-bb32-fff4ee64cdf1 service nova] Acquiring lock "refresh_cache-fe726611-331a-495f-a6bd-ced2d1a305b2" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2ff0bd8e-532d-47b7-ab7a-ef78c9bde525 req-bc78cb9b-6ce6-4c59-bb32-fff4ee64cdf1 service nova] Acquired lock "refresh_cache-fe726611-331a-495f-a6bd-ced2d1a305b2" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG nova.network.neutron [req-2ff0bd8e-532d-47b7-ab7a-ef78c9bde525 req-bc78cb9b-6ce6-4c59-bb32-fff4ee64cdf1 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Refreshing network info cache for port 4ccfe8e6-0fe8-4546-8469-9c0634eaf74c {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:13:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Instance destroyed successfully.
Nov 28 20:13:04 user nova-compute[75571]: DEBUG nova.objects.instance [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lazy-loading 'resources' on Instance uuid 42d7a4d5-4d2a-4803-b253-b656aec16f69 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-89090598',display_name='tempest-DeleteServersTestJSON-server-89090598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-89090598',id=1,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a23adb107ea2450687260c6260f14a9e',ramdisk_id='',reservation_id='r-vsl50vbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-246706357',owner_user_name='tempest-DeleteServersTestJSON-246706357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:11:15Z,user_data=None,user_id='830afb679e5d46cca73c2ad15c3ae83b',uuid=42d7a4d5-4d2a-4803-b253-b656aec16f69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a382b348-9cff-4cf4-9651-4fd406284eca", "address": "fa:16:3e:e8:84:60", "network": {"id": "0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58030690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a23adb107ea2450687260c6260f14a9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa382b348-9c", "ovs_interfaceid": "a382b348-9cff-4cf4-9651-4fd406284eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Converting VIF {"id": "a382b348-9cff-4cf4-9651-4fd406284eca", "address": "fa:16:3e:e8:84:60", "network": {"id": "0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58030690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a23adb107ea2450687260c6260f14a9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa382b348-9c", "ovs_interfaceid": "a382b348-9cff-4cf4-9651-4fd406284eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:84:60,bridge_name='br-int',has_traffic_filtering=True,id=a382b348-9cff-4cf4-9651-4fd406284eca,network=Network(0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa382b348-9c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_vif [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:84:60,bridge_name='br-int',has_traffic_filtering=True,id=a382b348-9cff-4cf4-9651-4fd406284eca,network=Network(0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa382b348-9c') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa382b348-9c, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a2e8617-67ad-452b-933b-8bce8e6aea75) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:04 user nova-compute[75571]: INFO os_vif [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:84:60,bridge_name='br-int',has_traffic_filtering=True,id=a382b348-9cff-4cf4-9651-4fd406284eca,network=Network(0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa382b348-9c')
Nov 28 20:13:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwrTjybJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:04 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ff1d21-7fe6-4329-8040-e63e4b1bcb42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:13:04 user nova-compute[75571]: No targets found.
Nov 28 20:13:04 user nova-compute[75571]: iSNS:
Nov 28 20:13:04 user nova-compute[75571]: No targets found.
Nov 28 20:13:04 user nova-compute[75571]: STATIC:
Nov 28 20:13:04 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35
Nov 28 20:13:04 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:04 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:04 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5
Nov 28 20:13:04 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:04 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:04 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620
Nov 28 20:13:04 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:04 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:04 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3
Nov 28 20:13:04 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:04 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:04 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72
Nov 28 20:13:04 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:04 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:04 user nova-compute[75571]: FIRMWARE:
Nov 28 20:13:04 user nova-compute[75571]: No targets found.
Nov 28 20:13:04 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:13:04 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:13:04 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[881f42b8-ec93-4524-a7c6-5c5fca7af656]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa55bd5-3d67-4421-b6f2-10964e7f8be8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:04 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:04 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:04 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:04 user nova-compute[75571]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 (non-flash)
Nov 28 20:13:04 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:04 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:04 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:04 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:04 user nova-compute[75571]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 (non-flash)
Nov 28 20:13:04 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77687bbf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35'): ({'sdf'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Removing single pathed devices sdf {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2a2c06-d6e7-4e51-91d7-782cfe71e2e0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[44395be2-1ef2-44f9-8259-e30e9c51afa6]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Flushing IO for device /dev/sdf {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[739662fe-571b-4e99-aa0d-b42ed11bbde7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c885bfa4-0f5d-4a68-8c11-30b8e4f5337e]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] SCSI volumes sdf have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f56b1fd-9535-4c82-aa37-03a028e3f6b8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d056e055-0d4d-4fe3-9d2e-b2f02c263b75]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35, portal: 172.16.0.220,3260]
Nov 28 20:13:04 user nova-compute[75571]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35, portal: 172.16.0.220,3260] successful.
Nov 28 20:13:04 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG nova.network.neutron [req-2ff0bd8e-532d-47b7-ab7a-ef78c9bde525 req-bc78cb9b-6ce6-4c59-bb32-fff4ee64cdf1 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Updated VIF entry in instance network info cache for port 4ccfe8e6-0fe8-4546-8469-9c0634eaf74c. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG nova.network.neutron [req-2ff0bd8e-532d-47b7-ab7a-ef78c9bde525 req-bc78cb9b-6ce6-4c59-bb32-fff4ee64cdf1 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Updating instance_info_cache with network_info: [{"id": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "address": "fa:16:3e:e6:89:ea", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccfe8e6-0f", "ovs_interfaceid": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2ff0bd8e-532d-47b7-ab7a-ef78c9bde525 req-bc78cb9b-6ce6-4c59-bb32-fff4ee64cdf1 service nova] Releasing lock "refresh_cache-fe726611-331a-495f-a6bd-ced2d1a305b2" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5bf0ecc-30b8-40c5-b56b-1a41db2efe35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3cfb4e-35a7-42fb-b687-e676a38b3a22]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] <== disconnect_volume: return (449ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:13:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Deleting instance files /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69_del
Nov 28 20:13:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Deletion of /opt/stack/data/nova/instances/42d7a4d5-4d2a-4803-b253-b656aec16f69_del complete
Nov 28 20:13:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75571) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 28 20:13:04 user nova-compute[75571]: INFO nova.virt.libvirt.host [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] UEFI support detected
Nov 28 20:13:04 user nova-compute[75571]: INFO nova.compute.manager [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Took 1.71 seconds to destroy the instance on the hypervisor.
Nov 28 20:13:04 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:13:04 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:13:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-3d07fe83-82fd-4c4e-9111-ab931fc42445 req-5700f6b6-29f3-48e3-a97e-b499a4d22b51 service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Received event network-vif-plugged-a382b348-9cff-4cf4-9651-4fd406284eca {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3d07fe83-82fd-4c4e-9111-ab931fc42445 req-5700f6b6-29f3-48e3-a97e-b499a4d22b51 service nova] Acquiring lock "42d7a4d5-4d2a-4803-b253-b656aec16f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3d07fe83-82fd-4c4e-9111-ab931fc42445 req-5700f6b6-29f3-48e3-a97e-b499a4d22b51 service nova] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3d07fe83-82fd-4c4e-9111-ab931fc42445 req-5700f6b6-29f3-48e3-a97e-b499a4d22b51 service nova] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-3d07fe83-82fd-4c4e-9111-ab931fc42445 req-5700f6b6-29f3-48e3-a97e-b499a4d22b51 service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] No waiting events found dispatching network-vif-plugged-a382b348-9cff-4cf4-9651-4fd406284eca {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:13:05 user nova-compute[75571]: WARNING nova.compute.manager [req-3d07fe83-82fd-4c4e-9111-ab931fc42445 req-5700f6b6-29f3-48e3-a97e-b499a4d22b51 service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Received unexpected event network-vif-plugged-a382b348-9cff-4cf4-9651-4fd406284eca for instance with vm_state active and task_state deleting.
Nov 28 20:13:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-f7756d5e-b09c-4715-aae0-d76e17c51c92 req-1f1f3ec2-acdc-405f-879c-c5f405af4b33 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received event network-vif-plugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f7756d5e-b09c-4715-aae0-d76e17c51c92 req-1f1f3ec2-acdc-405f-879c-c5f405af4b33 service nova] Acquiring lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f7756d5e-b09c-4715-aae0-d76e17c51c92 req-1f1f3ec2-acdc-405f-879c-c5f405af4b33 service nova] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f7756d5e-b09c-4715-aae0-d76e17c51c92 req-1f1f3ec2-acdc-405f-879c-c5f405af4b33 service nova] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-f7756d5e-b09c-4715-aae0-d76e17c51c92 req-1f1f3ec2-acdc-405f-879c-c5f405af4b33 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] No waiting events found dispatching network-vif-plugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:13:05 user nova-compute[75571]: WARNING nova.compute.manager [req-f7756d5e-b09c-4715-aae0-d76e17c51c92 req-1f1f3ec2-acdc-405f-879c-c5f405af4b33 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received unexpected event network-vif-plugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance with vm_state building and task_state spawning.
Nov 28 20:13:05 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:13:05 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Took 1.09 seconds to deallocate network for instance.
Nov 28 20:13:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-f3742df5-4be5-414a-be2a-6b16aace03ee req-0cc0ff7b-bf94-4cca-9ba6-d7209ceef4ea service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Received event network-changed-0fd6ab13-839a-4071-a3d1-60b901aea40f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-f3742df5-4be5-414a-be2a-6b16aace03ee req-0cc0ff7b-bf94-4cca-9ba6-d7209ceef4ea service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Refreshing instance network info cache due to event network-changed-0fd6ab13-839a-4071-a3d1-60b901aea40f. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:13:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f3742df5-4be5-414a-be2a-6b16aace03ee req-0cc0ff7b-bf94-4cca-9ba6-d7209ceef4ea service nova] Acquiring lock "refresh_cache-958252cc-398e-4cc6-bd8d-937c99ef2b70" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:13:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f3742df5-4be5-414a-be2a-6b16aace03ee req-0cc0ff7b-bf94-4cca-9ba6-d7209ceef4ea service nova] Acquired lock "refresh_cache-958252cc-398e-4cc6-bd8d-937c99ef2b70" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:13:06 user nova-compute[75571]: DEBUG nova.network.neutron [req-f3742df5-4be5-414a-be2a-6b16aace03ee req-0cc0ff7b-bf94-4cca-9ba6-d7209ceef4ea service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Refreshing network info cache for port 0fd6ab13-839a-4071-a3d1-60b901aea40f {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:13:06 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:13:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:13:06 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Instance spawned successfully.
Nov 28 20:13:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:13:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:13:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:13:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:13:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:13:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:13:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:13:06 user nova-compute[75571]: INFO nova.compute.manager [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Took 7.00 seconds to spawn the instance on the hypervisor.
Nov 28 20:13:06 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:13:06 user nova-compute[75571]: DEBUG nova.network.neutron [req-f3742df5-4be5-414a-be2a-6b16aace03ee req-0cc0ff7b-bf94-4cca-9ba6-d7209ceef4ea service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Updated VIF entry in instance network info cache for port 0fd6ab13-839a-4071-a3d1-60b901aea40f. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:13:06 user nova-compute[75571]: DEBUG nova.network.neutron [req-f3742df5-4be5-414a-be2a-6b16aace03ee req-0cc0ff7b-bf94-4cca-9ba6-d7209ceef4ea service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Updating instance_info_cache with network_info: [{"id": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "address": "fa:16:3e:7b:92:e2", "network": {"id": "b64cd5b4-e6ba-413d-839a-465e577eebb4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1905929996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4b4be41b8c4b2d83a6ea935a176a7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd6ab13-83", "ovs_interfaceid": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:13:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f3742df5-4be5-414a-be2a-6b16aace03ee req-0cc0ff7b-bf94-4cca-9ba6-d7209ceef4ea service nova] Releasing lock "refresh_cache-958252cc-398e-4cc6-bd8d-937c99ef2b70" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:13:06 user nova-compute[75571]: INFO nova.compute.manager [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Took 8.07 seconds to build instance.
Nov 28 20:13:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.174s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-66ec1e8e-241f-4e78-a37b-83516c64878f req-e4bfff78-7cee-4794-b0fc-e750a2703d68 service nova] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Received event network-vif-deleted-a382b348-9cff-4cf4-9651-4fd406284eca {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "fe726611-331a-495f-a6bd-ced2d1a305b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:07 user nova-compute[75571]: DEBUG nova.objects.instance [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lazy-loading 'flavor' on Instance uuid fe726611-331a-495f-a6bd-ced2d1a305b2 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "fe726611-331a-495f-a6bd-ced2d1a305b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:08 user nova-compute[75571]: INFO nova.compute.manager [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Attaching volume cf35ee65-861a-4cfd-9e94-fc02d8f0f180 to /dev/vdb
Nov 28 20:13:08 user nova-compute[75571]: DEBUG os_brick.utils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af1177e-2aa4-452e-9966-d32ac82cba2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8869f08f-ed05-4db0-b283-9b3c91baa313]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[18437eb0-a915-401e-86db-f95e88b5e356]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb9791a-d1ea-4f0d-9c84-cb737930ddf2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:13:08 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcd3ce6-32e5-4ae3-ad81-225a1661ce79]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG os_brick.utils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Updating existing volume attachment record: c13486d8-3e2a-467f-b70c-b6b8c8f7240c {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:13:08 user nova-compute[75571]: INFO nova.compute.manager [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Took 2.85 seconds to detach 1 volumes for instance.
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:09 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:13:09 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:13:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:09 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Deleted allocations for instance 42d7a4d5-4d2a-4803-b253-b656aec16f69
Nov 28 20:13:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "958252cc-398e-4cc6-bd8d-937c99ef2b70" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:09 user nova-compute[75571]: DEBUG nova.objects.instance [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lazy-loading 'flavor' on Instance uuid 958252cc-398e-4cc6-bd8d-937c99ef2b70 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "42d7a4d5-4d2a-4803-b253-b656aec16f69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.464s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "958252cc-398e-4cc6-bd8d-937c99ef2b70" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:09 user nova-compute[75571]: INFO nova.compute.manager [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Attaching volume 4a30bcfd-1fe1-40b4-b548-de392d8adc21 to /dev/sdc
Nov 28 20:13:09 user nova-compute[75571]: DEBUG os_brick.utils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5223183-5940-4fc0-b4e6-447b82891b8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea0bd88-deae-49b6-9a0a-8b7e65458932]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ac5246-550e-41c6-9abb-f7b4feb89b29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab156f1-849f-47c4-abd0-9e74fdff3d63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:13:10 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:13:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0682111-72c0-4dc3-be93-f0cca3e8ee12]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG os_brick.utils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:10 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Updating existing volume attachment record: 0139aaee-6242-40b9-9e3a-eca39c825527 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:13:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-ec3f7674-a4a1-4bf0-8fc2-311f3cbc6549 req-9ada2a2f-5f58-4fa9-8869-f300ea45ee45 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Received event network-changed-6ec42ed1-ea9b-462e-b695-22222a022c1d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-ec3f7674-a4a1-4bf0-8fc2-311f3cbc6549 req-9ada2a2f-5f58-4fa9-8869-f300ea45ee45 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Refreshing instance network info cache due to event network-changed-6ec42ed1-ea9b-462e-b695-22222a022c1d. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ec3f7674-a4a1-4bf0-8fc2-311f3cbc6549 req-9ada2a2f-5f58-4fa9-8869-f300ea45ee45 service nova] Acquiring lock "refresh_cache-a3084b80-68e5-44f6-b87d-4f7ad6b31756" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ec3f7674-a4a1-4bf0-8fc2-311f3cbc6549 req-9ada2a2f-5f58-4fa9-8869-f300ea45ee45 service nova] Acquired lock "refresh_cache-a3084b80-68e5-44f6-b87d-4f7ad6b31756" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG nova.network.neutron [req-ec3f7674-a4a1-4bf0-8fc2-311f3cbc6549 req-9ada2a2f-5f58-4fa9-8869-f300ea45ee45 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Refreshing network info cache for port 6ec42ed1-ea9b-462e-b695-22222a022c1d {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG nova.objects.instance [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lazy-loading 'flavor' on Instance uuid a3084b80-68e5-44f6-b87d-4f7ad6b31756 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:15 user nova-compute[75571]: INFO nova.compute.manager [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Attaching volume d1537a8f-618a-4dc3-aa95-77f77a33e2fb to /dev/vdb
Nov 28 20:13:15 user nova-compute[75571]: DEBUG nova.network.neutron [req-ec3f7674-a4a1-4bf0-8fc2-311f3cbc6549 req-9ada2a2f-5f58-4fa9-8869-f300ea45ee45 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Updated VIF entry in instance network info cache for port 6ec42ed1-ea9b-462e-b695-22222a022c1d. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG nova.network.neutron [req-ec3f7674-a4a1-4bf0-8fc2-311f3cbc6549 req-9ada2a2f-5f58-4fa9-8869-f300ea45ee45 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Updating instance_info_cache with network_info: [{"id": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "address": "fa:16:3e:a2:d7:f5", "network": {"id": "3c7d9d10-c298-4672-8ae8-c59553384435", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1579611606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f356c386b1804c90ad27fd57bf6961ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec42ed1-ea", "ovs_interfaceid": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ec3f7674-a4a1-4bf0-8fc2-311f3cbc6549 req-9ada2a2f-5f58-4fa9-8869-f300ea45ee45 service nova] Releasing lock "refresh_cache-a3084b80-68e5-44f6-b87d-4f7ad6b31756" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG os_brick.utils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9f2558-3336-449d-93da-1dbdeb123164]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bdc71c-e120-4de1-986a-62c7fc1d5252]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b749c0-df3b-4178-83b5-0330fc6124ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[687636cd-8a6b-43c4-8fac-07c1397a1c9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:13:15 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:13:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[674833d8-f789-4732-a9e0-230112248297]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG os_brick.utils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:15 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Updating existing volume attachment record: 75c6f551-ac87-440f-b9f5-b017729a7ce8 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:13:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUvJwBDn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:23 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:23 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:23 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ec9954-6edc-4f65-bf05-c007d5307c56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:13:23 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7606d4cd-277a-4bea-9456-581448cab55c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb] added
Nov 28 20:13:23 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad6eb4a-1031-48f2-9818-35aceafba11e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e53ed8-e09a-4425-ba83-b44e4dd663cd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUvJwBDn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUvJwBDn" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca42b83a-4eb0-497c-aa4b-6e4c6782f03a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qUvJwBDn'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[61671fba-3973-48e5-856f-f066d25a51a1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea56f272-b36d-42e5-abbd-7cd98372aaf2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHXVeklL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:23 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyDElkQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:23 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d70de8-efff-48b6-a649-f8aa2521b04d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260]
Nov 28 20:13:23 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260] successful.
Nov 28 20:13:23 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b931c5a3-8896-4e8c-a9da-f210da7b54b3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ea1cd5-44d3-4cbb-80de-26889bb8b08e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:23 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:23 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:23 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce5194d-5a95-4146-ad67-5165939cc234]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:13:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUvJwBDn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23436666562346466', 'path': '/dev/sdf'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436666562346466', 'path': '/dev/sdf'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.113s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:24 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:24 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG nova.objects.instance [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lazy-loading 'flavor' on Instance uuid a3084b80-68e5-44f6-b87d-4f7ad6b31756 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[446e2b45-e95b-47c5-af36-28f8f9c6ac69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:13:24 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e984caa6-08ac-4fdb-8d33-643970624f34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180] added
Nov 28 20:13:24 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:13:24 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:13:24 user nova-compute[75571]:   <source dev="/dev/sdf"/>
Nov 28 20:13:24 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:13:24 user nova-compute[75571]:   <serial>d1537a8f-618a-4dc3-aa95-77f77a33e2fb</serial>
Nov 28 20:13:24 user nova-compute[75571]: </disk>
Nov 28 20:13:24 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc703ef-e7d7-482c-b110-242b3c395ffa]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[918cfbd0-a563-459e-9fee-d96e849f2fcf]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RHXVeklL {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RHXVeklL" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[da403e09-dd3f-4b04-ae48-61ed017b8f8d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RHXVeklL'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b425cc-6af5-4241-83dd-9141d413f108]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5914149-e77e-4329-8de9-c9760a061ccc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:24 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:24 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:24 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:24 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:24 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:24 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:24 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:24 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:24 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:24 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c16c9d-ce37-459c-9475-8a3d0962ef6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180, portal: 172.16.0.220,3260]
Nov 28 20:13:25 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180, portal: 172.16.0.220,3260] successful.
Nov 28 20:13:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d40a37-94cf-48d4-a0a5-8af356233831]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01a3341-f3f7-4fd0-8d42-ca3ac73c3f80]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:25 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:25 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:25 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:25 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:25 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:25 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:25 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:25 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:25 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:25 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bc0a14-8843-40b9-b541-ee1ad9e6a503]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHXVeklL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] No VIF found with MAC fa:16:3e:a2:d7:f5, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:13:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.700s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] <== connect_volume: return (2440ms) {'type': 'block', 'scsi_wwn': '26137343431636630', 'path': '/dev/sdg'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137343431636630', 'path': '/dev/sdg'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.417s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:26 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:26 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG nova.objects.instance [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lazy-loading 'flavor' on Instance uuid fe726611-331a-495f-a6bd-ced2d1a305b2 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[446b3af3-aa8d-4dbf-9abd-9de120f1a479]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:13:26 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:13:26 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:13:26 user nova-compute[75571]:   <source dev="/dev/sdg"/>
Nov 28 20:13:26 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:13:26 user nova-compute[75571]:   <serial>cf35ee65-861a-4cfd-9e94-fc02d8f0f180</serial>
Nov 28 20:13:26 user nova-compute[75571]: </disk>
Nov 28 20:13:26 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e70b65-f30f-4717-a3a3-8341f04e32f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21] added
Nov 28 20:13:26 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1bdb92-9d74-42a3-8698-e0f14f85ae9c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Acquiring lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.utils [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf59193a-d7ee-4468-a244-d2fddd722615]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jyDElkQe {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cccd18-8e08-4e3d-97de-0017dbcf8137]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jyDElkQe" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[968f5dbd-90fa-4817-81c9-45f5bfb520db]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jyDElkQe'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b10f89a-f2b5-421f-ac36-73fd62f3849d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed014b2-3964-4852-a3c3-45a303ab62ae]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5c5e36-6a05-4673-972a-1e5e0287cce2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[57810d6a-1b16-4e8b-941c-8034db7c2ea4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e48c748-222f-4924-9093-181cc7ffc627]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:13:26 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a5d98a-795c-451d-bf26-708996e95410]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.utils [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48bd704-9530-428b-8e3c-8eea44f64251]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21, portal: 172.16.0.220,3260]
Nov 28 20:13:26 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21, portal: 172.16.0.220,3260] successful.
Nov 28 20:13:26 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9990f86b-62f2-4515-b398-482eaee8f75a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[61880b6b-91ee-47b9-b70a-a8a760f19b5e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:26 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:13:26 user nova-compute[75571]: INFO nova.compute.manager [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Swapping volume d1537a8f-618a-4dc3-aa95-77f77a33e2fb for 38d594ec-446e-4a19-a5ae-9371a985e1b0
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb59d69-c587-4906-a666-02694f14f231]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyDElkQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] No VIF found with MAC fa:16:3e:e6:89:ea, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:13:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.365s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] <== connect_volume: return (3799ms) {'type': 'block', 'scsi_wwn': '26436393330383234', 'path': '/dev/sdh'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436393330383234', 'path': '/dev/sdh'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:13:27 user nova-compute[75571]: DEBUG nova.objects.instance [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lazy-loading 'flavor' on Instance uuid 958252cc-398e-4cc6-bd8d-937c99ef2b70 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:13:27 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:13:27 user nova-compute[75571]:   <source dev="/dev/sdh"/>
Nov 28 20:13:27 user nova-compute[75571]:   <target dev="sdc" bus="scsi"/>
Nov 28 20:13:27 user nova-compute[75571]:   <serial>4a30bcfd-1fe1-40b4-b548-de392d8adc21</serial>
Nov 28 20:13:27 user nova-compute[75571]:   <address type="drive" controller="0" unit="2"/>
Nov 28 20:13:27 user nova-compute[75571]: </disk>
Nov 28 20:13:27 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] No BDM found with device name sda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] No VIF found with MAC fa:16:3e:7b:92:e2, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.359s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-cee08032-f517-4e2c-929f-e9aeccb3f10c req-0220a04e-e0b8-4f3d-a01c-1ba293b6e70f service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Received event network-changed-317f4a0e-b709-4696-9a61-0c8067789331 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-cee08032-f517-4e2c-929f-e9aeccb3f10c req-0220a04e-e0b8-4f3d-a01c-1ba293b6e70f service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Refreshing instance network info cache due to event network-changed-317f4a0e-b709-4696-9a61-0c8067789331. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cee08032-f517-4e2c-929f-e9aeccb3f10c req-0220a04e-e0b8-4f3d-a01c-1ba293b6e70f service nova] Acquiring lock "refresh_cache-415392e8-bf6c-433e-a4f5-be3d99419710" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cee08032-f517-4e2c-929f-e9aeccb3f10c req-0220a04e-e0b8-4f3d-a01c-1ba293b6e70f service nova] Acquired lock "refresh_cache-415392e8-bf6c-433e-a4f5-be3d99419710" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG nova.network.neutron [req-cee08032-f517-4e2c-929f-e9aeccb3f10c req-0220a04e-e0b8-4f3d-a01c-1ba293b6e70f service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Refreshing network info cache for port 317f4a0e-b709-4696-9a61-0c8067789331 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "fe726611-331a-495f-a6bd-ced2d1a305b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:28 user nova-compute[75571]: INFO nova.compute.manager [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Detaching volume cf35ee65-861a-4cfd-9e94-fc02d8f0f180
Nov 28 20:13:28 user nova-compute[75571]: INFO nova.virt.block_device [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Attempting to driver detach volume cf35ee65-861a-4cfd-9e94-fc02d8f0f180 from mountpoint /dev/vdb
Nov 28 20:13:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Attempting to detach device vdb from instance fe726611-331a-495f-a6bd-ced2d1a305b2 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:13:28 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:13:28 user nova-compute[75571]:   <source dev="/dev/sdg"/>
Nov 28 20:13:28 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:13:28 user nova-compute[75571]:   <serial>cf35ee65-861a-4cfd-9e94-fc02d8f0f180</serial>
Nov 28 20:13:28 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:13:28 user nova-compute[75571]: </disk>
Nov 28 20:13:28 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:13:28 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Successfully detached device vdb from instance fe726611-331a-495f-a6bd-ced2d1a305b2 from the persistent domain config.
Nov 28 20:13:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe726611-331a-495f-a6bd-ced2d1a305b2 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:13:28 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:13:28 user nova-compute[75571]:   <source dev="/dev/sdg"/>
Nov 28 20:13:28 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:13:28 user nova-compute[75571]:   <serial>cf35ee65-861a-4cfd-9e94-fc02d8f0f180</serial>
Nov 28 20:13:28 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:13:28 user nova-compute[75571]: </disk>
Nov 28 20:13:28 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Acquiring lock "415392e8-bf6c-433e-a4f5-be3d99419710" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "415392e8-bf6c-433e-a4f5-be3d99419710" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG nova.objects.instance [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lazy-loading 'flavor' on Instance uuid 415392e8-bf6c-433e-a4f5-be3d99419710 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "415392e8-bf6c-433e-a4f5-be3d99419710" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Acquiring lock "415392e8-bf6c-433e-a4f5-be3d99419710" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "415392e8-bf6c-433e-a4f5-be3d99419710" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:29 user nova-compute[75571]: INFO nova.compute.manager [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Attaching volume 9a88cdcb-c692-441b-90ca-dd777b566a4d to /dev/vdb
Nov 28 20:13:29 user nova-compute[75571]: DEBUG nova.network.neutron [req-cee08032-f517-4e2c-929f-e9aeccb3f10c req-0220a04e-e0b8-4f3d-a01c-1ba293b6e70f service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Updated VIF entry in instance network info cache for port 317f4a0e-b709-4696-9a61-0c8067789331. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG nova.network.neutron [req-cee08032-f517-4e2c-929f-e9aeccb3f10c req-0220a04e-e0b8-4f3d-a01c-1ba293b6e70f service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Updating instance_info_cache with network_info: [{"id": "317f4a0e-b709-4696-9a61-0c8067789331", "address": "fa:16:3e:d0:dd:5e", "network": {"id": "af31f11d-7ec4-4cc7-b346-0acf29157d15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-444410556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b1448d67fd4c94a0d1374ed792b428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f4a0e-b7", "ovs_interfaceid": "317f4a0e-b709-4696-9a61-0c8067789331", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cee08032-f517-4e2c-929f-e9aeccb3f10c req-0220a04e-e0b8-4f3d-a01c-1ba293b6e70f service nova] Releasing lock "refresh_cache-415392e8-bf6c-433e-a4f5-be3d99419710" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe726611-331a-495f-a6bd-ced2d1a305b2 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG os_brick.utils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceecfce-bfc3-430b-9675-ae1ba38c17cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b242d9c3-6d38-4f23-9840-b42a5b7a22d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f79dec-b40e-498f-89f7-aa51ad48edce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[245f7201-294b-437b-9d87-89509f2a57c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:13:29 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dbde2b-ba23-458c-9279-a3a553af84bd]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG os_brick.utils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Updating existing volume attachment record: a84f5e62-bd19-4160-8456-d92ba85ea84c {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "958252cc-398e-4cc6-bd8d-937c99ef2b70" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:29 user nova-compute[75571]: INFO nova.compute.manager [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Detaching volume 4a30bcfd-1fe1-40b4-b548-de392d8adc21
Nov 28 20:13:29 user nova-compute[75571]: INFO nova.virt.block_device [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Attempting to driver detach volume 4a30bcfd-1fe1-40b4-b548-de392d8adc21 from mountpoint /dev/sdc
Nov 28 20:13:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Attempting to detach device sdc from instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:13:29 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:13:29 user nova-compute[75571]:   <source dev="/dev/sdh"/>
Nov 28 20:13:29 user nova-compute[75571]:   <target dev="sdc" bus="scsi"/>
Nov 28 20:13:29 user nova-compute[75571]:   <serial>4a30bcfd-1fe1-40b4-b548-de392d8adc21</serial>
Nov 28 20:13:29 user nova-compute[75571]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 20:13:29 user nova-compute[75571]: </disk>
Nov 28 20:13:29 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:13:29 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Successfully detached device sdc from instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 from the persistent domain config.
Nov 28 20:13:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:13:29 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:13:29 user nova-compute[75571]:   <source dev="/dev/sdh"/>
Nov 28 20:13:29 user nova-compute[75571]:   <target dev="sdc" bus="scsi"/>
Nov 28 20:13:29 user nova-compute[75571]:   <serial>4a30bcfd-1fe1-40b4-b548-de392d8adc21</serial>
Nov 28 20:13:29 user nova-compute[75571]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 20:13:29 user nova-compute[75571]: </disk>
Nov 28 20:13:29 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:13:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:13:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-965c233d-c1fe-4343-bf7e-9a39c38a21d6 req-08fd5777-930a-4fdc-a69b-52e8a517ece8 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received event network-changed-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-965c233d-c1fe-4343-bf7e-9a39c38a21d6 req-08fd5777-930a-4fdc-a69b-52e8a517ece8 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Refreshing instance network info cache due to event network-changed-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:13:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-965c233d-c1fe-4343-bf7e-9a39c38a21d6 req-08fd5777-930a-4fdc-a69b-52e8a517ece8 service nova] Acquiring lock "refresh_cache-59a360a3-bce3-4673-b79e-cd0460d2a69a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:13:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-965c233d-c1fe-4343-bf7e-9a39c38a21d6 req-08fd5777-930a-4fdc-a69b-52e8a517ece8 service nova] Acquired lock "refresh_cache-59a360a3-bce3-4673-b79e-cd0460d2a69a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:13:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-965c233d-c1fe-4343-bf7e-9a39c38a21d6 req-08fd5777-930a-4fdc-a69b-52e8a517ece8 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Refreshing network info cache for port d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG nova.network.neutron [req-965c233d-c1fe-4343-bf7e-9a39c38a21d6 req-08fd5777-930a-4fdc-a69b-52e8a517ece8 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Updated VIF entry in instance network info cache for port d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG nova.network.neutron [req-965c233d-c1fe-4343-bf7e-9a39c38a21d6 req-08fd5777-930a-4fdc-a69b-52e8a517ece8 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Updating instance_info_cache with network_info: [{"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-965c233d-c1fe-4343-bf7e-9a39c38a21d6 req-08fd5777-930a-4fdc-a69b-52e8a517ece8 service nova] Releasing lock "refresh_cache-59a360a3-bce3-4673-b79e-cd0460d2a69a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwVriKBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3084b80-68e5-44f6-b87d-4f7ad6b31756', 'attached_at': '', 'detached_at': '', 'volume_id': '38d594ec-446e-4a19-a5ae-9371a985e1b0', 'serial': '38d594ec-446e-4a19-a5ae-9371a985e1b0'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUvJwBDn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'a3084b80-68e5-44f6-b87d-4f7ad6b31756', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1537a8f-618a-4dc3-aa95-77f77a33e2fb', 'serial'} {{(pid=75571) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwVriKBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:34 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:34 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:34 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a245f4c-60fa-4a39-86d4-29dc3f61d454]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:13:34 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e80ac3-d620-40be-984e-c57247976668]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0] added
Nov 28 20:13:34 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[828a7497-287b-4664-a406-28d15a52b49c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:34 user nova-compute[75571]: INFO nova.compute.manager [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Rebuilding instance
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09256a4-e6bd-480b-9f7f-475748270bca]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwVriKBE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwVriKBE" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92cb3ce-95be-4310-b94d-a69f4a8ef3ad]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jwVriKBE'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[63000dd1-a6ec-460f-ad91-13df95f76efd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG nova.compute.manager [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[27968317-5b1a-4888-ac67-6cfdf40d9659]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:34 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:34 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:34 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:34 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:34 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:34 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:34 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:34 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:34 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:34 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:34 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:34 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:34 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:34 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8f92f8-68b8-4150-be2e-d5c32f77963b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0, portal: 172.16.0.220,3260]
Nov 28 20:13:34 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0, portal: 172.16.0.220,3260] successful.
Nov 28 20:13:34 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccafb58-3bf4-49f6-bdf9-4cd8c9b3e5ad]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfe3cad-4177-429e-9573-bf92e784a797]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:35 user nova-compute[75571]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:35 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:35 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:35 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:35 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:35 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:35 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:35 user nova-compute[75571]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:35 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:35 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:35 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:35 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:35 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:35 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bee7f78-1567-4eb5-8047-3238844acad3]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwVriKBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-cc6469e8-bc2e-4c9f-b5ce-4631970f84e5 req-a0960327-1dd7-46ad-8292-54bffde09ca6 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received event network-vif-unplugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cc6469e8-bc2e-4c9f-b5ce-4631970f84e5 req-a0960327-1dd7-46ad-8292-54bffde09ca6 service nova] Acquiring lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cc6469e8-bc2e-4c9f-b5ce-4631970f84e5 req-a0960327-1dd7-46ad-8292-54bffde09ca6 service nova] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cc6469e8-bc2e-4c9f-b5ce-4631970f84e5 req-a0960327-1dd7-46ad-8292-54bffde09ca6 service nova] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-cc6469e8-bc2e-4c9f-b5ce-4631970f84e5 req-a0960327-1dd7-46ad-8292-54bffde09ca6 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] No waiting events found dispatching network-vif-unplugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:13:35 user nova-compute[75571]: WARNING nova.compute.manager [req-cc6469e8-bc2e-4c9f-b5ce-4631970f84e5 req-a0960327-1dd7-46ad-8292-54bffde09ca6 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received unexpected event network-vif-unplugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c for instance with vm_state active and task_state rebuilding.
Nov 28 20:13:35 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Instance destroyed successfully.
Nov 28 20:13:35 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Instance destroyed successfully.
Nov 28 20:13:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1642565132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-875799677',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6AuAWbbxZ0a6c7k1XS3X9t+pB3TAuStJooLKz16kYFR2aaVuQipo+CXoACBi2Birf2Rm15MEr9uQoGxphTgBDTn1HrWp9mOU4ZppNU69KCYDLZF6bXiACp5QJvGeeHcw==',key_name='tempest-keypair-1302784070',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:12:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fed1996731e94c8eb5c16e6327b32f39',ramdisk_id='',reservation_id='r-lg4xji60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-323010200',owner_user_name='tempest-ServerActionsV293TestJSON-323010200-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:13:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d313e776858a411ea463adecd1f36819',uuid=59a360a3-bce3-4673-b79e-cd0460d2a69a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Converting VIF {"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:9b:4a,bridge_name='br-int',has_traffic_filtering=True,id=d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c,network=Network(8b0c6ae3-604b-433f-920b-f28cc17a9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1934d1e-ff') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG os_vif [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:9b:4a,bridge_name='br-int',has_traffic_filtering=True,id=d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c,network=Network(8b0c6ae3-604b-433f-920b-f28cc17a9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1934d1e-ff') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1934d1e-ff, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f51604a4-ebe9-4873-a01c-76d9451fa1fb) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:35 user nova-compute[75571]: INFO os_vif [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:9b:4a,bridge_name='br-int',has_traffic_filtering=True,id=d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c,network=Network(8b0c6ae3-604b-433f-920b-f28cc17a9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1934d1e-ff')
Nov 28 20:13:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:13:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLvfdWST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:35 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 20:13:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23932616633386335', 'path': '/dev/sdi'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932616633386335', 'path': '/dev/sdi'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.360s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG nova.objects.instance [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lazy-loading 'flavor' on Instance uuid a3084b80-68e5-44f6-b87d-4f7ad6b31756 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ff0904-f445-473a-999b-8b2039250189]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:13:36 user nova-compute[75571]: No targets found.
Nov 28 20:13:36 user nova-compute[75571]: iSNS:
Nov 28 20:13:36 user nova-compute[75571]: No targets found.
Nov 28 20:13:36 user nova-compute[75571]: STATIC:
Nov 28 20:13:36 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5
Nov 28 20:13:36 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:36 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:36 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620
Nov 28 20:13:36 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:36 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:36 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb
Nov 28 20:13:36 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:36 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:36 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180
Nov 28 20:13:36 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:36 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:36 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21
Nov 28 20:13:36 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:36 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:36 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0
Nov 28 20:13:36 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:36 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:36 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3
Nov 28 20:13:36 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:36 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:36 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72
Nov 28 20:13:36 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:36 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:36 user nova-compute[75571]: FIRMWARE:
Nov 28 20:13:36 user nova-compute[75571]: No targets found.
Nov 28 20:13:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:13:36 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:13:36 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[152cdd8d-ebd0-409e-937a-fed388e6e543]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[48208c36-bae5-4aa2-8800-864b9c77349f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7778291480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca5832b-91e1-4ebb-986d-d511b13d55cb]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9841ba7-0c6e-4e95-a2f5-50a49269068d]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1bd13b-76f0-47db-822b-68e5fb71ace3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38f8daa-560b-4271-846e-8711b7628397]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84cd187-f810-4407-ba32-3b8c7b6161c9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ff8926-ed3b-4eb1-ab35-5cc8bb16e58c]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260]
Nov 28 20:13:36 user nova-compute[75571]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260] successful.
Nov 28 20:13:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd75a6e-2403-4b7c-8306-38f011786016]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] <== disconnect_volume: return (735ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:13:36 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Deleting instance files /opt/stack/data/nova/instances/59a360a3-bce3-4673-b79e-cd0460d2a69a_del
Nov 28 20:13:36 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Deletion of /opt/stack/data/nova/instances/59a360a3-bce3-4673-b79e-cd0460d2a69a_del complete
Nov 28 20:13:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:36 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 59a360a3-bce3-4673-b79e-cd0460d2a69a could not be found.
Nov 28 20:13:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLvfdWST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:36 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9b5a6b-4cc9-452e-925c-2c5e8f5d5560]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:13:36 user nova-compute[75571]: No targets found.
Nov 28 20:13:36 user nova-compute[75571]: iSNS:
Nov 28 20:13:36 user nova-compute[75571]: No targets found.
Nov 28 20:13:36 user nova-compute[75571]: STATIC:
Nov 28 20:13:36 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5
Nov 28 20:13:36 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:36 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:36 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620
Nov 28 20:13:36 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:36 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:36 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb
Nov 28 20:13:36 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:36 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:36 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180
Nov 28 20:13:36 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:36 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:36 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21
Nov 28 20:13:36 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:36 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:36 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0
Nov 28 20:13:36 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:36 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:36 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3
Nov 28 20:13:36 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:36 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:36 user nova-compute[75571]: FIRMWARE:
Nov 28 20:13:36 user nova-compute[75571]: No targets found.
Nov 28 20:13:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:13:36 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:13:36 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1592da35-9df4-4ca9-9a92-9903297c9964]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2609615-879c-45fc-813b-dece13866b07]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77782924d0>, {}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Disconnecting from: [] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.099s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] <== disconnect_volume: return (101ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:13:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 48234496 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-fe5aa81a-1775-4348-b703-58e4707f97da req-184a7dc7-cb31-4a65-8edd-981ff9cea704 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received event network-vif-plugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fe5aa81a-1775-4348-b703-58e4707f97da req-184a7dc7-cb31-4a65-8edd-981ff9cea704 service nova] Acquiring lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fe5aa81a-1775-4348-b703-58e4707f97da req-184a7dc7-cb31-4a65-8edd-981ff9cea704 service nova] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fe5aa81a-1775-4348-b703-58e4707f97da req-184a7dc7-cb31-4a65-8edd-981ff9cea704 service nova] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-fe5aa81a-1775-4348-b703-58e4707f97da req-184a7dc7-cb31-4a65-8edd-981ff9cea704 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] No waiting events found dispatching network-vif-plugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:13:37 user nova-compute[75571]: WARNING nova.compute.manager [req-fe5aa81a-1775-4348-b703-58e4707f97da req-184a7dc7-cb31-4a65-8edd-981ff9cea704 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received unexpected event network-vif-plugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c for instance with vm_state active and task_state rebuilding.
Nov 28 20:13:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaDwpNPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:37 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:37 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:37 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 207618048 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d6670a-a3ca-4cdd-b146-6517d21e2c50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:13:37 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a066f647-e132-4b9b-8e21-519f94951284]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d] added
Nov 28 20:13:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75094af-0df8-472d-b903-8e4e3f3c53dd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[979b22aa-2bb5-42fb-bdbe-999c1d52b4bd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oaDwpNPn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oaDwpNPn" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3342c035-92a8-4f1e-857f-60aca52c5a4a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oaDwpNPn'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e9be67-560e-47b9-98fd-a70408518f09]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcb56dd-7bb8-4c83-9a55-5b3847308a6c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --login" returned: 0 in 0.119s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba5167b-9ad8-4549-b2a4-c52386d1a24f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d, portal: 172.16.0.220,3260]
Nov 28 20:13:37 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d, portal: 172.16.0.220,3260] successful.
Nov 28 20:13:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcae9789-51c9-4ca9-9ab7-5751a11320e7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f2bb15-3157-44fa-af58-f4eb6c507ce4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b667ec83-81c2-4521-86c6-2c12e9b60bff]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:13:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 353370112 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Preparing to wait for external event volume-reimaged-fa0184f2-4a56-4d02-95cb-f5b41506ed72 {{(pid=75571) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 28 20:13:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 494927872 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:38 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:13:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaDwpNPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:13:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '26361376438653435', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361376438653435', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:13:38 user nova-compute[75571]: DEBUG nova.objects.instance [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lazy-loading 'flavor' on Instance uuid 415392e8-bf6c-433e-a4f5-be3d99419710 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] attach device xml: <disk type="block" device="disk">
Nov 28 20:13:38 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:13:38 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:13:38 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:13:38 user nova-compute[75571]:   <serial>9a88cdcb-c692-441b-90ca-dd777b566a4d</serial>
Nov 28 20:13:38 user nova-compute[75571]: </disk>
Nov 28 20:13:38 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:13:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 659554304 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:13:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:13:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] No VIF found with MAC fa:16:3e:d0:dd:5e, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:13:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 804257792 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "415392e8-bf6c-433e-a4f5-be3d99419710" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.587s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 960495616 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] volume_snapshot_create: create_info: {'snapshot_id': 'f7930ef6-2a96-40ea-89a7-57185f53c29b', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75571) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] snap xml: <domainsnapshot>
Nov 28 20:13:40 user nova-compute[75571]:   <disks>
Nov 28 20:13:40 user nova-compute[75571]:     <disk name="/dev/sdb" snapshot="external" type="file">
Nov 28 20:13:40 user nova-compute[75571]:       <source file="/dev/new_file"/>
Nov 28 20:13:40 user nova-compute[75571]:     </disk>
Nov 28 20:13:40 user nova-compute[75571]:     <disk name="vda" snapshot="no"/>
Nov 28 20:13:40 user nova-compute[75571]:   </disks>
Nov 28 20:13:40 user nova-compute[75571]: </domainsnapshot>
Nov 28 20:13:40 user nova-compute[75571]:  {{(pid=75571) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG nova.objects.instance [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Lazy-loading 'system_metadata' on Instance uuid 415392e8-bf6c-433e-a4f5-be3d99419710 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:40 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 20:13:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ad0647ed-276f-48c4-8d90-29735125119e tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] volume_snapshot_delete: delete_info: {'volume_id': '9a88cdcb-c692-441b-90ca-dd777b566a4d'} {{(pid=75571) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [None req-ad0647ed-276f-48c4-8d90-29735125119e tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Traceback (most recent call last):
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     if delete_info['type'] != 'qcow2':
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] KeyError: 'type'
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] 
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Traceback (most recent call last):
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     rv = execute(f, *args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     six.reraise(c, e, tb)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     raise value
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     rv = meth(*args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] 
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Traceback (most recent call last):
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     self._volume_snapshot_create(context, instance, guest,
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     rv = execute(f, *args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     six.reraise(c, e, tb)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     raise value
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     rv = meth(*args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] 
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [None req-ad0647ed-276f-48c4-8d90-29735125119e tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver 
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver 
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-bf9c428c-783c-445c-9790-a1a4bd7dfe42)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver 
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver 
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver 
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot f7930ef6-2a96-40ea-89a7-57185f53c29b could not be found.
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     raise value
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver 
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver 
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot f7930ef6-2a96-40ea-89a7-57185f53c29b could not be found. (HTTP 404) (Request-ID: req-0e2ab927-858f-4929-906f-4fa44373bf2d)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver 
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver 
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot f7930ef6-2a96-40ea-89a7-57185f53c29b could not be found.
Nov 28 20:13:40 user nova-compute[75571]: ERROR nova.virt.libvirt.driver 
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server [None req-ad0647ed-276f-48c4-8d90-29735125119e tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Exception during message handling: KeyError: 'type'
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server 
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     raise value
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 20:13:40 user nova-compute[75571]: ERROR oslo_messaging.rpc.server 
Nov 28 20:13:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUvJwBDn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:40 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Acquiring lock "415392e8-bf6c-433e-a4f5-be3d99419710" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "415392e8-bf6c-433e-a4f5-be3d99419710" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:40 user nova-compute[75571]: INFO nova.compute.manager [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Detaching volume 9a88cdcb-c692-441b-90ca-dd777b566a4d
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b69d64-acbb-41a3-bb48-00cd24cc6c67]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:13:40 user nova-compute[75571]: No targets found.
Nov 28 20:13:40 user nova-compute[75571]: iSNS:
Nov 28 20:13:40 user nova-compute[75571]: No targets found.
Nov 28 20:13:40 user nova-compute[75571]: STATIC:
Nov 28 20:13:40 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5
Nov 28 20:13:40 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:40 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:40 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620
Nov 28 20:13:40 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:40 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:40 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb
Nov 28 20:13:40 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:40 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:40 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180
Nov 28 20:13:40 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:40 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:40 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21
Nov 28 20:13:40 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:40 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:40 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0
Nov 28 20:13:40 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:40 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:40 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3
Nov 28 20:13:40 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:40 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:40 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d
Nov 28 20:13:40 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:40 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:40 user nova-compute[75571]: FIRMWARE:
Nov 28 20:13:40 user nova-compute[75571]: No targets found.
Nov 28 20:13:40 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:13:40 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:13:40 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5076ea85-a662-4358-bf4f-6eb73642d76e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:40 user nova-compute[75571]: INFO nova.virt.block_device [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Attempting to driver detach volume 9a88cdcb-c692-441b-90ca-dd777b566a4d from mountpoint /dev/vdb
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[66717157-bb48-48ff-9450-7c468da66b88]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:40 user nova-compute[75571]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:13:40 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:40 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:40 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:40 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:40 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:40 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:40 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:40 user nova-compute[75571]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:13:40 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:40 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:40 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:40 user nova-compute[75571]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:40 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:40 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:40 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768788e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb'): ({'sdf'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Removing single pathed devices sdf {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Attempting to detach device vdb from instance 415392e8-bf6c-433e-a4f5-be3d99419710 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 20:13:40 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:13:40 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:13:40 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:13:40 user nova-compute[75571]:   <serial>9a88cdcb-c692-441b-90ca-dd777b566a4d</serial>
Nov 28 20:13:40 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:13:40 user nova-compute[75571]: </disk>
Nov 28 20:13:40 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:13:40 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Successfully detached device vdb from instance 415392e8-bf6c-433e-a4f5-be3d99419710 from the persistent domain config.
Nov 28 20:13:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 415392e8-bf6c-433e-a4f5-be3d99419710 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 20:13:40 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:13:40 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:13:40 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:13:40 user nova-compute[75571]:   <serial>9a88cdcb-c692-441b-90ca-dd777b566a4d</serial>
Nov 28 20:13:40 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:13:40 user nova-compute[75571]: </disk>
Nov 28 20:13:40 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cd0a26-3f4f-4f07-9fd7-21c201e91830]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[259148b4-f107-4f51-94a1-ae62af2f219c]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Flushing IO for device /dev/sdf {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a9fd2e-1559-4870-9fe4-e6f3c5fdcaf7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a782b0-b803-409c-b4bf-288453d01750]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] SCSI volumes sdf have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6595df4a-5515-489d-8208-bd12d1ae87b8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[982e9a8a-1ea5-45f9-8c27-3000ded48c7e]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260]
Nov 28 20:13:41 user nova-compute[75571]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260] successful.
Nov 28 20:13:41 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dd825b-16cd-4835-8a09-ddd591dd630a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] <== disconnect_volume: return (339ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:13:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwVriKBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'a3084b80-68e5-44f6-b87d-4f7ad6b31756', 'attached_at': '', 'detached_at': '', 'volume_id': '38d594ec-446e-4a19-a5ae-9371a985e1b0', 'serial'} {{(pid=75571) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 20:13:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] swap_volume: removing Cinder connection for volume d1537a8f-618a-4dc3-aa95-77f77a33e2fb {{(pid=75571) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 20:13:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 415392e8-bf6c-433e-a4f5-be3d99419710 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:13:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] swap_volume: Updating volume d1537a8f-618a-4dc3-aa95-77f77a33e2fb BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "jwVriKBE", "auth_password": "fDSgmkvpJ4HQTu", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "38d594ec-446e-4a19-a5ae-9371a985e1b0"}, "status": "reserved", "instance": "a3084b80-68e5-44f6-b87d-4f7ad6b31756", "attached_at": "", "detached_at": "", "volume_id": "38d594ec-446e-4a19-a5ae-9371a985e1b0", "serial": "38d594ec-446e-4a19-a5ae-9371a985e1b0"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '38d594ec-446e-4a19-a5ae-9371a985e1b0', 'no_device': None, 'attachment_id': '1f1348c0-748d-4b81-970d-b69baacac65f'} {{(pid=75571) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 20:13:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.719s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Acquiring lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG os_brick.utils [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[595c1828-610e-47ad-b67d-b57d2f856e43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6af3e6-9253-4d9c-b834-7b932c61a4b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[076ecbd4-1c40-4805-bfde-daab6b50ab59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b99ebce-36ea-4239-b9ac-7d954c38e1df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:13:43 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:13:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b254887-c6ea-48ee-b60b-6f5e8ee79ac3]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:13:43 user nova-compute[75571]: DEBUG os_brick.utils [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:43 user nova-compute[75571]: INFO nova.compute.manager [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Swapping volume 38d594ec-446e-4a19-a5ae-9371a985e1b0 for d1537a8f-618a-4dc3-aa95-77f77a33e2fb
Nov 28 20:13:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:49 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe726611-331a-495f-a6bd-ced2d1a305b2 is timed out.
Nov 28 20:13:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Successfully detached device vdb from instance fe726611-331a-495f-a6bd-ced2d1a305b2 from the live domain config.
Nov 28 20:13:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHXVeklL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:49 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5af175e-9ac0-4aae-913a-bf1fa20165e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:13:49 user nova-compute[75571]: No targets found.
Nov 28 20:13:49 user nova-compute[75571]: iSNS:
Nov 28 20:13:49 user nova-compute[75571]: No targets found.
Nov 28 20:13:49 user nova-compute[75571]: STATIC:
Nov 28 20:13:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5
Nov 28 20:13:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620
Nov 28 20:13:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180
Nov 28 20:13:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21
Nov 28 20:13:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0
Nov 28 20:13:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3
Nov 28 20:13:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d
Nov 28 20:13:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72
Nov 28 20:13:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:49 user nova-compute[75571]: FIRMWARE:
Nov 28 20:13:49 user nova-compute[75571]: No targets found.
Nov 28 20:13:49 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:13:49 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:13:49 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc1ac28-fa95-4b02-a59f-a03e8aa73188]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b387b4-7e59-4479-b231-30a18b3a47ba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768713c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180'): ({'sdg'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Removing single pathed devices sdg {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2865f9da-5fb2-457c-9929-aa175337ef98]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[60274bdd-8ae7-432e-ae5e-021d41919ed1]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Flushing IO for device /dev/sdg {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a095a5e4-c128-468d-9252-cc19947650d5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.034s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[272c6931-7eab-43be-b1f2-33d06e6c8076]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] SCSI volumes sdg have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb3b6f9-81ed-44a3-8f77-f122a8e315cf]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c0d5ff-61d8-47ea-afd9-e533a7382cee]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180, portal: 172.16.0.220,3260]
Nov 28 20:13:49 user nova-compute[75571]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180, portal: 172.16.0.220,3260] successful.
Nov 28 20:13:49 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf35ee65-861a-4cfd-9e94-fc02d8f0f180 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0347f686-c5d4-40bf-95f6-bd26792b9ed5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] <== disconnect_volume: return (317ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:13:49 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 is timed out.
Nov 28 20:13:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Successfully detached device sdc from instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 from the live domain config.
Nov 28 20:13:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyDElkQe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:49 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f9a697-99e3-4418-ae87-cbcf3abc5aa9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:13:49 user nova-compute[75571]: No targets found.
Nov 28 20:13:49 user nova-compute[75571]: iSNS:
Nov 28 20:13:49 user nova-compute[75571]: No targets found.
Nov 28 20:13:49 user nova-compute[75571]: STATIC:
Nov 28 20:13:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5
Nov 28 20:13:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620
Nov 28 20:13:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21
Nov 28 20:13:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0
Nov 28 20:13:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3
Nov 28 20:13:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d
Nov 28 20:13:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72
Nov 28 20:13:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:49 user nova-compute[75571]: FIRMWARE:
Nov 28 20:13:49 user nova-compute[75571]: No targets found.
Nov 28 20:13:49 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:13:49 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:13:49 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bf344b-b26b-4524-89c5-b9fad2aacb73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[764cd85e-3a0c-42a2-80cc-554e9d7f29e0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 (non-flash)
Nov 28 20:13:49 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768507eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21'): ({'sdh'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Removing single pathed devices sdh {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1125edbc-d6e0-48d3-bb8f-230ea4ecc21a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c795ff64-84a5-486b-b76b-130144cc6588]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Flushing IO for device /dev/sdh {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6981c748-5399-4271-b80f-a0bf999a1375]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4d0ea3-d789-4f9a-a167-0669110cada7]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] SCSI volumes sdh have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[454726d3-79ef-455f-82c8-7b65cc2b2757]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d168cdbc-3305-452f-b347-5e766b793f67]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21, portal: 172.16.0.220,3260]
Nov 28 20:13:50 user nova-compute[75571]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21, portal: 172.16.0.220,3260] successful.
Nov 28 20:13:50 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a30bcfd-1fe1-40b4-b548-de392d8adc21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abb51ad-a157-40e7-bf85-60f52ca6c832]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] <== disconnect_volume: return (332ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lazy-loading 'flavor' on Instance uuid fe726611-331a-495f-a6bd-ced2d1a305b2 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.848s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG nova.compute.manager [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUvJwBDn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3084b80-68e5-44f6-b87d-4f7ad6b31756', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1537a8f-618a-4dc3-aa95-77f77a33e2fb', 'serial': 'd1537a8f-618a-4dc3-aa95-77f77a33e2fb'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwVriKBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '38d594ec-446e-4a19-a5ae-9371a985e1b0'}, 'status': 'reserved', 'instance': 'a3084b80-68e5-44f6-b87d-4f7ad6b31756', 'attached_at': '', 'detached_at': '', 'volume_id': '38d594ec-446e-4a19-a5ae-9371a985e1b0', 'serial'} {{(pid=75571) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUvJwBDn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:50 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:50 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:50 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:13:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14b6161-d9d8-4628-9dce-008f042ff7c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:13:50 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG nova.objects.instance [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lazy-loading 'flavor' on Instance uuid 958252cc-398e-4cc6-bd8d-937c99ef2b70 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[70099403-656a-47b1-a4c5-fa8d70d58a5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb] added
Nov 28 20:13:51 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1774e7a-3221-4eba-a309-9abd35376180]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.729s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[363a580f-7483-40d2-ac3f-81a509ded3fc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUvJwBDn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUvJwBDn" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[74656107-72d8-4222-8a31-f90f043f1245]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qUvJwBDn'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ab38e4-8883-4343-a131-0db835efd3c7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[de45ef7d-df14-4f00-a712-01641250c0b7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d288d7-e6c7-4b86-9318-3f86da1699f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260]
Nov 28 20:13:51 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260] successful.
Nov 28 20:13:51 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7acd974-e765-4c31-8535-199cf12d0604]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa1cb2e-e320-4ed3-99b4-0d859345bca3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:51 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] HCTL ('38', '-', '-', 0) found on session 13 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4bfde0-dcea-444e-a33d-c6fe46f9a215]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Searching for a device in session 13 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:13:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUvJwBDn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "958252cc-398e-4cc6-bd8d-937c99ef2b70" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "958252cc-398e-4cc6-bd8d-937c99ef2b70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:52 user nova-compute[75571]: INFO nova.compute.manager [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Terminating instance
Nov 28 20:13:52 user nova-compute[75571]: DEBUG nova.compute.manager [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23436666562346466', 'path': '/dev/sdg'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436666562346466', 'path': '/dev/sdg'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG nova.objects.instance [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lazy-loading 'flavor' on Instance uuid a3084b80-68e5-44f6-b87d-4f7ad6b31756 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG nova.compute.manager [req-c1f7020d-5143-4114-a11e-2f89df9518f8 req-4de70f52-a599-4683-a85f-a0e065c8ce33 service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Received event network-vif-unplugged-0fd6ab13-839a-4071-a3d1-60b901aea40f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c1f7020d-5143-4114-a11e-2f89df9518f8 req-4de70f52-a599-4683-a85f-a0e065c8ce33 service nova] Acquiring lock "958252cc-398e-4cc6-bd8d-937c99ef2b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c1f7020d-5143-4114-a11e-2f89df9518f8 req-4de70f52-a599-4683-a85f-a0e065c8ce33 service nova] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c1f7020d-5143-4114-a11e-2f89df9518f8 req-4de70f52-a599-4683-a85f-a0e065c8ce33 service nova] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG nova.compute.manager [req-c1f7020d-5143-4114-a11e-2f89df9518f8 req-4de70f52-a599-4683-a85f-a0e065c8ce33 service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] No waiting events found dispatching network-vif-unplugged-0fd6ab13-839a-4071-a3d1-60b901aea40f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:13:52 user nova-compute[75571]: DEBUG nova.compute.manager [req-c1f7020d-5143-4114-a11e-2f89df9518f8 req-4de70f52-a599-4683-a85f-a0e065c8ce33 service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Received event network-vif-unplugged-0fd6ab13-839a-4071-a3d1-60b901aea40f for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:13:53 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Instance destroyed successfully.
Nov 28 20:13:53 user nova-compute[75571]: DEBUG nova.objects.instance [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lazy-loading 'resources' on Instance uuid 958252cc-398e-4cc6-bd8d-937c99ef2b70 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-34592518',display_name='tempest-AttachSCSIVolumeTestJSON-server-34592518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-34592518',id=4,image_ref='0fe13e33-5c27-4eb1-8948-21098291272a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYplXzwET4VCxpdXETVYQ20/108yZbkDYnBL+bsxPCGkwSbdM1+M+pvjeXnNj257ALlRgNAx6Chap7EsPxZI+6RHrK5yLGGnnoitoanfrSqV2YSww6dqblLCraEp0Kt8A==',key_name='tempest-keypair-1011383959',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:11:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed4b4be41b8c4b2d83a6ea935a176a7e',ramdisk_id='',reservation_id='r-0bcn38w4',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0fe13e33-5c27-4eb1-8948-21098291272a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2114135896',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2114135896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56dee3003b03497db332c4719be3a045',uuid=958252cc-398e-4cc6-bd8d-937c99ef2b70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "address": "fa:16:3e:7b:92:e2", "network": {"id": "b64cd5b4-e6ba-413d-839a-465e577eebb4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1905929996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4b4be41b8c4b2d83a6ea935a176a7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd6ab13-83", "ovs_interfaceid": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Converting VIF {"id": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "address": "fa:16:3e:7b:92:e2", "network": {"id": "b64cd5b4-e6ba-413d-839a-465e577eebb4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1905929996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed4b4be41b8c4b2d83a6ea935a176a7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd6ab13-83", "ovs_interfaceid": "0fd6ab13-839a-4071-a3d1-60b901aea40f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:92:e2,bridge_name='br-int',has_traffic_filtering=True,id=0fd6ab13-839a-4071-a3d1-60b901aea40f,network=Network(b64cd5b4-e6ba-413d-839a-465e577eebb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd6ab13-83') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG os_vif [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:92:e2,bridge_name='br-int',has_traffic_filtering=True,id=0fd6ab13-839a-4071-a3d1-60b901aea40f,network=Network(b64cd5b4-e6ba-413d-839a-465e577eebb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd6ab13-83') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fd6ab13-83, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14b3eaf2-8611-459b-a546-b011223ba9ad) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:53 user nova-compute[75571]: INFO os_vif [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:92:e2,bridge_name='br-int',has_traffic_filtering=True,id=0fd6ab13-839a-4071-a3d1-60b901aea40f,network=Network(b64cd5b4-e6ba-413d-839a-465e577eebb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd6ab13-83')
Nov 28 20:13:53 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Deleting instance files /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70_del
Nov 28 20:13:53 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Deletion of /opt/stack/data/nova/instances/958252cc-398e-4cc6-bd8d-937c99ef2b70_del complete
Nov 28 20:13:53 user nova-compute[75571]: INFO nova.compute.manager [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 20:13:53 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 44040192 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 67108864 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:54 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:13:54 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Took 1.31 seconds to deallocate network for instance.
Nov 28 20:13:54 user nova-compute[75571]: DEBUG nova.compute.manager [req-b643be7f-b573-43d6-8d03-07d5b57753c0 req-c8f97c81-ad2c-4d21-9190-244f989427af service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Received event network-vif-deleted-0fd6ab13-839a-4071-a3d1-60b901aea40f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:54 user nova-compute[75571]: DEBUG nova.compute.manager [req-0fd0e75f-aadd-4e9a-85c9-1ab3da8a7f6d req-40da7c28-dc9e-43ca-b61c-e7b8ddd7e775 service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Received event network-vif-plugged-0fd6ab13-839a-4071-a3d1-60b901aea40f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0fd0e75f-aadd-4e9a-85c9-1ab3da8a7f6d req-40da7c28-dc9e-43ca-b61c-e7b8ddd7e775 service nova] Acquiring lock "958252cc-398e-4cc6-bd8d-937c99ef2b70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0fd0e75f-aadd-4e9a-85c9-1ab3da8a7f6d req-40da7c28-dc9e-43ca-b61c-e7b8ddd7e775 service nova] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0fd0e75f-aadd-4e9a-85c9-1ab3da8a7f6d req-40da7c28-dc9e-43ca-b61c-e7b8ddd7e775 service nova] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:54 user nova-compute[75571]: DEBUG nova.compute.manager [req-0fd0e75f-aadd-4e9a-85c9-1ab3da8a7f6d req-40da7c28-dc9e-43ca-b61c-e7b8ddd7e775 service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] No waiting events found dispatching network-vif-plugged-0fd6ab13-839a-4071-a3d1-60b901aea40f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:13:54 user nova-compute[75571]: WARNING nova.compute.manager [req-0fd0e75f-aadd-4e9a-85c9-1ab3da8a7f6d req-40da7c28-dc9e-43ca-b61c-e7b8ddd7e775 service nova] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Received unexpected event network-vif-plugged-0fd6ab13-839a-4071-a3d1-60b901aea40f for instance with vm_state deleted and task_state None.
Nov 28 20:13:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 158334976 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:54 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:13:54 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:13:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:55 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Deleted allocations for instance 958252cc-398e-4cc6-bd8d-937c99ef2b70
Nov 28 20:13:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "958252cc-398e-4cc6-bd8d-937c99ef2b70" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.899s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 186646528 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 244318208 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 390070272 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 572522496 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 684720128 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 818937856 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 972029952 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG nova.compute.manager [req-e46f23f4-c2f2-41ce-bc28-094f453c3436 req-07961de3-4e57-4f28-ac58-ea54174c905d service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received event volume-reimaged-fa0184f2-4a56-4d02-95cb-f5b41506ed72 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e46f23f4-c2f2-41ce-bc28-094f453c3436 req-07961de3-4e57-4f28-ac58-ea54174c905d service nova] Acquiring lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e46f23f4-c2f2-41ce-bc28-094f453c3436 req-07961de3-4e57-4f28-ac58-ea54174c905d service nova] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e46f23f4-c2f2-41ce-bc28-094f453c3436 req-07961de3-4e57-4f28-ac58-ea54174c905d service nova] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG nova.compute.manager [req-e46f23f4-c2f2-41ce-bc28-094f453c3436 req-07961de3-4e57-4f28-ac58-ea54174c905d service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Processing event volume-reimaged-fa0184f2-4a56-4d02-95cb-f5b41506ed72 {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Instance event wait completed in 20 seconds for volume-reimaged {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:13:58 user nova-compute[75571]: INFO nova.virt.block_device [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Booting with volume fa0184f2-4a56-4d02-95cb-f5b41506ed72 at /dev/vda
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.utils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7132619c-1dd8-423a-91a0-67ab96c94ed2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40783a4-1841-4ef8-8813-ed4978d43d0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb3beb0-d78d-453e-a84c-269552ae139d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[94773923-dffb-44c0-999f-96891da1f84c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:13:58 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3975ff2-5094-49f4-ad10-01d8484672a9]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.utils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Updating existing volume attachment record: 39ad0510-92e4-4a97-ac1b-fdf8bb350504 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwVriKBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '38d594ec-446e-4a19-a5ae-9371a985e1b0'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:13:58 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c237bc0f-dae2-4767-bc60-002dc22bb5cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:13:58 user nova-compute[75571]: No targets found.
Nov 28 20:13:58 user nova-compute[75571]: iSNS:
Nov 28 20:13:58 user nova-compute[75571]: No targets found.
Nov 28 20:13:58 user nova-compute[75571]: STATIC:
Nov 28 20:13:58 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5
Nov 28 20:13:58 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:58 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:58 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620
Nov 28 20:13:58 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:58 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:58 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb
Nov 28 20:13:58 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:58 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:58 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0
Nov 28 20:13:58 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:58 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:58 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3
Nov 28 20:13:58 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:58 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:58 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d
Nov 28 20:13:58 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:13:58 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:13:58 user nova-compute[75571]: FIRMWARE:
Nov 28 20:13:58 user nova-compute[75571]: No targets found.
Nov 28 20:13:58 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:13:58 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:13:58 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dffeb82-f7f8-4ae2-85f3-06a0dbffbba8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6245805a-a1f1-47c4-824d-97153f1901f9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:58 user nova-compute[75571]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:13:58 user nova-compute[75571]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:58 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:58 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:58 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:58 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 (non-flash)
Nov 28 20:13:58 user nova-compute[75571]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:13:58 user nova-compute[75571]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:13:58 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:13:58 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:13:58 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:13:58 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768788280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0'): ({'sdi'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Removing single pathed devices sdi {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:13:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4123943-21c2-496e-86a1-a36a749f1956]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[054f2418-dcdd-4014-9de0-55bbc230c31a]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Flushing IO for device /dev/sdi {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a090e2f2-73e8-46da-a627-b324420052dc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d93d82-4376-4154-ba00-0141e339c96a]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] SCSI volumes sdi have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4bac9d-c039-4a2f-abe1-a1df814fa3d5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9b7f83-a68a-4ba8-b569-56514dcacbea]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0, portal: 172.16.0.220,3260]
Nov 28 20:13:59 user nova-compute[75571]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0, portal: 172.16.0.220,3260] successful.
Nov 28 20:13:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d594ec-446e-4a19-a5ae-9371a985e1b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc25fe93-8803-4236-8e2a-7611b9593d02]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] <== disconnect_volume: return (318ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG nova.compute.manager [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUvJwBDn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'a3084b80-68e5-44f6-b87d-4f7ad6b31756', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1537a8f-618a-4dc3-aa95-77f77a33e2fb', 'serial'} {{(pid=75571) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 20:13:59 user nova-compute[75571]: DEBUG nova.compute.manager [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] swap_volume: removing Cinder connection for volume 38d594ec-446e-4a19-a5ae-9371a985e1b0 {{(pid=75571) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 20:14:00 user nova-compute[75571]: DEBUG nova.compute.manager [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] swap_volume: Updating volume 38d594ec-446e-4a19-a5ae-9371a985e1b0 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "qUvJwBDn", "auth_password": "LE2SRslXmjNfIv", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "d1537a8f-618a-4dc3-aa95-77f77a33e2fb"}, "status": "reserved", "instance": "a3084b80-68e5-44f6-b87d-4f7ad6b31756", "attached_at": "", "detached_at": "", "volume_id": "d1537a8f-618a-4dc3-aa95-77f77a33e2fb", "serial": "d1537a8f-618a-4dc3-aa95-77f77a33e2fb"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd1537a8f-618a-4dc3-aa95-77f77a33e2fb', 'no_device': None, 'attachment_id': '12165a33-c34d-4ac0-965b-6b93c7514c57'} {{(pid=75571) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 20:14:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.163s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "b4000485-c53c-46e7-b585-cec40c114ec9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "b4000485-c53c-46e7-b585-cec40c114ec9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:00 user nova-compute[75571]: DEBUG nova.compute.manager [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:14:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:00 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:14:00 user nova-compute[75571]: INFO nova.compute.claims [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Claim successful on node user
Nov 28 20:14:00 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:14:00 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:14:00 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:14:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-3af722ce-0fcf-4cee-baa1-5ce3694e4506 req-63adf01b-01cd-4bfe-b599-3f105c6493f4 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-changed-84e4f0c4-3f04-4c12-8691-9751c9f48d88 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-3af722ce-0fcf-4cee-baa1-5ce3694e4506 req-63adf01b-01cd-4bfe-b599-3f105c6493f4 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing instance network info cache due to event network-changed-84e4f0c4-3f04-4c12-8691-9751c9f48d88. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:14:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3af722ce-0fcf-4cee-baa1-5ce3694e4506 req-63adf01b-01cd-4bfe-b599-3f105c6493f4 service nova] Acquiring lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:14:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3af722ce-0fcf-4cee-baa1-5ce3694e4506 req-63adf01b-01cd-4bfe-b599-3f105c6493f4 service nova] Acquired lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:14:00 user nova-compute[75571]: DEBUG nova.network.neutron [req-3af722ce-0fcf-4cee-baa1-5ce3694e4506 req-63adf01b-01cd-4bfe-b599-3f105c6493f4 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Refreshing network info cache for port 84e4f0c4-3f04-4c12-8691-9751c9f48d88 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:01 user nova-compute[75571]: INFO nova.compute.manager [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Detaching volume d1537a8f-618a-4dc3-aa95-77f77a33e2fb
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-fe726611-331a-495f-a6bd-ced2d1a305b2" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-fe726611-331a-495f-a6bd-ced2d1a305b2" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:14:01 user nova-compute[75571]: INFO nova.virt.block_device [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Attempting to driver detach volume d1537a8f-618a-4dc3-aa95-77f77a33e2fb from mountpoint /dev/vdb
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.compute.manager [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Attempting to detach device vdb from instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:14:01 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:14:01 user nova-compute[75571]:   <source dev="/dev/sdg"/>
Nov 28 20:14:01 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:14:01 user nova-compute[75571]:   <serial>d1537a8f-618a-4dc3-aa95-77f77a33e2fb</serial>
Nov 28 20:14:01 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:14:01 user nova-compute[75571]: </disk>
Nov 28 20:14:01 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:14:01 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Successfully detached device vdb from instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 from the persistent domain config.
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:14:01 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:14:01 user nova-compute[75571]:   <source dev="/dev/sdg"/>
Nov 28 20:14:01 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:14:01 user nova-compute[75571]:   <serial>d1537a8f-618a-4dc3-aa95-77f77a33e2fb</serial>
Nov 28 20:14:01 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:14:01 user nova-compute[75571]: </disk>
Nov 28 20:14:01 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.compute.manager [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.network.neutron [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:14:01 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:14:01 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 415392e8-bf6c-433e-a4f5-be3d99419710 is timed out.
Nov 28 20:14:01 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Successfully detached device vdb from instance 415392e8-bf6c-433e-a4f5-be3d99419710 from the live domain config.
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaDwpNPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:14:01 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.compute.manager [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc96b22-7401-476a-a31f-47d9cf16501c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:14:01 user nova-compute[75571]: No targets found.
Nov 28 20:14:01 user nova-compute[75571]: iSNS:
Nov 28 20:14:01 user nova-compute[75571]: No targets found.
Nov 28 20:14:01 user nova-compute[75571]: STATIC:
Nov 28 20:14:01 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5
Nov 28 20:14:01 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:01 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:01 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620
Nov 28 20:14:01 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:01 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:01 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb
Nov 28 20:14:01 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:01 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:01 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3
Nov 28 20:14:01 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:01 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:01 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d
Nov 28 20:14:01 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:01 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:01 user nova-compute[75571]: FIRMWARE:
Nov 28 20:14:01 user nova-compute[75571]: No targets found.
Nov 28 20:14:01 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:14:01 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:14:01 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5f3fe5-5430-4f05-ba18-37a3c50dd9e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4d2f04-1304-4631-9fd9-87a526e6ef00]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:14:01 user nova-compute[75571]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:14:01 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:14:01 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:14:01 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:14:01 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d (non-flash)
Nov 28 20:14:01 user nova-compute[75571]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:14:01 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:14:01 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:14:01 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:14:01 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77781ec280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be15945-3763-4192-bdaa-a3e38954d54a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.policy [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.compute.manager [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:14:01 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Creating image(s)
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "/opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "/opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48fa1a7-b3b0-4ebf-b574-7abbcaf2b388]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eb3707-2ab3-4be9-8d0e-94bda6d5f86d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.066s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4690410a-28e2-4fc0-b0ee-7bafb1e1e9e1]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce6fb0b-c59c-4602-a7e8-c72add9f147a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.201s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e045ec3-3c49-44b1-95d3-14fd423afa38]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d, portal: 172.16.0.220,3260]
Nov 28 20:14:01 user nova-compute[75571]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d, portal: 172.16.0.220,3260] successful.
Nov 28 20:14:01 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.network.neutron [req-3af722ce-0fcf-4cee-baa1-5ce3694e4506 req-63adf01b-01cd-4bfe-b599-3f105c6493f4 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updated VIF entry in instance network info cache for port 84e4f0c4-3f04-4c12-8691-9751c9f48d88. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.network.neutron [req-3af722ce-0fcf-4cee-baa1-5ce3694e4506 req-63adf01b-01cd-4bfe-b599-3f105c6493f4 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating instance_info_cache with network_info: [{"id": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "address": "fa:16:3e:24:b8:3a", "network": {"id": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959537065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e4f0c4-3f", "ovs_interfaceid": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "address": "fa:16:3e:a5:09:85", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f10eb6-f4", "ovs_interfaceid": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83928471-88d4-4e3f-bebd-40d53fcfd576", "address": "fa:16:3e:79:c8:db", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83928471-88", "ovs_interfaceid": "83928471-88d4-4e3f-bebd-40d53fcfd576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "address": "fa:16:3e:53:ba:54", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c9d8f5-11", "ovs_interfaceid": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a88cdcb-c692-441b-90ca-dd777b566a4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36f1744-c804-42e0-bae0-e8b1c6094403]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] <== disconnect_volume: return (450ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3af722ce-0fcf-4cee-baa1-5ce3694e4506 req-63adf01b-01cd-4bfe-b599-3f105c6493f4 service nova] Releasing lock "refresh_cache-55765bf6-ce98-4e44-b444-afcb250dc54d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.205s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk 1073741824" returned: 0 in 0.058s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.199s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG nova.network.neutron [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Successfully created port: 0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Updating instance_info_cache with network_info: [{"id": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "address": "fa:16:3e:e6:89:ea", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccfe8e6-0f", "ovs_interfaceid": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-fe726611-331a-495f-a6bd-ced2d1a305b2" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Cannot resize image /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Ensure instance console log exists: /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG nova.objects.instance [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lazy-loading 'flavor' on Instance uuid 415392e8-bf6c-433e-a4f5-be3d99419710 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "415392e8-bf6c-433e-a4f5-be3d99419710" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.011s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.network.neutron [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Successfully updated port: 0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "refresh_cache-b4000485-c53c-46e7-b585-cec40c114ec9" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquired lock "refresh_cache-b4000485-c53c-46e7-b585-cec40c114ec9" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.network.neutron [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-36119413-b039-4411-8d4d-ec03035052ba req-4449dbe2-0aa8-4e06-b60e-c53248ffc95e service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received event network-changed-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-36119413-b039-4411-8d4d-ec03035052ba req-4449dbe2-0aa8-4e06-b60e-c53248ffc95e service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Refreshing instance network info cache due to event network-changed-0bae30f2-569a-4d1d-8e35-77ad39e87209. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-36119413-b039-4411-8d4d-ec03035052ba req-4449dbe2-0aa8-4e06-b60e-c53248ffc95e service nova] Acquiring lock "refresh_cache-b4000485-c53c-46e7-b585-cec40c114ec9" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.network.neutron [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.network.neutron [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Updating instance_info_cache with network_info: [{"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Releasing lock "refresh_cache-b4000485-c53c-46e7-b585-cec40c114ec9" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.compute.manager [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Instance network_info: |[{"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-36119413-b039-4411-8d4d-ec03035052ba req-4449dbe2-0aa8-4e06-b60e-c53248ffc95e service nova] Acquired lock "refresh_cache-b4000485-c53c-46e7-b585-cec40c114ec9" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.network.neutron [req-36119413-b039-4411-8d4d-ec03035052ba req-4449dbe2-0aa8-4e06-b60e-c53248ffc95e service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Refreshing network info cache for port 0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Start _get_guest_xml network_info=[{"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:14:03 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:14:03 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:13:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-966969358',display_name='tempest-tempest.common.compute-instance-966969358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-966969358',id=12,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcv8uQz+nR5/2Kyh5iIwf3OHys6PaLMAb2ymkOGNgmsCNHOoLJgjnILAd0z5T3cqhz2i9h9soKwPeCr9xdFkv0bMWCGWMfoC+gS3+jMXGPbetTiYDkWA2a0ddXyoobpZQ==',key_name='tempest-keypair-1082993848',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a85595c9e1704e71903d25a65f5b696c',ramdisk_id='',reservation_id='r-w442wsrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-390918760',owner_user_name='tempest-ServerActionsTestOtherA-390918760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098319d33fa243f5a044cf3f3c9f983c',uuid=b4000485-c53c-46e7-b585-cec40c114ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converting VIF {"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:4b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0bae30f2-569a-4d1d-8e35-77ad39e87209,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bae30f2-56') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.objects.instance [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lazy-loading 'pci_devices' on Instance uuid b4000485-c53c-46e7-b585-cec40c114ec9 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:14:03 user nova-compute[75571]:   <uuid>b4000485-c53c-46e7-b585-cec40c114ec9</uuid>
Nov 28 20:14:03 user nova-compute[75571]:   <name>instance-0000000c</name>
Nov 28 20:14:03 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:14:03 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:14:03 user nova-compute[75571]:   <metadata>
Nov 28 20:14:03 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:14:03 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:14:03 user nova-compute[75571]:       <nova:name>tempest-tempest.common.compute-instance-966969358</nova:name>
Nov 28 20:14:03 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:14:03</nova:creationTime>
Nov 28 20:14:03 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:14:03 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:14:03 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:14:03 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:14:03 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:14:03 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:14:03 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:14:03 user nova-compute[75571]:       <nova:owner>
Nov 28 20:14:03 user nova-compute[75571]:         <nova:user uuid="098319d33fa243f5a044cf3f3c9f983c">tempest-ServerActionsTestOtherA-390918760-project-member</nova:user>
Nov 28 20:14:03 user nova-compute[75571]:         <nova:project uuid="a85595c9e1704e71903d25a65f5b696c">tempest-ServerActionsTestOtherA-390918760</nova:project>
Nov 28 20:14:03 user nova-compute[75571]:       </nova:owner>
Nov 28 20:14:03 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:14:03 user nova-compute[75571]:       <nova:ports>
Nov 28 20:14:03 user nova-compute[75571]:         <nova:port uuid="0bae30f2-569a-4d1d-8e35-77ad39e87209">
Nov 28 20:14:03 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 20:14:03 user nova-compute[75571]:         </nova:port>
Nov 28 20:14:03 user nova-compute[75571]:       </nova:ports>
Nov 28 20:14:03 user nova-compute[75571]:     </nova:instance>
Nov 28 20:14:03 user nova-compute[75571]:   </metadata>
Nov 28 20:14:03 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:14:03 user nova-compute[75571]:     <system>
Nov 28 20:14:03 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:14:03 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:14:03 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:14:03 user nova-compute[75571]:       <entry name="serial">b4000485-c53c-46e7-b585-cec40c114ec9</entry>
Nov 28 20:14:03 user nova-compute[75571]:       <entry name="uuid">b4000485-c53c-46e7-b585-cec40c114ec9</entry>
Nov 28 20:14:03 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:14:03 user nova-compute[75571]:     </system>
Nov 28 20:14:03 user nova-compute[75571]:   </sysinfo>
Nov 28 20:14:03 user nova-compute[75571]:   <os>
Nov 28 20:14:03 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:14:03 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:14:03 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:14:03 user nova-compute[75571]:   </os>
Nov 28 20:14:03 user nova-compute[75571]:   <features>
Nov 28 20:14:03 user nova-compute[75571]:     <acpi/>
Nov 28 20:14:03 user nova-compute[75571]:     <apic/>
Nov 28 20:14:03 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:14:03 user nova-compute[75571]:   </features>
Nov 28 20:14:03 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:14:03 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:14:03 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:14:03 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:14:03 user nova-compute[75571]:   </clock>
Nov 28 20:14:03 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:14:03 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:14:03 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:14:03 user nova-compute[75571]:   </cpu>
Nov 28 20:14:03 user nova-compute[75571]:   <devices>
Nov 28 20:14:03 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:14:03 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:14:03 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk"/>
Nov 28 20:14:03 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:14:03 user nova-compute[75571]:     </disk>
Nov 28 20:14:03 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:14:03 user nova-compute[75571]:       <mac address="fa:16:3e:35:4b:c8"/>
Nov 28 20:14:03 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:14:03 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:14:03 user nova-compute[75571]:       <target dev="tap0bae30f2-56"/>
Nov 28 20:14:03 user nova-compute[75571]:     </interface>
Nov 28 20:14:03 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:14:03 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/console.log" append="off"/>
Nov 28 20:14:03 user nova-compute[75571]:     </serial>
Nov 28 20:14:03 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:14:03 user nova-compute[75571]:     <video>
Nov 28 20:14:03 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:14:03 user nova-compute[75571]:     </video>
Nov 28 20:14:03 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:14:03 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:14:03 user nova-compute[75571]:     </rng>
Nov 28 20:14:03 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:14:03 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:14:03 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:14:03 user nova-compute[75571]:     </memballoon>
Nov 28 20:14:03 user nova-compute[75571]:   </devices>
Nov 28 20:14:03 user nova-compute[75571]: </domain>
Nov 28 20:14:03 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:13:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-966969358',display_name='tempest-tempest.common.compute-instance-966969358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-966969358',id=12,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcv8uQz+nR5/2Kyh5iIwf3OHys6PaLMAb2ymkOGNgmsCNHOoLJgjnILAd0z5T3cqhz2i9h9soKwPeCr9xdFkv0bMWCGWMfoC+gS3+jMXGPbetTiYDkWA2a0ddXyoobpZQ==',key_name='tempest-keypair-1082993848',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a85595c9e1704e71903d25a65f5b696c',ramdisk_id='',reservation_id='r-w442wsrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-390918760',owner_user_name='tempest-ServerActionsTestOtherA-390918760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098319d33fa243f5a044cf3f3c9f983c',uuid=b4000485-c53c-46e7-b585-cec40c114ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converting VIF {"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:4b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0bae30f2-569a-4d1d-8e35-77ad39e87209,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bae30f2-56') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG os_vif [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:4b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0bae30f2-569a-4d1d-8e35-77ad39e87209,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bae30f2-56') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '149db1a8-f061-55ee-b0c0-0ff77e77fc98', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bae30f2-56, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bae30f2-56, col_values=(('qos', UUID('bb28f009-0f3b-4a18-89a8-7edf3ef59706')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bae30f2-56, col_values=(('external_ids', {'iface-id': '0bae30f2-569a-4d1d-8e35-77ad39e87209', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:4b:c8', 'vm-uuid': 'b4000485-c53c-46e7-b585-cec40c114ec9'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:03 user nova-compute[75571]: INFO os_vif [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:4b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0bae30f2-569a-4d1d-8e35-77ad39e87209,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bae30f2-56')
Nov 28 20:14:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] No VIF found with MAC fa:16:3e:35:4b:c8, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG nova.network.neutron [req-36119413-b039-4411-8d4d-ec03035052ba req-4449dbe2-0aa8-4e06-b60e-c53248ffc95e service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Updated VIF entry in instance network info cache for port 0bae30f2-569a-4d1d-8e35-77ad39e87209. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG nova.network.neutron [req-36119413-b039-4411-8d4d-ec03035052ba req-4449dbe2-0aa8-4e06-b60e-c53248ffc95e service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Updating instance_info_cache with network_info: [{"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-36119413-b039-4411-8d4d-ec03035052ba req-4449dbe2-0aa8-4e06-b60e-c53248ffc95e service nova] Releasing lock "refresh_cache-b4000485-c53c-46e7-b585-cec40c114ec9" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:04 user nova-compute[75571]: INFO nova.compute.manager [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Terminating instance
Nov 28 20:14:04 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-37f85b86-bfd4-41e8-a0b0-059670ee797b req-d05ae24a-d355-418c-bd65-6fb62df292cf service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-unplugged-84e4f0c4-3f04-4c12-8691-9751c9f48d88 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-37f85b86-bfd4-41e8-a0b0-059670ee797b req-d05ae24a-d355-418c-bd65-6fb62df292cf service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-37f85b86-bfd4-41e8-a0b0-059670ee797b req-d05ae24a-d355-418c-bd65-6fb62df292cf service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-37f85b86-bfd4-41e8-a0b0-059670ee797b req-d05ae24a-d355-418c-bd65-6fb62df292cf service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-37f85b86-bfd4-41e8-a0b0-059670ee797b req-d05ae24a-d355-418c-bd65-6fb62df292cf service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-unplugged-84e4f0c4-3f04-4c12-8691-9751c9f48d88 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-37f85b86-bfd4-41e8-a0b0-059670ee797b req-d05ae24a-d355-418c-bd65-6fb62df292cf service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-unplugged-84e4f0c4-3f04-4c12-8691-9751c9f48d88 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-eefbd2f3-e73b-42e9-a239-7a75c26a905c req-472f1813-0152-4bdf-97c4-5ef7ad98724f service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-unplugged-5bdfc240-06a9-47c2-b496-bda3e4931c80 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-eefbd2f3-e73b-42e9-a239-7a75c26a905c req-472f1813-0152-4bdf-97c4-5ef7ad98724f service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-eefbd2f3-e73b-42e9-a239-7a75c26a905c req-472f1813-0152-4bdf-97c4-5ef7ad98724f service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-eefbd2f3-e73b-42e9-a239-7a75c26a905c req-472f1813-0152-4bdf-97c4-5ef7ad98724f service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-eefbd2f3-e73b-42e9-a239-7a75c26a905c req-472f1813-0152-4bdf-97c4-5ef7ad98724f service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-unplugged-5bdfc240-06a9-47c2-b496-bda3e4931c80 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-eefbd2f3-e73b-42e9-a239-7a75c26a905c req-472f1813-0152-4bdf-97c4-5ef7ad98724f service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-unplugged-5bdfc240-06a9-47c2-b496-bda3e4931c80 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-00b92c2b-6019-4df4-b003-1213dce73a37 req-e97beca8-8315-494f-838c-a38bee59c28f service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-unplugged-83928471-88d4-4e3f-bebd-40d53fcfd576 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-00b92c2b-6019-4df4-b003-1213dce73a37 req-e97beca8-8315-494f-838c-a38bee59c28f service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-00b92c2b-6019-4df4-b003-1213dce73a37 req-e97beca8-8315-494f-838c-a38bee59c28f service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-00b92c2b-6019-4df4-b003-1213dce73a37 req-e97beca8-8315-494f-838c-a38bee59c28f service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-00b92c2b-6019-4df4-b003-1213dce73a37 req-e97beca8-8315-494f-838c-a38bee59c28f service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-unplugged-83928471-88d4-4e3f-bebd-40d53fcfd576 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-00b92c2b-6019-4df4-b003-1213dce73a37 req-e97beca8-8315-494f-838c-a38bee59c28f service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-unplugged-83928471-88d4-4e3f-bebd-40d53fcfd576 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:14:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:14:06 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=7616MB free_disk=25.469493865966797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:06 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Instance destroyed successfully.
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lazy-loading 'resources' on Instance uuid 55765bf6-ce98-4e44-b444-afcb250dc54d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:12:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:12:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "address": "fa:16:3e:24:b8:3a", "network": {"id": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959537065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e4f0c4-3f", "ovs_interfaceid": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "address": "fa:16:3e:24:b8:3a", "network": {"id": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959537065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e4f0c4-3f", "ovs_interfaceid": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:b8:3a,bridge_name='br-int',has_traffic_filtering=True,id=84e4f0c4-3f04-4c12-8691-9751c9f48d88,network=Network(8ac9ca6d-d1f1-4241-ae50-c00452fb1fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e4f0c4-3f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG os_vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:b8:3a,bridge_name='br-int',has_traffic_filtering=True,id=84e4f0c4-3f04-4c12-8691-9751c9f48d88,network=Network(8ac9ca6d-d1f1-4241-ae50-c00452fb1fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e4f0c4-3f') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84e4f0c4-3f, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e521f49-918f-492e-8940-b4741717598b) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance fe726611-331a-495f-a6bd-ced2d1a305b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 415392e8-bf6c-433e-a4f5-be3d99419710 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 59a360a3-bce3-4673-b79e-cd0460d2a69a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 55765bf6-ce98-4e44-b444-afcb250dc54d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e902b4e2-d53e-459f-a10e-bcbba4fc2317 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance a8112c4a-cb42-49df-81a7-97b42f5cc87d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance b4000485-c53c-46e7-b585-cec40c114ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: INFO os_vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:b8:3a,bridge_name='br-int',has_traffic_filtering=True,id=84e4f0c4-3f04-4c12-8691-9751c9f48d88,network=Network(8ac9ca6d-d1f1-4241-ae50-c00452fb1fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e4f0c4-3f')
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:12:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:12:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=5bdfc240-06a9-47c2-b496-bda3e4931c80,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bdfc240-06') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG os_vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=5bdfc240-06a9-47c2-b496-bda3e4931c80,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bdfc240-06') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bdfc240-06, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1ba20ca-c292-4139-a46d-af8e7b703200) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: INFO os_vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=5bdfc240-06a9-47c2-b496-bda3e4931c80,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bdfc240-06')
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:12:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:12:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:be:81,bridge_name='br-int',has_traffic_filtering=True,id=1732200a-bf2a-477a-b72e-7191f2ccfb4e,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1732200a-bf') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG os_vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:be:81,bridge_name='br-int',has_traffic_filtering=True,id=1732200a-bf2a-477a-b72e-7191f2ccfb4e,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1732200a-bf') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1732200a-bf, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=860dbf06-a243-41a7-8020-6d348bd90bef) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: INFO os_vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:be:81,bridge_name='br-int',has_traffic_filtering=True,id=1732200a-bf2a-477a-b72e-7191f2ccfb4e,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1732200a-bf')
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:12:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:12:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "address": "fa:16:3e:a5:09:85", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f10eb6-f4", "ovs_interfaceid": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "address": "fa:16:3e:a5:09:85", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f10eb6-f4", "ovs_interfaceid": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:09:85,bridge_name='br-int',has_traffic_filtering=True,id=e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f10eb6-f4') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:09:85,bridge_name='br-int',has_traffic_filtering=True,id=e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f10eb6-f4') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7f10eb6-f4, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-5bdfc240-06a9-47c2-b496-bda3e4931c80 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-5bdfc240-06a9-47c2-b496-bda3e4931c80 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:07 user nova-compute[75571]: WARNING nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-5bdfc240-06a9-47c2-b496-bda3e4931c80 for instance with vm_state active and task_state deleting.
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-unplugged-1732200a-bf2a-477a-b72e-7191f2ccfb4e {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-unplugged-1732200a-bf2a-477a-b72e-7191f2ccfb4e {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-unplugged-1732200a-bf2a-477a-b72e-7191f2ccfb4e for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-1732200a-bf2a-477a-b72e-7191f2ccfb4e {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-1732200a-bf2a-477a-b72e-7191f2ccfb4e {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:07 user nova-compute[75571]: WARNING nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-1732200a-bf2a-477a-b72e-7191f2ccfb4e for instance with vm_state active and task_state deleting.
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-unplugged-e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-unplugged-e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-unplugged-e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:07 user nova-compute[75571]: WARNING nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee for instance with vm_state active and task_state deleting.
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received event network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Acquiring lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] No waiting events found dispatching network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:07 user nova-compute[75571]: WARNING nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received unexpected event network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance with vm_state building and task_state spawning.
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received event network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Acquiring lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] No waiting events found dispatching network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:07 user nova-compute[75571]: WARNING nova.compute.manager [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received unexpected event network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance with vm_state building and task_state spawning.
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-ee1e6dda-f019-4a15-9626-9ba87a5e8ebe req-0f5f8107-966e-4c63-8551-c50a90c6f8a1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-84e4f0c4-3f04-4c12-8691-9751c9f48d88 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ee1e6dda-f019-4a15-9626-9ba87a5e8ebe req-0f5f8107-966e-4c63-8551-c50a90c6f8a1 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ee1e6dda-f019-4a15-9626-9ba87a5e8ebe req-0f5f8107-966e-4c63-8551-c50a90c6f8a1 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ee1e6dda-f019-4a15-9626-9ba87a5e8ebe req-0f5f8107-966e-4c63-8551-c50a90c6f8a1 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-ee1e6dda-f019-4a15-9626-9ba87a5e8ebe req-0f5f8107-966e-4c63-8551-c50a90c6f8a1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-84e4f0c4-3f04-4c12-8691-9751c9f48d88 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:07 user nova-compute[75571]: WARNING nova.compute.manager [req-ee1e6dda-f019-4a15-9626-9ba87a5e8ebe req-0f5f8107-966e-4c63-8551-c50a90c6f8a1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-84e4f0c4-3f04-4c12-8691-9751c9f48d88 for instance with vm_state active and task_state deleting.
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1473951b-0032-443c-9cbc-8bfd305b117f) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: INFO os_vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:09:85,bridge_name='br-int',has_traffic_filtering=True,id=e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f10eb6-f4')
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:12:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:12:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83928471-88d4-4e3f-bebd-40d53fcfd576", "address": "fa:16:3e:79:c8:db", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83928471-88", "ovs_interfaceid": "83928471-88d4-4e3f-bebd-40d53fcfd576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "83928471-88d4-4e3f-bebd-40d53fcfd576", "address": "fa:16:3e:79:c8:db", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83928471-88", "ovs_interfaceid": "83928471-88d4-4e3f-bebd-40d53fcfd576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:c8:db,bridge_name='br-int',has_traffic_filtering=True,id=83928471-88d4-4e3f-bebd-40d53fcfd576,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83928471-88') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:c8:db,bridge_name='br-int',has_traffic_filtering=True,id=83928471-88d4-4e3f-bebd-40d53fcfd576,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83928471-88') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83928471-88, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cafae07a-4653-4409-80c0-08dc2c89dc2c) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: INFO os_vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:c8:db,bridge_name='br-int',has_traffic_filtering=True,id=83928471-88d4-4e3f-bebd-40d53fcfd576,network=Network(0daf9f89-afa5-4c78-9079-8b195d3b64d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83928471-88')
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:12:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:12:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "address": "fa:16:3e:53:ba:54", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c9d8f5-11", "ovs_interfaceid": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "address": "fa:16:3e:53:ba:54", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c9d8f5-11", "ovs_interfaceid": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ba:54,bridge_name='br-int',has_traffic_filtering=True,id=a5c9d8f5-1111-4aa6-a962-1f7136a267b0,network=Network(93522955-fc00-44c2-b0d9-b7b4bb2f69a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c9d8f5-11') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ba:54,bridge_name='br-int',has_traffic_filtering=True,id=a5c9d8f5-1111-4aa6-a962-1f7136a267b0,network=Network(93522955-fc00-44c2-b0d9-b7b4bb2f69a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c9d8f5-11') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5c9d8f5-11, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b8a874f-8810-4018-96d5-616ba7915d0d) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: INFO os_vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ba:54,bridge_name='br-int',has_traffic_filtering=True,id=a5c9d8f5-1111-4aa6-a962-1f7136a267b0,network=Network(93522955-fc00-44c2-b0d9-b7b4bb2f69a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c9d8f5-11')
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759809128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759809128',id=8,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw==',key_name='tempest-keypair-642922695',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:12:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d1a4972442f432da170242f18d528e7',ramdisk_id='',reservation_id='r-cdzjkf6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1933440292',owner_user_name='tempest-TaggedBootDevicesTest-1933440292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:12:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be9e9698937848dbb2b073607f73af64',uuid=55765bf6-ce98-4e44-b444-afcb250dc54d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converting VIF {"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:20,bridge_name='br-int',has_traffic_filtering=True,id=fe80e513-5da6-4885-8fce-0bc941bf6b4a,network=Network(93522955-fc00-44c2-b0d9-b7b4bb2f69a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe80e513-5d') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:20,bridge_name='br-int',has_traffic_filtering=True,id=fe80e513-5da6-4885-8fce-0bc941bf6b4a,network=Network(93522955-fc00-44c2-b0d9-b7b4bb2f69a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe80e513-5d') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe80e513-5d, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7461c76c-87b9-49e9-be79-8a743c009da9) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:07 user nova-compute[75571]: INFO os_vif [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:20,bridge_name='br-int',has_traffic_filtering=True,id=fe80e513-5da6-4885-8fce-0bc941bf6b4a,network=Network(93522955-fc00-44c2-b0d9-b7b4bb2f69a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe80e513-5d')
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtYvXSdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:14:07 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0938678c-c3ec-41d0-8527-7c95ae29e743]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:14:07 user nova-compute[75571]: No targets found.
Nov 28 20:14:07 user nova-compute[75571]: iSNS:
Nov 28 20:14:07 user nova-compute[75571]: No targets found.
Nov 28 20:14:07 user nova-compute[75571]: STATIC:
Nov 28 20:14:07 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5
Nov 28 20:14:07 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:07 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:07 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620
Nov 28 20:14:07 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:07 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:07 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb
Nov 28 20:14:07 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:07 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:07 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3
Nov 28 20:14:07 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:07 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:07 user nova-compute[75571]: FIRMWARE:
Nov 28 20:14:07 user nova-compute[75571]: No targets found.
Nov 28 20:14:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:14:07 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:14:07 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[854da298-ac30-4119-b696-dde9606d8159]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b617a8c-e3e9-4166-90f7-2b7219d57a9c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:14:07 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:14:07 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:14:07 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:14:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:14:07 user nova-compute[75571]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 (non-flash)
Nov 28 20:14:07 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:14:07 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:14:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7778339bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620'): ({'sdc'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Removing single pathed devices sdc {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b39d74c-b195-4807-90eb-caaf87b71803]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[416b2d38-9df2-4866-8a47-d5c7892f3992]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Flushing IO for device /dev/sdc {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9654f626-cf80-4129-ba3b-cca30801c451]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[60825e9a-e0d7-45f9-9edd-f40e5007d5c5]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd89459-0dda-4dce-8c2d-21b10cb7dc8d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[270dc43c-58b5-4df1-ab47-0b34c738bed6]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620, portal: 172.16.0.220,3260]
Nov 28 20:14:07 user nova-compute[75571]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620, portal: 172.16.0.220,3260] successful.
Nov 28 20:14:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:14:07 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Creating image(s)
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Ensure instance console log exists: /opt/stack/data/nova/instances/59a360a3-bce3-4673-b79e-cd0460d2a69a/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Start _get_guest_xml network_info=[{"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLvfdWST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '59a360a3-bce3-4673-b79e-cd0460d2a69a', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa0184f2-4a56-4d02-95cb-f5b41506ed72', 'serial': 'fa0184f2-4a56-4d02-95cb-f5b41506ed72'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '39ad0510-92e4-4a97-ac1b-fdf8bb350504', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:14:07 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 20:14:07 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.objects.instance [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lazy-loading 'vcpu_model' on Instance uuid 59a360a3-bce3-4673-b79e-cd0460d2a69a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:268567d9-8c0c-46d9-8bc0-70157c860620 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1dfa93-ad25-447f-be4f-d226455aeb3c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] <== disconnect_volume: return (348ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndAivaMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:14:07 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLvfdWST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:14:07 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc34dbcb-8e2b-4fc7-b5cd-aae20cae0ae0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:14:07 user nova-compute[75571]: No targets found.
Nov 28 20:14:07 user nova-compute[75571]: iSNS:
Nov 28 20:14:07 user nova-compute[75571]: No targets found.
Nov 28 20:14:07 user nova-compute[75571]: STATIC:
Nov 28 20:14:07 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5
Nov 28 20:14:07 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:07 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:07 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb
Nov 28 20:14:07 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:07 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:07 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3
Nov 28 20:14:07 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:07 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:07 user nova-compute[75571]: FIRMWARE:
Nov 28 20:14:07 user nova-compute[75571]: No targets found.
Nov 28 20:14:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:14:07 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:14:07 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[165ecb17-f39e-4b0a-afc7-dd7744a02d81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-83928471-88d4-4e3f-bebd-40d53fcfd576 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-83928471-88d4-4e3f-bebd-40d53fcfd576 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:07 user nova-compute[75571]: WARNING nova.compute.manager [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-83928471-88d4-4e3f-bebd-40d53fcfd576 for instance with vm_state active and task_state deleting.
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-unplugged-a5c9d8f5-1111-4aa6-a962-1f7136a267b0 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-unplugged-a5c9d8f5-1111-4aa6-a962-1f7136a267b0 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-unplugged-a5c9d8f5-1111-4aa6-a962-1f7136a267b0 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-a5c9d8f5-1111-4aa6-a962-1f7136a267b0 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-a5c9d8f5-1111-4aa6-a962-1f7136a267b0 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:07 user nova-compute[75571]: WARNING nova.compute.manager [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-a5c9d8f5-1111-4aa6-a962-1f7136a267b0 for instance with vm_state active and task_state deleting.
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-unplugged-fe80e513-5da6-4885-8fce-0bc941bf6b4a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-unplugged-fe80e513-5da6-4885-8fce-0bc941bf6b4a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-unplugged-fe80e513-5da6-4885-8fce-0bc941bf6b4a for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-plugged-fe80e513-5da6-4885-8fce-0bc941bf6b4a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Acquiring lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] No waiting events found dispatching network-vif-plugged-fe80e513-5da6-4885-8fce-0bc941bf6b4a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:07 user nova-compute[75571]: WARNING nova.compute.manager [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received unexpected event network-vif-plugged-fe80e513-5da6-4885-8fce-0bc941bf6b4a for instance with vm_state active and task_state deleting.
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e99616-dcdd-42ec-9b64-e430f2694ff4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:14:07 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:14:07 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:14:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:14:07 user nova-compute[75571]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 (non-flash)
Nov 28 20:14:07 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:14:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77687f31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3'): ({'sdd'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Removing single pathed devices sdd {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fdecf3-d917-44fc-af60-cf837509ef66]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acb5780-13da-4a53-a766-3d94b3259e43]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Flushing IO for device /dev/sdd {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00a4953-1833-4d30-bfe4-977706878bc5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[846a2f63-c372-4490-b484-075724095b0d]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] SCSI volumes sdd have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[70012eac-2822-4f0f-bc63-3bd2149e4915]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5deeaf7-a4a2-41af-97e4-8d3160488474]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3, portal: 172.16.0.220,3260]
Nov 28 20:14:07 user nova-compute[75571]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3, portal: 172.16.0.220,3260] successful.
Nov 28 20:14:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f15c27-93a6-49d9-8e7c-b001e771f4f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbb2c2f-4181-44d1-9a7c-bdd6425121d8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] <== disconnect_volume: return (332ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.300s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:14:07 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:14:07 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzFaMTov', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:14:07 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b00d954-42fe-4d84-953f-964952b971e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:14:07 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d76ed1-e00b-4604-bf7f-d1dac0ed53d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72] added
Nov 28 20:14:08 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d988c96-efd1-447d-a902-2752b4f250a2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e814a4-ee84-44de-867f-b0d88f1b92a9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLvfdWST {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLvfdWST" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d95962-e42b-4fc0-9d6d-7088b8eddc2c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XLvfdWST'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f247d83-f064-4910-9f37-87e6c49bee23]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[56451006-9544-45ad-9181-346e5ce1df0a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:14:08 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:14:08 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:14:08 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:14:08 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff78818-f812-4146-8ba2-a24c6880f019]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260]
Nov 28 20:14:08 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260] successful.
Nov 28 20:14:08 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2524eb3-6f0d-4fa9-ad90-27680f3c93e7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG nova.compute.manager [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:14:08 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Instance spawned successfully.
Nov 28 20:14:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ce4941-9448-4f23-895a-286505660870]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:14:08 user nova-compute[75571]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:14:08 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:14:08 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:14:08 user nova-compute[75571]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:14:08 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:14:08 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1e8131-8615-4f73-9e48-b3d77e94dcdc]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLvfdWST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:14:08 user nova-compute[75571]: INFO nova.compute.manager [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Took 6.91 seconds to spawn the instance on the hypervisor.
Nov 28 20:14:08 user nova-compute[75571]: DEBUG nova.compute.manager [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:14:08 user nova-compute[75571]: INFO nova.compute.manager [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Took 7.85 seconds to build instance.
Nov 28 20:14:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "b4000485-c53c-46e7-b585-cec40c114ec9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.011s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] <== connect_volume: return (1615ms) {'type': 'block', 'scsi_wwn': '23732623863633531', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732623863633531', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.310s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[999c3822-c7b7-44d3-846f-c9194410fee1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:14:09 user nova-compute[75571]: No targets found.
Nov 28 20:14:09 user nova-compute[75571]: iSNS:
Nov 28 20:14:09 user nova-compute[75571]: No targets found.
Nov 28 20:14:09 user nova-compute[75571]: STATIC:
Nov 28 20:14:09 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5
Nov 28 20:14:09 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:09 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:09 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb
Nov 28 20:14:09 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:09 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:09 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72
Nov 28 20:14:09 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:09 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:09 user nova-compute[75571]: FIRMWARE:
Nov 28 20:14:09 user nova-compute[75571]: No targets found.
Nov 28 20:14:09 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:14:09 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:14:09 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T20:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1642565132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-875799677',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6AuAWbbxZ0a6c7k1XS3X9t+pB3TAuStJooLKz16kYFR2aaVuQipo+CXoACBi2Birf2Rm15MEr9uQoGxphTgBDTn1HrWp9mOU4ZppNU69KCYDLZF6bXiACp5QJvGeeHcw==',key_name='tempest-keypair-1302784070',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:12:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fed1996731e94c8eb5c16e6327b32f39',ramdisk_id='',reservation_id='r-lg4xji60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-323010200',owner_user_name='tempest-ServerActionsV293TestJSON-323010200-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d313e776858a411ea463adecd1f36819',uuid=59a360a3-bce3-4673-b79e-cd0460d2a69a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Converting VIF {"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:9b:4a,bridge_name='br-int',has_traffic_filtering=True,id=d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c,network=Network(8b0c6ae3-604b-433f-920b-f28cc17a9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1934d1e-ff') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:14:09 user nova-compute[75571]:   <uuid>59a360a3-bce3-4673-b79e-cd0460d2a69a</uuid>
Nov 28 20:14:09 user nova-compute[75571]:   <name>instance-00000007</name>
Nov 28 20:14:09 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:14:09 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:14:09 user nova-compute[75571]:   <metadata>
Nov 28 20:14:09 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:14:09 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:14:09 user nova-compute[75571]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1642565132</nova:name>
Nov 28 20:14:09 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:14:07</nova:creationTime>
Nov 28 20:14:09 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:14:09 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:14:09 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:14:09 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:14:09 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:14:09 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:14:09 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:14:09 user nova-compute[75571]:       <nova:owner>
Nov 28 20:14:09 user nova-compute[75571]:         <nova:user uuid="d313e776858a411ea463adecd1f36819">tempest-ServerActionsV293TestJSON-323010200-project-member</nova:user>
Nov 28 20:14:09 user nova-compute[75571]:         <nova:project uuid="fed1996731e94c8eb5c16e6327b32f39">tempest-ServerActionsV293TestJSON-323010200</nova:project>
Nov 28 20:14:09 user nova-compute[75571]:       </nova:owner>
Nov 28 20:14:09 user nova-compute[75571]:       <nova:ports>
Nov 28 20:14:09 user nova-compute[75571]:         <nova:port uuid="d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c">
Nov 28 20:14:09 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 20:14:09 user nova-compute[75571]:         </nova:port>
Nov 28 20:14:09 user nova-compute[75571]:       </nova:ports>
Nov 28 20:14:09 user nova-compute[75571]:     </nova:instance>
Nov 28 20:14:09 user nova-compute[75571]:   </metadata>
Nov 28 20:14:09 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:14:09 user nova-compute[75571]:     <system>
Nov 28 20:14:09 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:14:09 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:14:09 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:14:09 user nova-compute[75571]:       <entry name="serial">59a360a3-bce3-4673-b79e-cd0460d2a69a</entry>
Nov 28 20:14:09 user nova-compute[75571]:       <entry name="uuid">59a360a3-bce3-4673-b79e-cd0460d2a69a</entry>
Nov 28 20:14:09 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:14:09 user nova-compute[75571]:     </system>
Nov 28 20:14:09 user nova-compute[75571]:   </sysinfo>
Nov 28 20:14:09 user nova-compute[75571]:   <os>
Nov 28 20:14:09 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:14:09 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:14:09 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:14:09 user nova-compute[75571]:   </os>
Nov 28 20:14:09 user nova-compute[75571]:   <features>
Nov 28 20:14:09 user nova-compute[75571]:     <acpi/>
Nov 28 20:14:09 user nova-compute[75571]:     <apic/>
Nov 28 20:14:09 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:14:09 user nova-compute[75571]:   </features>
Nov 28 20:14:09 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:14:09 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:14:09 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:14:09 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:14:09 user nova-compute[75571]:   </clock>
Nov 28 20:14:09 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:14:09 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:14:09 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:14:09 user nova-compute[75571]:   </cpu>
Nov 28 20:14:09 user nova-compute[75571]:   <devices>
Nov 28 20:14:09 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:14:09 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:14:09 user nova-compute[75571]:       <source dev="/dev/sdb"/>
Nov 28 20:14:09 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:14:09 user nova-compute[75571]:       <serial>fa0184f2-4a56-4d02-95cb-f5b41506ed72</serial>
Nov 28 20:14:09 user nova-compute[75571]:     </disk>
Nov 28 20:14:09 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:14:09 user nova-compute[75571]:       <mac address="fa:16:3e:23:9b:4a"/>
Nov 28 20:14:09 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:14:09 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:14:09 user nova-compute[75571]:       <target dev="tapd1934d1e-ff"/>
Nov 28 20:14:09 user nova-compute[75571]:     </interface>
Nov 28 20:14:09 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:14:09 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/59a360a3-bce3-4673-b79e-cd0460d2a69a/console.log" append="off"/>
Nov 28 20:14:09 user nova-compute[75571]:     </serial>
Nov 28 20:14:09 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:14:09 user nova-compute[75571]:     <video>
Nov 28 20:14:09 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:14:09 user nova-compute[75571]:     </video>
Nov 28 20:14:09 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:14:09 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:14:09 user nova-compute[75571]:     </rng>
Nov 28 20:14:09 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:14:09 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:14:09 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:14:09 user nova-compute[75571]:     </memballoon>
Nov 28 20:14:09 user nova-compute[75571]:   </devices>
Nov 28 20:14:09 user nova-compute[75571]: </domain>
Nov 28 20:14:09 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T20:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1642565132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-875799677',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6AuAWbbxZ0a6c7k1XS3X9t+pB3TAuStJooLKz16kYFR2aaVuQipo+CXoACBi2Birf2Rm15MEr9uQoGxphTgBDTn1HrWp9mOU4ZppNU69KCYDLZF6bXiACp5QJvGeeHcw==',key_name='tempest-keypair-1302784070',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:12:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fed1996731e94c8eb5c16e6327b32f39',ramdisk_id='',reservation_id='r-lg4xji60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-323010200',owner_user_name='tempest-ServerActionsV293TestJSON-323010200-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d313e776858a411ea463adecd1f36819',uuid=59a360a3-bce3-4673-b79e-cd0460d2a69a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Converting VIF {"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:9b:4a,bridge_name='br-int',has_traffic_filtering=True,id=d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c,network=Network(8b0c6ae3-604b-433f-920b-f28cc17a9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1934d1e-ff') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_vif [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:9b:4a,bridge_name='br-int',has_traffic_filtering=True,id=d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c,network=Network(8b0c6ae3-604b-433f-920b-f28cc17a9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1934d1e-ff') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ef79a64-a373-59eb-ad25-cd233370f2f2', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eaf4a9-5a19-4a4f-a4d2-98cbd18a2f08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1934d1e-ff, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1934d1e-ff, col_values=(('qos', UUID('e6ecff0a-496e-441f-a2b5-a41805b05600')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1934d1e-ff, col_values=(('external_ids', {'iface-id': 'd1934d1e-ff23-4c6f-bec5-cb3289ae0d0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:9b:4a', 'vm-uuid': '59a360a3-bce3-4673-b79e-cd0460d2a69a'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a03de6e-44fc-4587-a20b-16f09f2afab1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:14:09 user nova-compute[75571]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:14:09 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:14:09 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:14:09 user nova-compute[75571]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:14:09 user nova-compute[75571]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 (non-flash)
Nov 28 20:14:09 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77687f16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5'): ({'sde'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Removing single pathed devices sde {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:09 user nova-compute[75571]: INFO os_vif [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:9b:4a,bridge_name='br-int',has_traffic_filtering=True,id=d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c,network=Network(8b0c6ae3-604b-433f-920b-f28cc17a9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1934d1e-ff')
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7618ea75-9d01-4e22-8366-24ac229c33f0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[02207bdf-a063-421d-b7a7-8cf18c2e9e13]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Flushing IO for device /dev/sde {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[03595e9d-149f-4918-acfd-125cc69a1d75]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] No VIF found with MAC fa:16:3e:23:9b:4a, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.089s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18e7ed3-9f80-4c08-a8be-14a090c05b09]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] SCSI volumes sde have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.067s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3928a3d5-0791-4c79-b924-e546e483dea9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.203s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5ad8de-3510-4f44-9092-656b88a92312]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5, portal: 172.16.0.220,3260]
Nov 28 20:14:09 user nova-compute[75571]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5, portal: 172.16.0.220,3260] successful.
Nov 28 20:14:09 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b91bfea3-75ee-40af-b479-01a81b104cc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.130s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b5d057-2bd1-4056-80c1-07d16db8fd47]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.699s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] <== disconnect_volume: return (2009ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:14:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:14:09 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Deleting instance files /opt/stack/data/nova/instances/55765bf6-ce98-4e44-b444-afcb250dc54d_del
Nov 28 20:14:09 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Deletion of /opt/stack/data/nova/instances/55765bf6-ce98-4e44-b444-afcb250dc54d_del complete
Nov 28 20:14:10 user nova-compute[75571]: INFO nova.compute.manager [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Took 5.97 seconds to destroy the instance on the hypervisor.
Nov 28 20:14:10 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:14:10 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:14:10 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:14:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-40f8f733-77dc-4b1c-975d-6c6c32fd4bb3 req-e949f8a1-7787-41cc-8676-ee97412cd951 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-deleted-e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:12 user nova-compute[75571]: INFO nova.compute.manager [req-40f8f733-77dc-4b1c-975d-6c6c32fd4bb3 req-e949f8a1-7787-41cc-8676-ee97412cd951 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Neutron deleted interface e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee; detaching it from the instance and deleting it from the info cache
Nov 28 20:14:12 user nova-compute[75571]: DEBUG nova.network.neutron [req-40f8f733-77dc-4b1c-975d-6c6c32fd4bb3 req-e949f8a1-7787-41cc-8676-ee97412cd951 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating instance_info_cache with network_info: [{"id": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "address": "fa:16:3e:24:b8:3a", "network": {"id": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959537065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e4f0c4-3f", "ovs_interfaceid": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "83928471-88d4-4e3f-bebd-40d53fcfd576", "address": "fa:16:3e:79:c8:db", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83928471-88", "ovs_interfaceid": "83928471-88d4-4e3f-bebd-40d53fcfd576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "address": "fa:16:3e:53:ba:54", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c9d8f5-11", "ovs_interfaceid": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-40f8f733-77dc-4b1c-975d-6c6c32fd4bb3 req-e949f8a1-7787-41cc-8676-ee97412cd951 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Detach interface failed, port_id=e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee, reason: Instance 55765bf6-ce98-4e44-b444-afcb250dc54d could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:14:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:14:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:14:13 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Instance spawned successfully.
Nov 28 20:14:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:14:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:14:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:13 user nova-compute[75571]: DEBUG nova.objects.instance [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75571) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 20:14:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-deleted-83928471-88d4-4e3f-bebd-40d53fcfd576 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:14 user nova-compute[75571]: INFO nova.compute.manager [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Neutron deleted interface 83928471-88d4-4e3f-bebd-40d53fcfd576; detaching it from the instance and deleting it from the info cache
Nov 28 20:14:14 user nova-compute[75571]: DEBUG nova.network.neutron [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating instance_info_cache with network_info: [{"id": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "address": "fa:16:3e:24:b8:3a", "network": {"id": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959537065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e4f0c4-3f", "ovs_interfaceid": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "address": "fa:16:3e:53:ba:54", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c9d8f5-11", "ovs_interfaceid": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:14 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Detach interface failed, port_id=83928471-88d4-4e3f-bebd-40d53fcfd576, reason: Instance 55765bf6-ce98-4e44-b444-afcb250dc54d could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:14:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-deleted-a5c9d8f5-1111-4aa6-a962-1f7136a267b0 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:14 user nova-compute[75571]: INFO nova.compute.manager [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Neutron deleted interface a5c9d8f5-1111-4aa6-a962-1f7136a267b0; detaching it from the instance and deleting it from the info cache
Nov 28 20:14:14 user nova-compute[75571]: DEBUG nova.network.neutron [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating instance_info_cache with network_info: [{"id": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "address": "fa:16:3e:24:b8:3a", "network": {"id": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959537065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e4f0c4-3f", "ovs_interfaceid": "84e4f0c4-3f04-4c12-8691-9751c9f48d88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:14 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Took 4.48 seconds to deallocate network for instance.
Nov 28 20:14:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Detach interface failed, port_id=a5c9d8f5-1111-4aa6-a962-1f7136a267b0, reason: Instance 55765bf6-ce98-4e44-b444-afcb250dc54d could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:14:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-deleted-84e4f0c4-3f04-4c12-8691-9751c9f48d88 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:14 user nova-compute[75571]: INFO nova.compute.manager [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Neutron deleted interface 84e4f0c4-3f04-4c12-8691-9751c9f48d88; detaching it from the instance and deleting it from the info cache
Nov 28 20:14:14 user nova-compute[75571]: DEBUG nova.network.neutron [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating instance_info_cache with network_info: [{"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "address": "fa:16:3e:97:15:20", "network": {"id": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1296780783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80e513-5d", "ovs_interfaceid": "fe80e513-5da6-4885-8fce-0bc941bf6b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Detach interface failed, port_id=84e4f0c4-3f04-4c12-8691-9751c9f48d88, reason: Instance 55765bf6-ce98-4e44-b444-afcb250dc54d could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:14:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-977eb247-4413-4637-9361-0b31448cf6a6 req-d832808e-7ad3-43c1-9f7d-9b56d56515b0 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Received event network-vif-deleted-fe80e513-5da6-4885-8fce-0bc941bf6b4a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:16 user nova-compute[75571]: INFO nova.compute.manager [req-977eb247-4413-4637-9361-0b31448cf6a6 req-d832808e-7ad3-43c1-9f7d-9b56d56515b0 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Neutron deleted interface fe80e513-5da6-4885-8fce-0bc941bf6b4a; detaching it from the instance and deleting it from the info cache
Nov 28 20:14:16 user nova-compute[75571]: DEBUG nova.network.neutron [req-977eb247-4413-4637-9361-0b31448cf6a6 req-d832808e-7ad3-43c1-9f7d-9b56d56515b0 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Updating instance_info_cache with network_info: [{"id": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "address": "fa:16:3e:16:7a:63", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdfc240-06", "ovs_interfaceid": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "address": "fa:16:3e:65:be:81", "network": {"id": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-61466488", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8d1a4972442f432da170242f18d528e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1732200a-bf", "ovs_interfaceid": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-977eb247-4413-4637-9361-0b31448cf6a6 req-d832808e-7ad3-43c1-9f7d-9b56d56515b0 service nova] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Detach interface failed, port_id=fe80e513-5da6-4885-8fce-0bc941bf6b4a, reason: Instance 55765bf6-ce98-4e44-b444-afcb250dc54d could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:14:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-31f167d6-e619-4911-b7c5-a62ecaaaa18f req-279bb92e-ba8c-4f9f-ad66-3591b4b6e357 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received event network-vif-plugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-31f167d6-e619-4911-b7c5-a62ecaaaa18f req-279bb92e-ba8c-4f9f-ad66-3591b4b6e357 service nova] Acquiring lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-31f167d6-e619-4911-b7c5-a62ecaaaa18f req-279bb92e-ba8c-4f9f-ad66-3591b4b6e357 service nova] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-31f167d6-e619-4911-b7c5-a62ecaaaa18f req-279bb92e-ba8c-4f9f-ad66-3591b4b6e357 service nova] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-31f167d6-e619-4911-b7c5-a62ecaaaa18f req-279bb92e-ba8c-4f9f-ad66-3591b4b6e357 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] No waiting events found dispatching network-vif-plugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:17 user nova-compute[75571]: WARNING nova.compute.manager [req-31f167d6-e619-4911-b7c5-a62ecaaaa18f req-279bb92e-ba8c-4f9f-ad66-3591b4b6e357 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received unexpected event network-vif-plugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c for instance with vm_state active and task_state None.
Nov 28 20:14:17 user nova-compute[75571]: INFO nova.compute.manager [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Took 2.72 seconds to detach 3 volumes for instance.
Nov 28 20:14:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:18 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:14:18 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:14:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:18 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Deleted allocations for instance 55765bf6-ce98-4e44-b444-afcb250dc54d
Nov 28 20:14:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "55765bf6-ce98-4e44-b444-afcb250dc54d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.856s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-e7f442cb-c55e-483a-bff5-c3cb168088b3 req-69ca6ee3-b49c-4a0c-b125-aca184404078 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received event network-vif-plugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e7f442cb-c55e-483a-bff5-c3cb168088b3 req-69ca6ee3-b49c-4a0c-b125-aca184404078 service nova] Acquiring lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e7f442cb-c55e-483a-bff5-c3cb168088b3 req-69ca6ee3-b49c-4a0c-b125-aca184404078 service nova] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e7f442cb-c55e-483a-bff5-c3cb168088b3 req-69ca6ee3-b49c-4a0c-b125-aca184404078 service nova] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-e7f442cb-c55e-483a-bff5-c3cb168088b3 req-69ca6ee3-b49c-4a0c-b125-aca184404078 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] No waiting events found dispatching network-vif-plugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:19 user nova-compute[75571]: WARNING nova.compute.manager [req-e7f442cb-c55e-483a-bff5-c3cb168088b3 req-69ca6ee3-b49c-4a0c-b125-aca184404078 service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received unexpected event network-vif-plugged-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c for instance with vm_state active and task_state None.
Nov 28 20:14:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "4cdf5581-3412-46dc-a702-30f759bf2b05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "4cdf5581-3412-46dc-a702-30f759bf2b05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:19 user nova-compute[75571]: DEBUG nova.compute.manager [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:14:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "e902b4e2-d53e-459f-a10e-bcbba4fc2317" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "e902b4e2-d53e-459f-a10e-bcbba4fc2317" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "e902b4e2-d53e-459f-a10e-bcbba4fc2317-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "e902b4e2-d53e-459f-a10e-bcbba4fc2317-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "e902b4e2-d53e-459f-a10e-bcbba4fc2317-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:19 user nova-compute[75571]: INFO nova.compute.manager [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Terminating instance
Nov 28 20:14:19 user nova-compute[75571]: DEBUG nova.compute.manager [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:14:20 user nova-compute[75571]: INFO nova.compute.claims [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Claim successful on node user
Nov 28 20:14:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:14:20 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:14:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG nova.policy [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d747c1fd611452f8d0e6ee1b423cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ff2e349b40430a91730a22fd4a0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:20 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Instance destroyed successfully.
Nov 28 20:14:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG nova.objects.instance [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lazy-loading 'resources' on Instance uuid e902b4e2-d53e-459f-a10e-bcbba4fc2317 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:12:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2082525117',display_name='tempest-VolumesNegativeTest-instance-2082525117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2082525117',id=9,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:12:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b6bbaa4bb5b47668fa7beddd9dbcb69',ramdisk_id='',reservation_id='r-xt6mzy6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-300076032',owner_user_name='tempest-VolumesNegativeTest-300076032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:12:37Z,user_data=None,user_id='637fd3a4988b4f5cbb9507b3e850effa',uuid=e902b4e2-d53e-459f-a10e-bcbba4fc2317,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "address": "fa:16:3e:da:da:c7", "network": {"id": "55a74e7f-c346-450d-a844-21d692c92df5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a3f68630a9a04ebebd5c4eab29a79ef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eabc9ee-0a", "ovs_interfaceid": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Converting VIF {"id": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "address": "fa:16:3e:da:da:c7", "network": {"id": "55a74e7f-c346-450d-a844-21d692c92df5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a3f68630a9a04ebebd5c4eab29a79ef0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eabc9ee-0a", "ovs_interfaceid": "3eabc9ee-0a3a-48ec-8956-6036d0217183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:da:c7,bridge_name='br-int',has_traffic_filtering=True,id=3eabc9ee-0a3a-48ec-8956-6036d0217183,network=Network(55a74e7f-c346-450d-a844-21d692c92df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eabc9ee-0a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG os_vif [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:da:c7,bridge_name='br-int',has_traffic_filtering=True,id=3eabc9ee-0a3a-48ec-8956-6036d0217183,network=Network(55a74e7f-c346-450d-a844-21d692c92df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eabc9ee-0a') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:14:20 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Creating image(s)
Nov 28 20:14:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "/opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "/opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "/opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.040s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3eabc9ee-0a, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27288913-357d-45bc-8f27-aa561ea0f997) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:20 user nova-compute[75571]: INFO os_vif [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:da:c7,bridge_name='br-int',has_traffic_filtering=True,id=3eabc9ee-0a3a-48ec-8956-6036d0217183,network=Network(55a74e7f-c346-450d-a844-21d692c92df5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eabc9ee-0a')
Nov 28 20:14:20 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Deleting instance files /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317_del
Nov 28 20:14:20 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Deletion of /opt/stack/data/nova/instances/e902b4e2-d53e-459f-a10e-bcbba4fc2317_del complete
Nov 28 20:14:21 user nova-compute[75571]: INFO nova.compute.manager [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.204s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.182s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk 1073741824" returned: 0 in 0.065s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG nova.network.neutron [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Successfully created port: dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.241s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:21 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 is timed out.
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:21 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Successfully detached device vdb from instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 from the live domain config.
Nov 28 20:14:21 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Cannot resize image /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Ensure instance console log exists: /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUvJwBDn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'd1537a8f-618a-4dc3-aa95-77f77a33e2fb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:14:21 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:14:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-a937be0c-5e07-4fcf-b46b-a23ddee89955 req-5b1220ac-8523-4487-9b65-8acfcd80b30b service nova] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Received event network-vif-deleted-3eabc9ee-0a3a-48ec-8956-6036d0217183 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:21 user nova-compute[75571]: INFO nova.compute.manager [req-a937be0c-5e07-4fcf-b46b-a23ddee89955 req-5b1220ac-8523-4487-9b65-8acfcd80b30b service nova] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Neutron deleted interface 3eabc9ee-0a3a-48ec-8956-6036d0217183; detaching it from the instance and deleting it from the info cache
Nov 28 20:14:21 user nova-compute[75571]: DEBUG nova.network.neutron [req-a937be0c-5e07-4fcf-b46b-a23ddee89955 req-5b1220ac-8523-4487-9b65-8acfcd80b30b service nova] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:21 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Took 0.79 seconds to deallocate network for instance.
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d160243-6db3-4c68-a934-5f4337044490]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:14:21 user nova-compute[75571]: No targets found.
Nov 28 20:14:21 user nova-compute[75571]: iSNS:
Nov 28 20:14:21 user nova-compute[75571]: No targets found.
Nov 28 20:14:21 user nova-compute[75571]: STATIC:
Nov 28 20:14:21 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb
Nov 28 20:14:21 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:21 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:21 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72
Nov 28 20:14:21 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:14:21 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:14:21 user nova-compute[75571]: FIRMWARE:
Nov 28 20:14:21 user nova-compute[75571]: No targets found.
Nov 28 20:14:21 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:14:21 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:14:21 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-a937be0c-5e07-4fcf-b46b-a23ddee89955 req-5b1220ac-8523-4487-9b65-8acfcd80b30b service nova] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Detach interface failed, port_id=3eabc9ee-0a3a-48ec-8956-6036d0217183, reason: Instance e902b4e2-d53e-459f-a10e-bcbba4fc2317 could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9479a58-347f-41d6-9b4c-8bb6b7ea7c21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c3e544-8095-494d-9e27-596f3658dfea]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:14:21 user nova-compute[75571]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:14:21 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb (non-flash)
Nov 28 20:14:21 user nova-compute[75571]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:14:21 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7778292560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb'): ({'sdg'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Removing single pathed devices sdg {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[220d0f37-977d-4cab-aa59-0cd317de518b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[35687ca2-ee95-46fa-935a-d12f18773a54]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Flushing IO for device /dev/sdg {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3ac98f-3a22-45ef-8364-cd41d45e90d8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:14:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c1e1cf-79c0-4fff-8d35-8eef7a789581]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] SCSI volumes sdg have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bf7805-710b-4df5-bed5-a30140bf0bc8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[50977cad-41db-4e7a-84c4-6a95a8e581f1]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260]
Nov 28 20:14:22 user nova-compute[75571]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb, portal: 172.16.0.220,3260] successful.
Nov 28 20:14:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.network.neutron [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Successfully updated port: dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "refresh_cache-4cdf5581-3412-46dc-a702-30f759bf2b05" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquired lock "refresh_cache-4cdf5581-3412-46dc-a702-30f759bf2b05" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.network.neutron [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1537a8f-618a-4dc3-aa95-77f77a33e2fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c914ad-ba43-49ae-954b-e295ffe68bed]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] <== disconnect_volume: return (362ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.compute.manager [req-1f842b26-c6b8-4db3-9bd6-cd89c70263e2 req-b2e0e31d-b265-44bc-9b2b-37dae7e2f8ac service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Received event network-changed-dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.compute.manager [req-1f842b26-c6b8-4db3-9bd6-cd89c70263e2 req-b2e0e31d-b265-44bc-9b2b-37dae7e2f8ac service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Refreshing instance network info cache due to event network-changed-dabcf8a5-911a-4edb-a993-c3cbfd06d4a9. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1f842b26-c6b8-4db3-9bd6-cd89c70263e2 req-b2e0e31d-b265-44bc-9b2b-37dae7e2f8ac service nova] Acquiring lock "refresh_cache-4cdf5581-3412-46dc-a702-30f759bf2b05" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.network.neutron [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:22 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Deleted allocations for instance e902b4e2-d53e-459f-a10e-bcbba4fc2317
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "e902b4e2-d53e-459f-a10e-bcbba4fc2317" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.567s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.network.neutron [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Updating instance_info_cache with network_info: [{"id": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "address": "fa:16:3e:b3:15:52", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabcf8a5-91", "ovs_interfaceid": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Releasing lock "refresh_cache-4cdf5581-3412-46dc-a702-30f759bf2b05" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.compute.manager [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Instance network_info: |[{"id": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "address": "fa:16:3e:b3:15:52", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabcf8a5-91", "ovs_interfaceid": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1f842b26-c6b8-4db3-9bd6-cd89c70263e2 req-b2e0e31d-b265-44bc-9b2b-37dae7e2f8ac service nova] Acquired lock "refresh_cache-4cdf5581-3412-46dc-a702-30f759bf2b05" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.network.neutron [req-1f842b26-c6b8-4db3-9bd6-cd89c70263e2 req-b2e0e31d-b265-44bc-9b2b-37dae7e2f8ac service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Refreshing network info cache for port dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Start _get_guest_xml network_info=[{"id": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "address": "fa:16:3e:b3:15:52", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabcf8a5-91", "ovs_interfaceid": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:14:22 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:14:22 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:14:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1259091663',display_name='tempest-VolumesAdminNegativeTest-server-1259091663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1259091663',id=13,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63ff2e349b40430a91730a22fd4a0487',ramdisk_id='',reservation_id='r-ocw6kjrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1106730846',owner_user_name='tempest-VolumesAdminNegativeTest-1106730846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:21Z,user_data=None,user_id='0d747c1fd611452f8d0e6ee1b423cd2c',uuid=4cdf5581-3412-46dc-a702-30f759bf2b05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "address": "fa:16:3e:b3:15:52", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabcf8a5-91", "ovs_interfaceid": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Converting VIF {"id": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "address": "fa:16:3e:b3:15:52", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabcf8a5-91", "ovs_interfaceid": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:15:52,bridge_name='br-int',has_traffic_filtering=True,id=dabcf8a5-911a-4edb-a993-c3cbfd06d4a9,network=Network(3b3bc160-310f-422a-ab1d-d8090334b344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdabcf8a5-91') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.objects.instance [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cdf5581-3412-46dc-a702-30f759bf2b05 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:14:22 user nova-compute[75571]:   <uuid>4cdf5581-3412-46dc-a702-30f759bf2b05</uuid>
Nov 28 20:14:22 user nova-compute[75571]:   <name>instance-0000000d</name>
Nov 28 20:14:22 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:14:22 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:14:22 user nova-compute[75571]:   <metadata>
Nov 28 20:14:22 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:14:22 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:14:22 user nova-compute[75571]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1259091663</nova:name>
Nov 28 20:14:22 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:14:22</nova:creationTime>
Nov 28 20:14:22 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:14:22 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:14:22 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:14:22 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:14:22 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:14:22 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:14:22 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:14:22 user nova-compute[75571]:       <nova:owner>
Nov 28 20:14:22 user nova-compute[75571]:         <nova:user uuid="0d747c1fd611452f8d0e6ee1b423cd2c">tempest-VolumesAdminNegativeTest-1106730846-project-member</nova:user>
Nov 28 20:14:22 user nova-compute[75571]:         <nova:project uuid="63ff2e349b40430a91730a22fd4a0487">tempest-VolumesAdminNegativeTest-1106730846</nova:project>
Nov 28 20:14:22 user nova-compute[75571]:       </nova:owner>
Nov 28 20:14:22 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:14:22 user nova-compute[75571]:       <nova:ports>
Nov 28 20:14:22 user nova-compute[75571]:         <nova:port uuid="dabcf8a5-911a-4edb-a993-c3cbfd06d4a9">
Nov 28 20:14:22 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 20:14:22 user nova-compute[75571]:         </nova:port>
Nov 28 20:14:22 user nova-compute[75571]:       </nova:ports>
Nov 28 20:14:22 user nova-compute[75571]:     </nova:instance>
Nov 28 20:14:22 user nova-compute[75571]:   </metadata>
Nov 28 20:14:22 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:14:22 user nova-compute[75571]:     <system>
Nov 28 20:14:22 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:14:22 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:14:22 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:14:22 user nova-compute[75571]:       <entry name="serial">4cdf5581-3412-46dc-a702-30f759bf2b05</entry>
Nov 28 20:14:22 user nova-compute[75571]:       <entry name="uuid">4cdf5581-3412-46dc-a702-30f759bf2b05</entry>
Nov 28 20:14:22 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:14:22 user nova-compute[75571]:     </system>
Nov 28 20:14:22 user nova-compute[75571]:   </sysinfo>
Nov 28 20:14:22 user nova-compute[75571]:   <os>
Nov 28 20:14:22 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:14:22 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:14:22 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:14:22 user nova-compute[75571]:   </os>
Nov 28 20:14:22 user nova-compute[75571]:   <features>
Nov 28 20:14:22 user nova-compute[75571]:     <acpi/>
Nov 28 20:14:22 user nova-compute[75571]:     <apic/>
Nov 28 20:14:22 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:14:22 user nova-compute[75571]:   </features>
Nov 28 20:14:22 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:14:22 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:14:22 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:14:22 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:14:22 user nova-compute[75571]:   </clock>
Nov 28 20:14:22 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:14:22 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:14:22 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:14:22 user nova-compute[75571]:   </cpu>
Nov 28 20:14:22 user nova-compute[75571]:   <devices>
Nov 28 20:14:22 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:14:22 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:14:22 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk"/>
Nov 28 20:14:22 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:14:22 user nova-compute[75571]:     </disk>
Nov 28 20:14:22 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:14:22 user nova-compute[75571]:       <mac address="fa:16:3e:b3:15:52"/>
Nov 28 20:14:22 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:14:22 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:14:22 user nova-compute[75571]:       <target dev="tapdabcf8a5-91"/>
Nov 28 20:14:22 user nova-compute[75571]:     </interface>
Nov 28 20:14:22 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:14:22 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/console.log" append="off"/>
Nov 28 20:14:22 user nova-compute[75571]:     </serial>
Nov 28 20:14:22 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:14:22 user nova-compute[75571]:     <video>
Nov 28 20:14:22 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:14:22 user nova-compute[75571]:     </video>
Nov 28 20:14:22 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:14:22 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:14:22 user nova-compute[75571]:     </rng>
Nov 28 20:14:22 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:14:22 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:14:22 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:14:22 user nova-compute[75571]:     </memballoon>
Nov 28 20:14:22 user nova-compute[75571]:   </devices>
Nov 28 20:14:22 user nova-compute[75571]: </domain>
Nov 28 20:14:22 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:14:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1259091663',display_name='tempest-VolumesAdminNegativeTest-server-1259091663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1259091663',id=13,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63ff2e349b40430a91730a22fd4a0487',ramdisk_id='',reservation_id='r-ocw6kjrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1106730846',owner_user_name='tempest-VolumesAdminNegativeTest-1106730846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:21Z,user_data=None,user_id='0d747c1fd611452f8d0e6ee1b423cd2c',uuid=4cdf5581-3412-46dc-a702-30f759bf2b05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "address": "fa:16:3e:b3:15:52", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabcf8a5-91", "ovs_interfaceid": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Converting VIF {"id": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "address": "fa:16:3e:b3:15:52", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabcf8a5-91", "ovs_interfaceid": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:15:52,bridge_name='br-int',has_traffic_filtering=True,id=dabcf8a5-911a-4edb-a993-c3cbfd06d4a9,network=Network(3b3bc160-310f-422a-ab1d-d8090334b344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdabcf8a5-91') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG os_vif [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:15:52,bridge_name='br-int',has_traffic_filtering=True,id=dabcf8a5-911a-4edb-a993-c3cbfd06d4a9,network=Network(3b3bc160-310f-422a-ab1d-d8090334b344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdabcf8a5-91') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b2dbf0f-8749-5f45-8f2f-90944ca7a112', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdabcf8a5-91, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdabcf8a5-91, col_values=(('qos', UUID('b7eded09-d6f6-4726-a92f-d1eb8022b57b')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdabcf8a5-91, col_values=(('external_ids', {'iface-id': 'dabcf8a5-911a-4edb-a993-c3cbfd06d4a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:15:52', 'vm-uuid': '4cdf5581-3412-46dc-a702-30f759bf2b05'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:22 user nova-compute[75571]: INFO os_vif [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:15:52,bridge_name='br-int',has_traffic_filtering=True,id=dabcf8a5-911a-4edb-a993-c3cbfd06d4a9,network=Network(3b3bc160-310f-422a-ab1d-d8090334b344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdabcf8a5-91')
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:14:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] No VIF found with MAC fa:16:3e:b3:15:52, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:14:23 user nova-compute[75571]: DEBUG nova.network.neutron [req-1f842b26-c6b8-4db3-9bd6-cd89c70263e2 req-b2e0e31d-b265-44bc-9b2b-37dae7e2f8ac service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Updated VIF entry in instance network info cache for port dabcf8a5-911a-4edb-a993-c3cbfd06d4a9. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:14:23 user nova-compute[75571]: DEBUG nova.network.neutron [req-1f842b26-c6b8-4db3-9bd6-cd89c70263e2 req-b2e0e31d-b265-44bc-9b2b-37dae7e2f8ac service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Updating instance_info_cache with network_info: [{"id": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "address": "fa:16:3e:b3:15:52", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabcf8a5-91", "ovs_interfaceid": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1f842b26-c6b8-4db3-9bd6-cd89c70263e2 req-b2e0e31d-b265-44bc-9b2b-37dae7e2f8ac service nova] Releasing lock "refresh_cache-4cdf5581-3412-46dc-a702-30f759bf2b05" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:14:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:24 user nova-compute[75571]: DEBUG nova.compute.manager [req-753681c3-023f-47e2-be47-523c6f54acfd req-a51c2378-8c22-403f-bfa3-b9edd2faed77 service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Received event network-vif-plugged-dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-753681c3-023f-47e2-be47-523c6f54acfd req-a51c2378-8c22-403f-bfa3-b9edd2faed77 service nova] Acquiring lock "4cdf5581-3412-46dc-a702-30f759bf2b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-753681c3-023f-47e2-be47-523c6f54acfd req-a51c2378-8c22-403f-bfa3-b9edd2faed77 service nova] Lock "4cdf5581-3412-46dc-a702-30f759bf2b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-753681c3-023f-47e2-be47-523c6f54acfd req-a51c2378-8c22-403f-bfa3-b9edd2faed77 service nova] Lock "4cdf5581-3412-46dc-a702-30f759bf2b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:24 user nova-compute[75571]: DEBUG nova.compute.manager [req-753681c3-023f-47e2-be47-523c6f54acfd req-a51c2378-8c22-403f-bfa3-b9edd2faed77 service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] No waiting events found dispatching network-vif-plugged-dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:24 user nova-compute[75571]: WARNING nova.compute.manager [req-753681c3-023f-47e2-be47-523c6f54acfd req-a51c2378-8c22-403f-bfa3-b9edd2faed77 service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Received unexpected event network-vif-plugged-dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 for instance with vm_state building and task_state spawning.
Nov 28 20:14:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:24 user nova-compute[75571]: DEBUG nova.objects.instance [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lazy-loading 'flavor' on Instance uuid a3084b80-68e5-44f6-b87d-4f7ad6b31756 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:14:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.803s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-d99da8a9-adcc-4a1f-9730-40870ab30e2e req-38340049-8a7f-4938-9a08-126cf641211c service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Received event network-vif-plugged-dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d99da8a9-adcc-4a1f-9730-40870ab30e2e req-38340049-8a7f-4938-9a08-126cf641211c service nova] Acquiring lock "4cdf5581-3412-46dc-a702-30f759bf2b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d99da8a9-adcc-4a1f-9730-40870ab30e2e req-38340049-8a7f-4938-9a08-126cf641211c service nova] Lock "4cdf5581-3412-46dc-a702-30f759bf2b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d99da8a9-adcc-4a1f-9730-40870ab30e2e req-38340049-8a7f-4938-9a08-126cf641211c service nova] Lock "4cdf5581-3412-46dc-a702-30f759bf2b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-d99da8a9-adcc-4a1f-9730-40870ab30e2e req-38340049-8a7f-4938-9a08-126cf641211c service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] No waiting events found dispatching network-vif-plugged-dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:26 user nova-compute[75571]: WARNING nova.compute.manager [req-d99da8a9-adcc-4a1f-9730-40870ab30e2e req-38340049-8a7f-4938-9a08-126cf641211c service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Received unexpected event network-vif-plugged-dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 for instance with vm_state building and task_state spawning.
Nov 28 20:14:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:14:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:14:26 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Instance spawned successfully.
Nov 28 20:14:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:14:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:14:26 user nova-compute[75571]: INFO nova.compute.manager [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 28 20:14:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:14:26 user nova-compute[75571]: INFO nova.compute.manager [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Took 6.85 seconds to build instance.
Nov 28 20:14:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "4cdf5581-3412-46dc-a702-30f759bf2b05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.970s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:34 user nova-compute[75571]: INFO nova.compute.manager [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Terminating instance
Nov 28 20:14:34 user nova-compute[75571]: DEBUG nova.compute.manager [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-cf19fc26-18e1-45ae-9475-64b5872052b7 req-ec934d14-7c23-4af8-86aa-635122d3e0a0 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Received event network-vif-unplugged-a1d9020e-bbea-4ca9-8cc9-e4c684b47aac {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cf19fc26-18e1-45ae-9475-64b5872052b7 req-ec934d14-7c23-4af8-86aa-635122d3e0a0 service nova] Acquiring lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cf19fc26-18e1-45ae-9475-64b5872052b7 req-ec934d14-7c23-4af8-86aa-635122d3e0a0 service nova] Lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cf19fc26-18e1-45ae-9475-64b5872052b7 req-ec934d14-7c23-4af8-86aa-635122d3e0a0 service nova] Lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-cf19fc26-18e1-45ae-9475-64b5872052b7 req-ec934d14-7c23-4af8-86aa-635122d3e0a0 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] No waiting events found dispatching network-vif-unplugged-a1d9020e-bbea-4ca9-8cc9-e4c684b47aac {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-cf19fc26-18e1-45ae-9475-64b5872052b7 req-ec934d14-7c23-4af8-86aa-635122d3e0a0 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Received event network-vif-unplugged-a1d9020e-bbea-4ca9-8cc9-e4c684b47aac for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "415392e8-bf6c-433e-a4f5-be3d99419710" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "415392e8-bf6c-433e-a4f5-be3d99419710" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "415392e8-bf6c-433e-a4f5-be3d99419710-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "415392e8-bf6c-433e-a4f5-be3d99419710-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "415392e8-bf6c-433e-a4f5-be3d99419710-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:35 user nova-compute[75571]: INFO nova.compute.manager [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Terminating instance
Nov 28 20:14:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:14:35 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Instance destroyed successfully.
Nov 28 20:14:35 user nova-compute[75571]: DEBUG nova.objects.instance [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lazy-loading 'resources' on Instance uuid 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1829120743',display_name='tempest-VolumesActionsTest-instance-1829120743',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1829120743',id=10,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:12:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bed5b9f19e584ca5bd8bf2d75b5ee765',ramdisk_id='',reservation_id='r-9lp7rtx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1803837223',owner_user_name='tempest-VolumesActionsTest-1803837223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:12:52Z,user_data=None,user_id='854e01c9d8d644299bbf6b9a18e00fcd',uuid=8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "address": "fa:16:3e:b1:1f:b2", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d9020e-bb", "ovs_interfaceid": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Converting VIF {"id": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "address": "fa:16:3e:b1:1f:b2", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d9020e-bb", "ovs_interfaceid": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a1d9020e-bbea-4ca9-8cc9-e4c684b47aac,network=Network(00de1a40-1743-4c1d-a032-0ae863c7e009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d9020e-bb') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG os_vif [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a1d9020e-bbea-4ca9-8cc9-e4c684b47aac,network=Network(00de1a40-1743-4c1d-a032-0ae863c7e009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d9020e-bb') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1d9020e-bb, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae706a84-7962-44d3-92fe-b7255d905270) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:35 user nova-compute[75571]: INFO os_vif [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a1d9020e-bbea-4ca9-8cc9-e4c684b47aac,network=Network(00de1a40-1743-4c1d-a032-0ae863c7e009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d9020e-bb')
Nov 28 20:14:35 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Deleting instance files /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6_del
Nov 28 20:14:35 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Deletion of /opt/stack/data/nova/instances/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6_del complete
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:35 user nova-compute[75571]: INFO nova.compute.manager [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 20:14:35 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG nova.compute.manager [req-3134ce34-4316-4dcc-b8b3-6ade8ef35ee7 req-a3b435d8-eea0-4047-9ffa-692b805e8b12 service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Received event network-vif-unplugged-317f4a0e-b709-4696-9a61-0c8067789331 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3134ce34-4316-4dcc-b8b3-6ade8ef35ee7 req-a3b435d8-eea0-4047-9ffa-692b805e8b12 service nova] Acquiring lock "415392e8-bf6c-433e-a4f5-be3d99419710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3134ce34-4316-4dcc-b8b3-6ade8ef35ee7 req-a3b435d8-eea0-4047-9ffa-692b805e8b12 service nova] Lock "415392e8-bf6c-433e-a4f5-be3d99419710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3134ce34-4316-4dcc-b8b3-6ade8ef35ee7 req-a3b435d8-eea0-4047-9ffa-692b805e8b12 service nova] Lock "415392e8-bf6c-433e-a4f5-be3d99419710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG nova.compute.manager [req-3134ce34-4316-4dcc-b8b3-6ade8ef35ee7 req-a3b435d8-eea0-4047-9ffa-692b805e8b12 service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] No waiting events found dispatching network-vif-unplugged-317f4a0e-b709-4696-9a61-0c8067789331 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG nova.compute.manager [req-3134ce34-4316-4dcc-b8b3-6ade8ef35ee7 req-a3b435d8-eea0-4047-9ffa-692b805e8b12 service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Received event network-vif-unplugged-317f4a0e-b709-4696-9a61-0c8067789331 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:36 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Took 0.61 seconds to deallocate network for instance.
Nov 28 20:14:36 user nova-compute[75571]: DEBUG nova.compute.manager [req-a3e047db-f74e-4e8b-8cd2-52b5c235222d req-8672fcf0-05fa-4a5a-bb66-54645ce7fd95 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Received event network-vif-deleted-a1d9020e-bbea-4ca9-8cc9-e4c684b47aac {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:36 user nova-compute[75571]: INFO nova.compute.manager [req-a3e047db-f74e-4e8b-8cd2-52b5c235222d req-8672fcf0-05fa-4a5a-bb66-54645ce7fd95 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Neutron deleted interface a1d9020e-bbea-4ca9-8cc9-e4c684b47aac; detaching it from the instance and deleting it from the info cache
Nov 28 20:14:36 user nova-compute[75571]: DEBUG nova.network.neutron [req-a3e047db-f74e-4e8b-8cd2-52b5c235222d req-8672fcf0-05fa-4a5a-bb66-54645ce7fd95 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG nova.compute.manager [req-a3e047db-f74e-4e8b-8cd2-52b5c235222d req-8672fcf0-05fa-4a5a-bb66-54645ce7fd95 service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Detach interface failed, port_id=a1d9020e-bbea-4ca9-8cc9-e4c684b47aac, reason: Instance 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:14:36 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Instance destroyed successfully.
Nov 28 20:14:36 user nova-compute[75571]: DEBUG nova.objects.instance [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lazy-loading 'resources' on Instance uuid 415392e8-bf6c-433e-a4f5-be3d99419710 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-42165751',display_name='tempest-VolumesAssistedSnapshotsTest-server-42165751',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-42165751',id=6,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG6Xb2b289i94kzq7mRKEPfFFFiPwMG1Ax8zd+3NfUydS8o64GAfxeGZLhx6dUt1q6V5b8gVKa4LMu8Qe11Hu8MDVA+VA1GLE3Pw67neyU87X6frDyM9AaWBV48vqdSfw==',key_name='tempest-keypair-448215708',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:11:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16b1448d67fd4c94a0d1374ed792b428',ramdisk_id='',reservation_id='r-3mfm29ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1397496501',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1397496501-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac5d0e5911d94f0c96e5065db9729740',uuid=415392e8-bf6c-433e-a4f5-be3d99419710,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "317f4a0e-b709-4696-9a61-0c8067789331", "address": "fa:16:3e:d0:dd:5e", "network": {"id": "af31f11d-7ec4-4cc7-b346-0acf29157d15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-444410556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b1448d67fd4c94a0d1374ed792b428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f4a0e-b7", "ovs_interfaceid": "317f4a0e-b709-4696-9a61-0c8067789331", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Converting VIF {"id": "317f4a0e-b709-4696-9a61-0c8067789331", "address": "fa:16:3e:d0:dd:5e", "network": {"id": "af31f11d-7ec4-4cc7-b346-0acf29157d15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-444410556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b1448d67fd4c94a0d1374ed792b428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap317f4a0e-b7", "ovs_interfaceid": "317f4a0e-b709-4696-9a61-0c8067789331", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=317f4a0e-b709-4696-9a61-0c8067789331,network=Network(af31f11d-7ec4-4cc7-b346-0acf29157d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317f4a0e-b7') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG os_vif [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=317f4a0e-b709-4696-9a61-0c8067789331,network=Network(af31f11d-7ec4-4cc7-b346-0acf29157d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317f4a0e-b7') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap317f4a0e-b7, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=101b4e8e-b2cd-45f7-a98e-7ec0cda32971) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:36 user nova-compute[75571]: INFO os_vif [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=317f4a0e-b709-4696-9a61-0c8067789331,network=Network(af31f11d-7ec4-4cc7-b346-0acf29157d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317f4a0e-b7')
Nov 28 20:14:36 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Deleting instance files /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710_del
Nov 28 20:14:36 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Deletion of /opt/stack/data/nova/instances/415392e8-bf6c-433e-a4f5-be3d99419710_del complete
Nov 28 20:14:36 user nova-compute[75571]: INFO nova.compute.manager [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 28 20:14:36 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:14:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:37 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Deleted allocations for instance 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6
Nov 28 20:14:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.179s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:37 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:37 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Took 0.75 seconds to deallocate network for instance.
Nov 28 20:14:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-5981c030-770a-4a20-ba3d-593026ed4db6 req-372a2db7-7259-46ea-81af-df141f19f76c service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Received event network-vif-plugged-a1d9020e-bbea-4ca9-8cc9-e4c684b47aac {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5981c030-770a-4a20-ba3d-593026ed4db6 req-372a2db7-7259-46ea-81af-df141f19f76c service nova] Acquiring lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5981c030-770a-4a20-ba3d-593026ed4db6 req-372a2db7-7259-46ea-81af-df141f19f76c service nova] Lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5981c030-770a-4a20-ba3d-593026ed4db6 req-372a2db7-7259-46ea-81af-df141f19f76c service nova] Lock "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-5981c030-770a-4a20-ba3d-593026ed4db6 req-372a2db7-7259-46ea-81af-df141f19f76c service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] No waiting events found dispatching network-vif-plugged-a1d9020e-bbea-4ca9-8cc9-e4c684b47aac {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:37 user nova-compute[75571]: WARNING nova.compute.manager [req-5981c030-770a-4a20-ba3d-593026ed4db6 req-372a2db7-7259-46ea-81af-df141f19f76c service nova] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Received unexpected event network-vif-plugged-a1d9020e-bbea-4ca9-8cc9-e4c684b47aac for instance with vm_state deleted and task_state None.
Nov 28 20:14:37 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:14:37 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:14:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:37 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Deleted allocations for instance 415392e8-bf6c-433e-a4f5-be3d99419710
Nov 28 20:14:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "415392e8-bf6c-433e-a4f5-be3d99419710" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.352s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:38 user nova-compute[75571]: DEBUG nova.compute.manager [req-e1d67a64-9c18-4b75-83a6-8c7b9c584acd req-335677cd-fb8c-48ae-8801-0d9544fa6030 service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Received event network-vif-plugged-317f4a0e-b709-4696-9a61-0c8067789331 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e1d67a64-9c18-4b75-83a6-8c7b9c584acd req-335677cd-fb8c-48ae-8801-0d9544fa6030 service nova] Acquiring lock "415392e8-bf6c-433e-a4f5-be3d99419710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e1d67a64-9c18-4b75-83a6-8c7b9c584acd req-335677cd-fb8c-48ae-8801-0d9544fa6030 service nova] Lock "415392e8-bf6c-433e-a4f5-be3d99419710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e1d67a64-9c18-4b75-83a6-8c7b9c584acd req-335677cd-fb8c-48ae-8801-0d9544fa6030 service nova] Lock "415392e8-bf6c-433e-a4f5-be3d99419710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:38 user nova-compute[75571]: DEBUG nova.compute.manager [req-e1d67a64-9c18-4b75-83a6-8c7b9c584acd req-335677cd-fb8c-48ae-8801-0d9544fa6030 service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] No waiting events found dispatching network-vif-plugged-317f4a0e-b709-4696-9a61-0c8067789331 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:38 user nova-compute[75571]: WARNING nova.compute.manager [req-e1d67a64-9c18-4b75-83a6-8c7b9c584acd req-335677cd-fb8c-48ae-8801-0d9544fa6030 service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Received unexpected event network-vif-plugged-317f4a0e-b709-4696-9a61-0c8067789331 for instance with vm_state deleted and task_state None.
Nov 28 20:14:38 user nova-compute[75571]: DEBUG nova.compute.manager [req-4e83fca1-fe8a-4123-a85a-5c60fa8775a0 req-11933fd1-102e-479a-ab31-c6cdc94224fe service nova] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Received event network-vif-deleted-317f4a0e-b709-4696-9a61-0c8067789331 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:14:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:14:41 user nova-compute[75571]: INFO nova.compute.claims [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Claim successful on node user
Nov 28 20:14:42 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.321s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:14:42 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:14:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:14:42 user nova-compute[75571]: INFO nova.virt.block_device [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Booting with volume 037b5b30-bff1-4d62-b6b5-21a93e3891a4 at /dev/vda
Nov 28 20:14:42 user nova-compute[75571]: DEBUG os_brick.utils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d044191-b04b-499e-bae5-b216c43883f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG nova.policy [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd826645c8f4f4ce7bb0cf606d9005ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573c587fe3af43a5a01c4e5db0643075', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e072e35-bd80-410f-8a5a-94624e19cf93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3259ef36-3a35-4d26-83a6-1ca4d87544be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[151084df-785a-4582-8a2a-5723429606ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:14:42 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:14:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[06981bac-858a-4ccf-bd42-c9931c5ba1e9]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG os_brick.utils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:14:42 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating existing volume attachment record: 12e63b79-03f5-414e-8aa7-c426325405c5 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:14:43 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Successfully created port: 00fac4f4-969a-449b-a264-4d1ce345c3b6 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:14:43 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Successfully created port: 90cdd786-4498-4e1d-8eff-7407674beb52 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:14:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:44 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Successfully created port: 78aeb66d-2196-43e4-80fb-ffbf4559d29f {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:14:44 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Successfully created port: dec8aa66-f6b6-4e5a-b055-c6321063f024 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:14:45 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Successfully created port: 5923f2c1-af01-4178-8faf-143583adb2d9 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:14:45 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Successfully updated port: 00fac4f4-969a-449b-a264-4d1ce345c3b6 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:14:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-52e4df1c-79e0-4697-aacc-cfe6c3db3454 req-13752ff5-472a-4d3c-a8e3-dca88db715c4 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-changed-00fac4f4-969a-449b-a264-4d1ce345c3b6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-52e4df1c-79e0-4697-aacc-cfe6c3db3454 req-13752ff5-472a-4d3c-a8e3-dca88db715c4 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing instance network info cache due to event network-changed-00fac4f4-969a-449b-a264-4d1ce345c3b6. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:14:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-52e4df1c-79e0-4697-aacc-cfe6c3db3454 req-13752ff5-472a-4d3c-a8e3-dca88db715c4 service nova] Acquiring lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:14:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-52e4df1c-79e0-4697-aacc-cfe6c3db3454 req-13752ff5-472a-4d3c-a8e3-dca88db715c4 service nova] Acquired lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:14:45 user nova-compute[75571]: DEBUG nova.network.neutron [req-52e4df1c-79e0-4697-aacc-cfe6c3db3454 req-13752ff5-472a-4d3c-a8e3-dca88db715c4 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing network info cache for port 00fac4f4-969a-449b-a264-4d1ce345c3b6 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:14:46 user nova-compute[75571]: DEBUG nova.network.neutron [req-52e4df1c-79e0-4697-aacc-cfe6c3db3454 req-13752ff5-472a-4d3c-a8e3-dca88db715c4 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:14:46 user nova-compute[75571]: DEBUG nova.network.neutron [req-52e4df1c-79e0-4697-aacc-cfe6c3db3454 req-13752ff5-472a-4d3c-a8e3-dca88db715c4 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-52e4df1c-79e0-4697-aacc-cfe6c3db3454 req-13752ff5-472a-4d3c-a8e3-dca88db715c4 service nova] Releasing lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:14:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Successfully updated port: 13d2eb0a-77c7-4db6-96c1-547dc7781057 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:14:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:47 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Successfully updated port: 2eb26bff-1c84-413b-b3b4-fbc18940f912 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:14:47 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Successfully updated port: 90cdd786-4498-4e1d-8eff-7407674beb52 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-changed-13d2eb0a-77c7-4db6-96c1-547dc7781057 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing instance network info cache due to event network-changed-13d2eb0a-77c7-4db6-96c1-547dc7781057. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Acquiring lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Acquired lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing network info cache for port 13d2eb0a-77c7-4db6-96c1-547dc7781057 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Releasing lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-changed-2eb26bff-1c84-413b-b3b4-fbc18940f912 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing instance network info cache due to event network-changed-2eb26bff-1c84-413b-b3b4-fbc18940f912. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Acquiring lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Acquired lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing network info cache for port 2eb26bff-1c84-413b-b3b4-fbc18940f912 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Releasing lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-changed-90cdd786-4498-4e1d-8eff-7407674beb52 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing instance network info cache due to event network-changed-90cdd786-4498-4e1d-8eff-7407674beb52. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Acquiring lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Acquired lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing network info cache for port 90cdd786-4498-4e1d-8eff-7407674beb52 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Successfully updated port: 78aeb66d-2196-43e4-80fb-ffbf4559d29f {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-61cb48ef-0184-4f67-822c-3d2842869fc4 req-c8647dcf-6689-4f00-9010-dc6a68bc4a73 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-changed-78aeb66d-2196-43e4-80fb-ffbf4559d29f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-61cb48ef-0184-4f67-822c-3d2842869fc4 req-c8647dcf-6689-4f00-9010-dc6a68bc4a73 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing instance network info cache due to event network-changed-78aeb66d-2196-43e4-80fb-ffbf4559d29f. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:14:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-61cb48ef-0184-4f67-822c-3d2842869fc4 req-c8647dcf-6689-4f00-9010-dc6a68bc4a73 service nova] Acquiring lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:14:49 user nova-compute[75571]: DEBUG nova.network.neutron [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Releasing lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:14:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-61cb48ef-0184-4f67-822c-3d2842869fc4 req-c8647dcf-6689-4f00-9010-dc6a68bc4a73 service nova] Acquired lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:14:49 user nova-compute[75571]: DEBUG nova.network.neutron [req-61cb48ef-0184-4f67-822c-3d2842869fc4 req-c8647dcf-6689-4f00-9010-dc6a68bc4a73 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing network info cache for port 78aeb66d-2196-43e4-80fb-ffbf4559d29f {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:14:49 user nova-compute[75571]: DEBUG nova.network.neutron [req-61cb48ef-0184-4f67-822c-3d2842869fc4 req-c8647dcf-6689-4f00-9010-dc6a68bc4a73 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:14:49 user nova-compute[75571]: DEBUG nova.network.neutron [req-61cb48ef-0184-4f67-822c-3d2842869fc4 req-c8647dcf-6689-4f00-9010-dc6a68bc4a73 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-61cb48ef-0184-4f67-822c-3d2842869fc4 req-c8647dcf-6689-4f00-9010-dc6a68bc4a73 service nova] Releasing lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:14:49 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Successfully updated port: dec8aa66-f6b6-4e5a-b055-c6321063f024 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:50 user nova-compute[75571]: INFO nova.virt.block_device [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Booting with volume 4d17e45e-920e-43e3-a502-1047571c3c0a at /dev/vdb
Nov 28 20:14:50 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Successfully updated port: 5923f2c1-af01-4178-8faf-143583adb2d9 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG os_brick.utils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquired lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f5b270-34ba-4fc7-b6d6-ad1fad9fb46f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[02197e96-0411-4635-a585-b8a3ab12e8e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3515fa64-1b25-482a-abf7-55d466b0e6c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac08b599-4bc9-4eeb-afc9-6b5d3be1dbcb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:14:50 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:14:50 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da379cc-1026-4fcd-888b-587a1b169ca1]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG os_brick.utils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating existing volume attachment record: 78f591e6-185f-4eaf-a8ee-cfaa1c96a407 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:14:50 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG nova.compute.manager [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-changed-dec8aa66-f6b6-4e5a-b055-c6321063f024 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG nova.compute.manager [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing instance network info cache due to event network-changed-dec8aa66-f6b6-4e5a-b055-c6321063f024. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] Acquiring lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:51 user nova-compute[75571]: INFO nova.compute.manager [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Terminating instance
Nov 28 20:14:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG nova.compute.manager [req-759d17c6-9a0b-411d-a0ea-27e2e82d49cb req-322934e6-b3ed-4d18-ace2-3937b86043b2 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received event network-changed-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG nova.compute.manager [req-759d17c6-9a0b-411d-a0ea-27e2e82d49cb req-322934e6-b3ed-4d18-ace2-3937b86043b2 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Refreshing instance network info cache due to event network-changed-11217ca7-1cb1-404d-8a7c-a8a33ff80098. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-759d17c6-9a0b-411d-a0ea-27e2e82d49cb req-322934e6-b3ed-4d18-ace2-3937b86043b2 service nova] Acquiring lock "refresh_cache-a8112c4a-cb42-49df-81a7-97b42f5cc87d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-759d17c6-9a0b-411d-a0ea-27e2e82d49cb req-322934e6-b3ed-4d18-ace2-3937b86043b2 service nova] Acquired lock "refresh_cache-a8112c4a-cb42-49df-81a7-97b42f5cc87d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG nova.network.neutron [req-759d17c6-9a0b-411d-a0ea-27e2e82d49cb req-322934e6-b3ed-4d18-ace2-3937b86043b2 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Refreshing network info cache for port 11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:14:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.network.neutron [req-759d17c6-9a0b-411d-a0ea-27e2e82d49cb req-322934e6-b3ed-4d18-ace2-3937b86043b2 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Updated VIF entry in instance network info cache for port 11217ca7-1cb1-404d-8a7c-a8a33ff80098. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.network.neutron [req-759d17c6-9a0b-411d-a0ea-27e2e82d49cb req-322934e6-b3ed-4d18-ace2-3937b86043b2 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Updating instance_info_cache with network_info: [{"id": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "address": "fa:16:3e:f7:a3:4b", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11217ca7-1c", "ovs_interfaceid": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-759d17c6-9a0b-411d-a0ea-27e2e82d49cb req-322934e6-b3ed-4d18-ace2-3937b86043b2 service nova] Releasing lock "refresh_cache-a8112c4a-cb42-49df-81a7-97b42f5cc87d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.objects.instance [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lazy-loading 'flavor' on Instance uuid a8112c4a-cb42-49df-81a7-97b42f5cc87d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:52 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Instance destroyed successfully.
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.objects.instance [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lazy-loading 'resources' on Instance uuid a3084b80-68e5-44f6-b87d-4f7ad6b31756 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1477944076',display_name='tempest-TestVolumeSwap-server-1477944076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1477944076',id=5,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8qccgJ5L8n2VbmiZBJmXIcygNAyfnrvdVnhom0xN/KuMQ/b/tRiFbGabtnWwx5S33ukRea3zF/Z2zg9/+kWuwckhkbdQ/DMvabwXKP+5ly21Od6ocu0Es/N0ywrUvRAA==',key_name='tempest-keypair-1029990611',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:11:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f356c386b1804c90ad27fd57bf6961ce',ramdisk_id='',reservation_id='r-tf9tgnu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2014144021',owner_user_name='tempest-TestVolumeSwap-2014144021-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c5dbb5a65014af3b72843ad4fccd06f',uuid=a3084b80-68e5-44f6-b87d-4f7ad6b31756,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "address": "fa:16:3e:a2:d7:f5", "network": {"id": "3c7d9d10-c298-4672-8ae8-c59553384435", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1579611606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f356c386b1804c90ad27fd57bf6961ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec42ed1-ea", "ovs_interfaceid": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Converting VIF {"id": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "address": "fa:16:3e:a2:d7:f5", "network": {"id": "3c7d9d10-c298-4672-8ae8-c59553384435", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1579611606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f356c386b1804c90ad27fd57bf6961ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ec42ed1-ea", "ovs_interfaceid": "6ec42ed1-ea9b-462e-b695-22222a022c1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:d7:f5,bridge_name='br-int',has_traffic_filtering=True,id=6ec42ed1-ea9b-462e-b695-22222a022c1d,network=Network(3c7d9d10-c298-4672-8ae8-c59553384435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ec42ed1-ea') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG os_vif [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:d7:f5,bridge_name='br-int',has_traffic_filtering=True,id=6ec42ed1-ea9b-462e-b695-22222a022c1d,network=Network(3c7d9d10-c298-4672-8ae8-c59553384435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ec42ed1-ea') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ec42ed1-ea, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70c5c99b-3606-4948-8d2b-fa8737e3beba) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:52 user nova-compute[75571]: INFO os_vif [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:d7:f5,bridge_name='br-int',has_traffic_filtering=True,id=6ec42ed1-ea9b-462e-b695-22222a022c1d,network=Network(3c7d9d10-c298-4672-8ae8-c59553384435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ec42ed1-ea')
Nov 28 20:14:52 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Deleting instance files /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756_del
Nov 28 20:14:52 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Deletion of /opt/stack/data/nova/instances/a3084b80-68e5-44f6-b87d-4f7ad6b31756_del complete
Nov 28 20:14:52 user nova-compute[75571]: INFO nova.compute.manager [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating instance_info_cache with network_info: [{"id": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "address": "fa:16:3e:de:65:0c", "network": {"id": "f4277af4-8e9c-4147-9ca9-2cf286d9de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-271277689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fac4f4-96", "ovs_interfaceid": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "90cdd786-4498-4e1d-8eff-7407674beb52", "address": "fa:16:3e:e3:38:55", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdd786-44", "ovs_interfaceid": "90cdd786-4498-4e1d-8eff-7407674beb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "address": "fa:16:3e:46:26:0d", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78aeb66d-21", "ovs_interfaceid": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "address": "fa:16:3e:59:92:9e", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec8aa66-f6", "ovs_interfaceid": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:52 user nova-compute[75571]: INFO nova.compute.manager [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Attaching volume 55971858-8dd0-45f6-ba68-a481db871e91 to /dev/vdb
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Releasing lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.compute.manager [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Instance network_info: |[{"id": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "address": "fa:16:3e:de:65:0c", "network": {"id": "f4277af4-8e9c-4147-9ca9-2cf286d9de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-271277689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fac4f4-96", "ovs_interfaceid": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "90cdd786-4498-4e1d-8eff-7407674beb52", "address": "fa:16:3e:e3:38:55", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdd786-44", "ovs_interfaceid": "90cdd786-4498-4e1d-8eff-7407674beb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "address": "fa:16:3e:46:26:0d", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78aeb66d-21", "ovs_interfaceid": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "address": "fa:16:3e:59:92:9e", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec8aa66-f6", "ovs_interfaceid": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] Acquired lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.network.neutron [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing network info cache for port dec8aa66-f6b6-4e5a-b055-c6321063f024 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG os_brick.utils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1a5a5a-4409-4908-9017-994905cbaa0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[20285e9d-fea4-4e9a-8175-59d901f98c43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e499640-3044-44d9-a3a0-2d02c810a5dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bc12e7-5613-4a62-928b-7e560af5c341]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:14:52 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8645dc8-871f-47ae-a05f-17893d21e260]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG os_brick.utils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Updating existing volume attachment record: 0b26f60a-b771-4aa7-b729-3ee376f561a9 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.network.neutron [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updated VIF entry in instance network info cache for port dec8aa66-f6b6-4e5a-b055-c6321063f024. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.network.neutron [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating instance_info_cache with network_info: [{"id": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "address": "fa:16:3e:de:65:0c", "network": {"id": "f4277af4-8e9c-4147-9ca9-2cf286d9de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-271277689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fac4f4-96", "ovs_interfaceid": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "90cdd786-4498-4e1d-8eff-7407674beb52", "address": "fa:16:3e:e3:38:55", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdd786-44", "ovs_interfaceid": "90cdd786-4498-4e1d-8eff-7407674beb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "address": "fa:16:3e:46:26:0d", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78aeb66d-21", "ovs_interfaceid": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "address": "fa:16:3e:59:92:9e", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec8aa66-f6", "ovs_interfaceid": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] Releasing lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.compute.manager [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-changed-5923f2c1-af01-4178-8faf-143583adb2d9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.compute.manager [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing instance network info cache due to event network-changed-5923f2c1-af01-4178-8faf-143583adb2d9. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] Acquiring lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] Acquired lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:14:52 user nova-compute[75571]: DEBUG nova.network.neutron [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing network info cache for port 5923f2c1-af01-4178-8faf-143583adb2d9 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG nova.compute.manager [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Received event network-vif-unplugged-6ec42ed1-ea9b-462e-b695-22222a022c1d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] Acquiring lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG nova.compute.manager [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] No waiting events found dispatching network-vif-unplugged-6ec42ed1-ea9b-462e-b695-22222a022c1d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG nova.compute.manager [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Received event network-vif-unplugged-6ec42ed1-ea9b-462e-b695-22222a022c1d for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG nova.compute.manager [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Received event network-vif-plugged-6ec42ed1-ea9b-462e-b695-22222a022c1d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] Acquiring lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG nova.compute.manager [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] No waiting events found dispatching network-vif-plugged-6ec42ed1-ea9b-462e-b695-22222a022c1d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:14:53 user nova-compute[75571]: WARNING nova.compute.manager [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Received unexpected event network-vif-plugged-6ec42ed1-ea9b-462e-b695-22222a022c1d for instance with vm_state active and task_state deleting.
Nov 28 20:14:53 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:53 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Took 0.74 seconds to deallocate network for instance.
Nov 28 20:14:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG nova.network.neutron [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updated VIF entry in instance network info cache for port 5923f2c1-af01-4178-8faf-143583adb2d9. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG nova.network.neutron [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating instance_info_cache with network_info: [{"id": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "address": "fa:16:3e:de:65:0c", "network": {"id": "f4277af4-8e9c-4147-9ca9-2cf286d9de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-271277689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fac4f4-96", "ovs_interfaceid": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "90cdd786-4498-4e1d-8eff-7407674beb52", "address": "fa:16:3e:e3:38:55", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdd786-44", "ovs_interfaceid": "90cdd786-4498-4e1d-8eff-7407674beb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "address": "fa:16:3e:46:26:0d", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78aeb66d-21", "ovs_interfaceid": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "address": "fa:16:3e:59:92:9e", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec8aa66-f6", "ovs_interfaceid": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] Releasing lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:53 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Deleted allocations for instance a3084b80-68e5-44f6-b87d-4f7ad6b31756
Nov 28 20:14:53 user nova-compute[75571]: DEBUG nova.compute.manager [req-6696d2b7-b336-401f-b94b-eb9ca30ac761 req-bfdd94d8-8bd1-497a-9ad8-dfa685bae38c service nova] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Received event network-vif-deleted-6ec42ed1-ea9b-462e-b695-22222a022c1d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:14:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "a3084b80-68e5-44f6-b87d-4f7ad6b31756" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.264s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:14:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:14:58 user nova-compute[75571]: INFO nova.virt.block_device [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Booting with volume 24f35406-cae5-4853-b197-f772e12de0b3 at /dev/vdc
Nov 28 20:14:58 user nova-compute[75571]: DEBUG os_brick.utils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a7dfd7-92d2-4558-ad4e-8c95f87b7b77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a129cdaf-8577-43f2-a6ff-9099a2d7c5ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b9d823-c218-478f-86aa-812dc8a1e94a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff330e63-86f4-4917-bda8-206bcbff01c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:14:58 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:14:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8a3ac5-37d8-459b-aa90-1f23d63615ba]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG os_brick.utils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating existing volume attachment record: beaf0b70-d401-4649-b61c-d2e780e286eb {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:14:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bfvnHdNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:15:00 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:15:00 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:15:00 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e057d331-602a-4e90-a34c-02b872b1a2d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:15:00 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3417604b-5d49-4430-ab27-97aa45c017a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91] added
Nov 28 20:15:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdb755c-8924-4910-9a6d-a0919e0b40a1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b07d44-9872-4d27-bd57-5b49158173b9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bfvnHdNs {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bfvnHdNs" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcc928b-b28e-43e9-9152-ef8ce873d006]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bfvnHdNs'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff64e14b-0614-4017-a092-70a621036f7a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc474cc-9fb3-450e-b4aa-513771305974]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1390e6cd-a521-4e31-a8ae-170b84b2d075]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91, portal: 172.16.0.220,3260]
Nov 28 20:15:00 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91, portal: 172.16.0.220,3260] successful.
Nov 28 20:15:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.069s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c162049f-584f-4a28-8a29-77d473cc8e58]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[61af0ea0-c284-4741-b201-fe8a5e7c102f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:00 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:00 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed1049c-f0d7-4972-8173-e62c462adc9e]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:15:01 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:15:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bfvnHdNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:15:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:15:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23935633563656232', 'path': '/dev/sdc'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:15:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935633563656232', 'path': '/dev/sdc'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:15:01 user nova-compute[75571]: DEBUG nova.objects.instance [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lazy-loading 'flavor' on Instance uuid a8112c4a-cb42-49df-81a7-97b42f5cc87d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:15:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:15:01 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:15:01 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:15:01 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:15:01 user nova-compute[75571]:   <serial>55971858-8dd0-45f6-ba68-a481db871e91</serial>
Nov 28 20:15:01 user nova-compute[75571]: </disk>
Nov 28 20:15:01 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] No VIF found with MAC fa:16:3e:f7:a3:4b, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.657s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:04 user nova-compute[75571]: INFO nova.compute.manager [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Detaching volume 55971858-8dd0-45f6-ba68-a481db871e91
Nov 28 20:15:04 user nova-compute[75571]: INFO nova.virt.block_device [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Attempting to driver detach volume 55971858-8dd0-45f6-ba68-a481db871e91 from mountpoint /dev/vdb
Nov 28 20:15:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Attempting to detach device vdb from instance a8112c4a-cb42-49df-81a7-97b42f5cc87d from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:15:04 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:15:04 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:15:04 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:15:04 user nova-compute[75571]:   <serial>55971858-8dd0-45f6-ba68-a481db871e91</serial>
Nov 28 20:15:04 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:15:04 user nova-compute[75571]: </disk>
Nov 28 20:15:04 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:15:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Successfully detached device vdb from instance a8112c4a-cb42-49df-81a7-97b42f5cc87d from the persistent domain config.
Nov 28 20:15:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8112c4a-cb42-49df-81a7-97b42f5cc87d from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:15:04 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:15:04 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:15:04 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:15:04 user nova-compute[75571]:   <serial>55971858-8dd0-45f6-ba68-a481db871e91</serial>
Nov 28 20:15:04 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:15:04 user nova-compute[75571]: </disk>
Nov 28 20:15:04 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8112c4a-cb42-49df-81a7-97b42f5cc87d {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:15:05 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:15:05 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:15:05 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=7887MB free_disk=25.54092025756836GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:15:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:05 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:15:05 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance fe726611-331a-495f-a6bd-ced2d1a305b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:15:05 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 59a360a3-bce3-4673-b79e-cd0460d2a69a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:15:05 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance a8112c4a-cb42-49df-81a7-97b42f5cc87d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:15:05 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance b4000485-c53c-46e7-b585-cec40c114ec9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:15:05 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4cdf5581-3412-46dc-a702-30f759bf2b05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:15:05 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 17cffd89-efcd-4c35-8c12-75393c8776f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:15:05 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:15:05 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:15:05 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:15:05 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:15:05 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:15:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.compute.manager [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:15:06 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Creating image(s)
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Ensure instance console log exists: /opt/stack/data/nova/instances/17cffd89-efcd-4c35-8c12-75393c8776f8/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Start _get_guest_xml network_info=[{"id": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "address": "fa:16:3e:de:65:0c", "network": {"id": "f4277af4-8e9c-4147-9ca9-2cf286d9de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-271277689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fac4f4-96", "ovs_interfaceid": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "90cdd786-4498-4e1d-8eff-7407674beb52", "address": "fa:16:3e:e3:38:55", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdd786-44", "ovs_interfaceid": "90cdd786-4498-4e1d-8eff-7407674beb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "address": "fa:16:3e:46:26:0d", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78aeb66d-21", "ovs_interfaceid": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "address": "fa:16:3e:59:92:9e", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec8aa66-f6", "ovs_interfaceid": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKOCFqBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '17cffd89-efcd-4c35-8c12-75393c8776f8', 'attached_at': '', 'detached_at': '', 'volume_id': '037b5b30-bff1-4d62-b6b5-21a93e3891a4', 'serial': '037b5b30-bff1-4d62-b6b5-21a93e3891a4'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '12e63b79-03f5-414e-8aa7-c426325405c5', 'mount_device': '/dev/vda', 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ciPdBaCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '17cffd89-efcd-4c35-8c12-75393c8776f8', 'attached_at': '', 'detached_at': '', 'volume_id': '4d17e45e-920e-43e3-a502-1047571c3c0a', 'serial': '4d17e45e-920e-43e3-a502-1047571c3c0a'}, 'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '78f591e6-185f-4eaf-a8ee-cfaa1c96a407', 'mount_device': '/dev/vdb', 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIzcKfPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '17cffd89-efcd-4c35-8c12-75393c8776f8', 'attached_at': '', 'detached_at': '', 'volume_id': '24f35406-cae5-4853-b197-f772e12de0b3', 'serial': '24f35406-cae5-4853-b197-f772e12de0b3'}, 'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'beaf0b70-d401-4649-b61c-d2e780e286eb', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:15:06 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:15:06 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKOCFqBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:15:06 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:15:06 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:15:06 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89c7720-ae32-4e17-8b92-70beb9ae5f73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:15:06 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54b2bf3-0a4d-4a44-85d6-4f648527aec2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4] added
Nov 28 20:15:06 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6805e82-f9fd-4c03-8718-9e5358a83873]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cf63a1-e544-4657-b120-2d05b1de16e8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKOCFqBZ {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKOCFqBZ" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b27e227-35bc-43be-92a4-2d3476b90f05]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RKOCFqBZ'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c313ee3-9938-40c8-861e-5f32b95bea36]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcf53cf-5874-4c4b-831a-07f2c2a21b11]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:06 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:06 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:06 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:06 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[31413eb3-3f31-44cd-8703-27d27983d7ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4, portal: 172.16.0.220,3260]
Nov 28 20:15:06 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4, portal: 172.16.0.220,3260] successful.
Nov 28 20:15:06 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.156s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bc2aca-59c2-4ca3-8c41-a91925ccbedc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bf0396-42dd-465e-9a25-d1b8901c39df]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:06 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:06 user nova-compute[75571]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:15:06 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:06 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:06 user nova-compute[75571]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:15:06 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a9c493-b543-496b-8f4e-7d7ba9d4ccf9]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:15:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKOCFqBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '26263653033626131', 'path': '/dev/sdd'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263653033626131', 'path': '/dev/sdd'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ciPdBaCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:15:07 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:15:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:15:07 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:15:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:15:07 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ef4186-02f4-4ecb-bb26-76339580130c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:15:07 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eed766-a6ff-4c43-b962-ddb5c0133052]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a] added
Nov 28 20:15:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab4340c-3964-4b28-8f47-9f1cc1b9a48e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[49376b45-b9f8-4c53-99f2-50082f9ff034]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ciPdBaCN {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ciPdBaCN" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe6fbe6-f35d-4ec3-ae24-d3fc257093d0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ciPdBaCN'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c4adc7-4aa0-47f2-a510-5ea1fe14e62f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5731136-5870-41eb-b3a6-daccf77fe4e3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:08 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:08 user nova-compute[75571]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:15:08 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:08 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:08 user nova-compute[75571]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:15:08 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd68d43-79c4-4d19-973c-ecfa349bc89f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a, portal: 172.16.0.220,3260]
Nov 28 20:15:08 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a, portal: 172.16.0.220,3260] successful.
Nov 28 20:15:08 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bfd8f1-38dd-4a8b-b03d-081fab230752]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3980a916-3e79-414a-93c7-ec8fe45b21cd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:08 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:08 user nova-compute[75571]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:15:08 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:15:08 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:08 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:08 user nova-compute[75571]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:15:08 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:15:08 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfa1be4-e358-455f-88b2-65086c9a113f]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ciPdBaCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23933363138313165', 'path': '/dev/sde'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933363138313165', 'path': '/dev/sde'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIzcKfPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:15:09 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:15:09 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:15:09 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[90664025-ef1d-4e47-b49e-bc18a88362da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:15:09 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.078s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfa798b-c205-4ef1-b579-f2fedd1951d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3] added
Nov 28 20:15:09 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[64be673f-5504-4823-8c2a-65ca8fe3b6df]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e81ac40-a4c2-4131-962c-e7c412320cea]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FIzcKfPu {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FIzcKfPu" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd17ffc-9352-4c4f-9178-ec5041d9494c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FIzcKfPu'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ef2bb7-3057-457c-aa35-ae86285baf60]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0266e326-15f1-4110-bc53-0ad84310d2c2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:09 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:09 user nova-compute[75571]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:15:09 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:15:09 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:09 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:09 user nova-compute[75571]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:15:09 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:15:09 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d06c0f-485d-4593-8e5d-c9a3431bfa60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3, portal: 172.16.0.220,3260]
Nov 28 20:15:09 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3, portal: 172.16.0.220,3260] successful.
Nov 28 20:15:09 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f02aefb-57ba-40f9-b05e-b2efee55c51f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81ccf8a-8490-4cb5-9a4f-dde54b922553]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:09 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:09 user nova-compute[75571]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:15:09 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:15:09 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:15:09 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:09 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:09 user nova-compute[75571]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:15:09 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:15:09 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:15:09 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2305dc5e-20ff-4449-a7ff-71b24629902e]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:15:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIzcKfPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23935393037376266', 'path': '/dev/sdf'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935393037376266', 'path': '/dev/sdf'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "address": "fa:16:3e:de:65:0c", "network": {"id": "f4277af4-8e9c-4147-9ca9-2cf286d9de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-271277689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fac4f4-96", "ovs_interfaceid": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "address": "fa:16:3e:de:65:0c", "network": {"id": "f4277af4-8e9c-4147-9ca9-2cf286d9de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-271277689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fac4f4-96", "ovs_interfaceid": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:65:0c,bridge_name='br-int',has_traffic_filtering=True,id=00fac4f4-969a-449b-a264-4d1ce345c3b6,network=Network(f4277af4-8e9c-4147-9ca9-2cf286d9de49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00fac4f4-96') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:66,bridge_name='br-int',has_traffic_filtering=True,id=13d2eb0a-77c7-4db6-96c1-547dc7781057,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13d2eb0a-77') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:73:04,bridge_name='br-int',has_traffic_filtering=True,id=2eb26bff-1c84-413b-b3b4-fbc18940f912,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eb26bff-1c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90cdd786-4498-4e1d-8eff-7407674beb52", "address": "fa:16:3e:e3:38:55", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdd786-44", "ovs_interfaceid": "90cdd786-4498-4e1d-8eff-7407674beb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "90cdd786-4498-4e1d-8eff-7407674beb52", "address": "fa:16:3e:e3:38:55", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdd786-44", "ovs_interfaceid": "90cdd786-4498-4e1d-8eff-7407674beb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:38:55,bridge_name='br-int',has_traffic_filtering=True,id=90cdd786-4498-4e1d-8eff-7407674beb52,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cdd786-44') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "address": "fa:16:3e:46:26:0d", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78aeb66d-21", "ovs_interfaceid": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "address": "fa:16:3e:46:26:0d", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78aeb66d-21", "ovs_interfaceid": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:26:0d,bridge_name='br-int',has_traffic_filtering=True,id=78aeb66d-2196-43e4-80fb-ffbf4559d29f,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78aeb66d-21') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "address": "fa:16:3e:59:92:9e", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec8aa66-f6", "ovs_interfaceid": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "address": "fa:16:3e:59:92:9e", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec8aa66-f6", "ovs_interfaceid": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:92:9e,bridge_name='br-int',has_traffic_filtering=True,id=dec8aa66-f6b6-4e5a-b055-c6321063f024,network=Network(5a401ccf-f76c-407a-8684-f55009848833),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec8aa66-f6') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ea:4f,bridge_name='br-int',has_traffic_filtering=True,id=5923f2c1-af01-4178-8faf-143583adb2d9,network=Network(5a401ccf-f76c-407a-8684-f55009848833),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5923f2c1-af') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.objects.instance [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lazy-loading 'pci_devices' on Instance uuid 17cffd89-efcd-4c35-8c12-75393c8776f8 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:15:10 user nova-compute[75571]:   <uuid>17cffd89-efcd-4c35-8c12-75393c8776f8</uuid>
Nov 28 20:15:10 user nova-compute[75571]:   <name>instance-0000000e</name>
Nov 28 20:15:10 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:15:10 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:15:10 user nova-compute[75571]:   <metadata>
Nov 28 20:15:10 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:15:10 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:15:10 user nova-compute[75571]:       <nova:name>tempest-device-tagging-server-669424600</nova:name>
Nov 28 20:15:10 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:15:06</nova:creationTime>
Nov 28 20:15:10 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:15:10 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:15:10 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:15:10 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:15:10 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:15:10 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:15:10 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:15:10 user nova-compute[75571]:       <nova:owner>
Nov 28 20:15:10 user nova-compute[75571]:         <nova:user uuid="d826645c8f4f4ce7bb0cf606d9005ed2">tempest-TaggedBootDevicesTest_v242-771180377-project-member</nova:user>
Nov 28 20:15:10 user nova-compute[75571]:         <nova:project uuid="573c587fe3af43a5a01c4e5db0643075">tempest-TaggedBootDevicesTest_v242-771180377</nova:project>
Nov 28 20:15:10 user nova-compute[75571]:       </nova:owner>
Nov 28 20:15:10 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:15:10 user nova-compute[75571]:       <nova:ports>
Nov 28 20:15:10 user nova-compute[75571]:         <nova:port uuid="00fac4f4-969a-449b-a264-4d1ce345c3b6">
Nov 28 20:15:10 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 20:15:10 user nova-compute[75571]:         </nova:port>
Nov 28 20:15:10 user nova-compute[75571]:         <nova:port uuid="13d2eb0a-77c7-4db6-96c1-547dc7781057">
Nov 28 20:15:10 user nova-compute[75571]:           <nova:ip type="fixed" address="10.1.1.222" ipVersion="4"/>
Nov 28 20:15:10 user nova-compute[75571]:         </nova:port>
Nov 28 20:15:10 user nova-compute[75571]:         <nova:port uuid="2eb26bff-1c84-413b-b3b4-fbc18940f912">
Nov 28 20:15:10 user nova-compute[75571]:           <nova:ip type="fixed" address="10.1.1.11" ipVersion="4"/>
Nov 28 20:15:10 user nova-compute[75571]:         </nova:port>
Nov 28 20:15:10 user nova-compute[75571]:         <nova:port uuid="90cdd786-4498-4e1d-8eff-7407674beb52">
Nov 28 20:15:10 user nova-compute[75571]:           <nova:ip type="fixed" address="10.1.1.231" ipVersion="4"/>
Nov 28 20:15:10 user nova-compute[75571]:         </nova:port>
Nov 28 20:15:10 user nova-compute[75571]:         <nova:port uuid="78aeb66d-2196-43e4-80fb-ffbf4559d29f">
Nov 28 20:15:10 user nova-compute[75571]:           <nova:ip type="fixed" address="10.1.1.79" ipVersion="4"/>
Nov 28 20:15:10 user nova-compute[75571]:         </nova:port>
Nov 28 20:15:10 user nova-compute[75571]:         <nova:port uuid="dec8aa66-f6b6-4e5a-b055-c6321063f024">
Nov 28 20:15:10 user nova-compute[75571]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 20:15:10 user nova-compute[75571]:         </nova:port>
Nov 28 20:15:10 user nova-compute[75571]:         <nova:port uuid="5923f2c1-af01-4178-8faf-143583adb2d9">
Nov 28 20:15:10 user nova-compute[75571]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 20:15:10 user nova-compute[75571]:         </nova:port>
Nov 28 20:15:10 user nova-compute[75571]:       </nova:ports>
Nov 28 20:15:10 user nova-compute[75571]:     </nova:instance>
Nov 28 20:15:10 user nova-compute[75571]:   </metadata>
Nov 28 20:15:10 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:15:10 user nova-compute[75571]:     <system>
Nov 28 20:15:10 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:15:10 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:15:10 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:15:10 user nova-compute[75571]:       <entry name="serial">17cffd89-efcd-4c35-8c12-75393c8776f8</entry>
Nov 28 20:15:10 user nova-compute[75571]:       <entry name="uuid">17cffd89-efcd-4c35-8c12-75393c8776f8</entry>
Nov 28 20:15:10 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:15:10 user nova-compute[75571]:     </system>
Nov 28 20:15:10 user nova-compute[75571]:   </sysinfo>
Nov 28 20:15:10 user nova-compute[75571]:   <os>
Nov 28 20:15:10 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:15:10 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:15:10 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:15:10 user nova-compute[75571]:   </os>
Nov 28 20:15:10 user nova-compute[75571]:   <features>
Nov 28 20:15:10 user nova-compute[75571]:     <acpi/>
Nov 28 20:15:10 user nova-compute[75571]:     <apic/>
Nov 28 20:15:10 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:15:10 user nova-compute[75571]:   </features>
Nov 28 20:15:10 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:15:10 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:15:10 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:15:10 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:15:10 user nova-compute[75571]:   </clock>
Nov 28 20:15:10 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:15:10 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:15:10 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:15:10 user nova-compute[75571]:   </cpu>
Nov 28 20:15:10 user nova-compute[75571]:   <devices>
Nov 28 20:15:10 user nova-compute[75571]:     <disk type="file" device="cdrom">
Nov 28 20:15:10 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 20:15:10 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/17cffd89-efcd-4c35-8c12-75393c8776f8/disk.config"/>
Nov 28 20:15:10 user nova-compute[75571]:       <target dev="hda" bus="ide"/>
Nov 28 20:15:10 user nova-compute[75571]:     </disk>
Nov 28 20:15:10 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:15:10 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:15:10 user nova-compute[75571]:       <source dev="/dev/sdd"/>
Nov 28 20:15:10 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:15:10 user nova-compute[75571]:       <serial>037b5b30-bff1-4d62-b6b5-21a93e3891a4</serial>
Nov 28 20:15:10 user nova-compute[75571]:     </disk>
Nov 28 20:15:10 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:15:10 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:15:10 user nova-compute[75571]:       <source dev="/dev/sde"/>
Nov 28 20:15:10 user nova-compute[75571]:       <target dev="vdb" bus="virtio"/>
Nov 28 20:15:10 user nova-compute[75571]:       <serial>4d17e45e-920e-43e3-a502-1047571c3c0a</serial>
Nov 28 20:15:10 user nova-compute[75571]:     </disk>
Nov 28 20:15:10 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:15:10 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:15:10 user nova-compute[75571]:       <source dev="/dev/sdf"/>
Nov 28 20:15:10 user nova-compute[75571]:       <target dev="vdc" bus="virtio"/>
Nov 28 20:15:10 user nova-compute[75571]:       <serial>24f35406-cae5-4853-b197-f772e12de0b3</serial>
Nov 28 20:15:10 user nova-compute[75571]:     </disk>
Nov 28 20:15:10 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:15:10 user nova-compute[75571]:       <mac address="fa:16:3e:de:65:0c"/>
Nov 28 20:15:10 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:15:10 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:15:10 user nova-compute[75571]:       <target dev="tap00fac4f4-96"/>
Nov 28 20:15:10 user nova-compute[75571]:     </interface>
Nov 28 20:15:10 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:15:10 user nova-compute[75571]:       <mac address="fa:16:3e:48:b6:66"/>
Nov 28 20:15:10 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:15:10 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:15:10 user nova-compute[75571]:       <target dev="tap13d2eb0a-77"/>
Nov 28 20:15:10 user nova-compute[75571]:     </interface>
Nov 28 20:15:10 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:15:10 user nova-compute[75571]:       <mac address="fa:16:3e:31:73:04"/>
Nov 28 20:15:10 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:15:10 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:15:10 user nova-compute[75571]:       <target dev="tap2eb26bff-1c"/>
Nov 28 20:15:10 user nova-compute[75571]:     </interface>
Nov 28 20:15:10 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:15:10 user nova-compute[75571]:       <mac address="fa:16:3e:e3:38:55"/>
Nov 28 20:15:10 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:15:10 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:15:10 user nova-compute[75571]:       <target dev="tap90cdd786-44"/>
Nov 28 20:15:10 user nova-compute[75571]:     </interface>
Nov 28 20:15:10 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:15:10 user nova-compute[75571]:       <mac address="fa:16:3e:46:26:0d"/>
Nov 28 20:15:10 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:15:10 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:15:10 user nova-compute[75571]:       <target dev="tap78aeb66d-21"/>
Nov 28 20:15:10 user nova-compute[75571]:     </interface>
Nov 28 20:15:10 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:15:10 user nova-compute[75571]:       <mac address="fa:16:3e:59:92:9e"/>
Nov 28 20:15:10 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:15:10 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:15:10 user nova-compute[75571]:       <target dev="tapdec8aa66-f6"/>
Nov 28 20:15:10 user nova-compute[75571]:     </interface>
Nov 28 20:15:10 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:15:10 user nova-compute[75571]:       <mac address="fa:16:3e:2b:ea:4f"/>
Nov 28 20:15:10 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:15:10 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:15:10 user nova-compute[75571]:       <target dev="tap5923f2c1-af"/>
Nov 28 20:15:10 user nova-compute[75571]:     </interface>
Nov 28 20:15:10 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:15:10 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/17cffd89-efcd-4c35-8c12-75393c8776f8/console.log" append="off"/>
Nov 28 20:15:10 user nova-compute[75571]:     </serial>
Nov 28 20:15:10 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:15:10 user nova-compute[75571]:     <video>
Nov 28 20:15:10 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:15:10 user nova-compute[75571]:     </video>
Nov 28 20:15:10 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:15:10 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:15:10 user nova-compute[75571]:     </rng>
Nov 28 20:15:10 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:15:10 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:15:10 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:15:10 user nova-compute[75571]:     </memballoon>
Nov 28 20:15:10 user nova-compute[75571]:   </devices>
Nov 28 20:15:10 user nova-compute[75571]: </domain>
Nov 28 20:15:10 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "address": "fa:16:3e:de:65:0c", "network": {"id": "f4277af4-8e9c-4147-9ca9-2cf286d9de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-271277689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fac4f4-96", "ovs_interfaceid": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "address": "fa:16:3e:de:65:0c", "network": {"id": "f4277af4-8e9c-4147-9ca9-2cf286d9de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-271277689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fac4f4-96", "ovs_interfaceid": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:65:0c,bridge_name='br-int',has_traffic_filtering=True,id=00fac4f4-969a-449b-a264-4d1ce345c3b6,network=Network(f4277af4-8e9c-4147-9ca9-2cf286d9de49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00fac4f4-96') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG os_vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:65:0c,bridge_name='br-int',has_traffic_filtering=True,id=00fac4f4-969a-449b-a264-4d1ce345c3b6,network=Network(f4277af4-8e9c-4147-9ca9-2cf286d9de49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00fac4f4-96') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ce405bd-cc5c-5654-9a5e-3f37245d7e85', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00fac4f4-96, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00fac4f4-96, col_values=(('qos', UUID('7793a018-a83f-46c6-b5a3-d40024f8233f')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00fac4f4-96, col_values=(('external_ids', {'iface-id': '00fac4f4-969a-449b-a264-4d1ce345c3b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:65:0c', 'vm-uuid': '17cffd89-efcd-4c35-8c12-75393c8776f8'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: INFO os_vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:65:0c,bridge_name='br-int',has_traffic_filtering=True,id=00fac4f4-969a-449b-a264-4d1ce345c3b6,network=Network(f4277af4-8e9c-4147-9ca9-2cf286d9de49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00fac4f4-96')
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:66,bridge_name='br-int',has_traffic_filtering=True,id=13d2eb0a-77c7-4db6-96c1-547dc7781057,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13d2eb0a-77') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG os_vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:66,bridge_name='br-int',has_traffic_filtering=True,id=13d2eb0a-77c7-4db6-96c1-547dc7781057,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13d2eb0a-77') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d58246d-ad1a-5dfe-b86e-1eb3c9e85297', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13d2eb0a-77, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13d2eb0a-77, col_values=(('qos', UUID('82e64086-db16-4c11-8df3-c44355c34177')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13d2eb0a-77, col_values=(('external_ids', {'iface-id': '13d2eb0a-77c7-4db6-96c1-547dc7781057', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:b6:66', 'vm-uuid': '17cffd89-efcd-4c35-8c12-75393c8776f8'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: INFO os_vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:66,bridge_name='br-int',has_traffic_filtering=True,id=13d2eb0a-77c7-4db6-96c1-547dc7781057,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13d2eb0a-77')
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:73:04,bridge_name='br-int',has_traffic_filtering=True,id=2eb26bff-1c84-413b-b3b4-fbc18940f912,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eb26bff-1c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG os_vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:73:04,bridge_name='br-int',has_traffic_filtering=True,id=2eb26bff-1c84-413b-b3b4-fbc18940f912,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eb26bff-1c') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9a7d977-e4ba-5297-b6ec-962ef683fe55', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eb26bff-1c, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2eb26bff-1c, col_values=(('qos', UUID('fd4f28ff-dda4-4035-885e-6d48cd0c7a23')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2eb26bff-1c, col_values=(('external_ids', {'iface-id': '2eb26bff-1c84-413b-b3b4-fbc18940f912', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:73:04', 'vm-uuid': '17cffd89-efcd-4c35-8c12-75393c8776f8'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: INFO os_vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:73:04,bridge_name='br-int',has_traffic_filtering=True,id=2eb26bff-1c84-413b-b3b4-fbc18940f912,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eb26bff-1c')
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90cdd786-4498-4e1d-8eff-7407674beb52", "address": "fa:16:3e:e3:38:55", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdd786-44", "ovs_interfaceid": "90cdd786-4498-4e1d-8eff-7407674beb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "90cdd786-4498-4e1d-8eff-7407674beb52", "address": "fa:16:3e:e3:38:55", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdd786-44", "ovs_interfaceid": "90cdd786-4498-4e1d-8eff-7407674beb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:38:55,bridge_name='br-int',has_traffic_filtering=True,id=90cdd786-4498-4e1d-8eff-7407674beb52,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cdd786-44') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG os_vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:38:55,bridge_name='br-int',has_traffic_filtering=True,id=90cdd786-4498-4e1d-8eff-7407674beb52,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cdd786-44') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3b5e71c-4379-5fcc-b61e-b10b4e621957', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90cdd786-44, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90cdd786-44, col_values=(('qos', UUID('2d1246c3-d19b-4783-88ae-5123a457f5b2')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90cdd786-44, col_values=(('external_ids', {'iface-id': '90cdd786-4498-4e1d-8eff-7407674beb52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:38:55', 'vm-uuid': '17cffd89-efcd-4c35-8c12-75393c8776f8'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: INFO os_vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:38:55,bridge_name='br-int',has_traffic_filtering=True,id=90cdd786-4498-4e1d-8eff-7407674beb52,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cdd786-44')
Nov 28 20:15:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "address": "fa:16:3e:46:26:0d", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78aeb66d-21", "ovs_interfaceid": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "address": "fa:16:3e:46:26:0d", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78aeb66d-21", "ovs_interfaceid": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:26:0d,bridge_name='br-int',has_traffic_filtering=True,id=78aeb66d-2196-43e4-80fb-ffbf4559d29f,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78aeb66d-21') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG os_vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:26:0d,bridge_name='br-int',has_traffic_filtering=True,id=78aeb66d-2196-43e4-80fb-ffbf4559d29f,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78aeb66d-21') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97933d24-0adf-5173-a534-b1652704c2d9', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78aeb66d-21, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78aeb66d-21, col_values=(('qos', UUID('b5a192e5-b915-4046-a71c-0ebec6a7a460')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78aeb66d-21, col_values=(('external_ids', {'iface-id': '78aeb66d-2196-43e4-80fb-ffbf4559d29f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:26:0d', 'vm-uuid': '17cffd89-efcd-4c35-8c12-75393c8776f8'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: INFO os_vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:26:0d,bridge_name='br-int',has_traffic_filtering=True,id=78aeb66d-2196-43e4-80fb-ffbf4559d29f,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78aeb66d-21')
Nov 28 20:15:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "address": "fa:16:3e:59:92:9e", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec8aa66-f6", "ovs_interfaceid": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "address": "fa:16:3e:59:92:9e", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec8aa66-f6", "ovs_interfaceid": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:92:9e,bridge_name='br-int',has_traffic_filtering=True,id=dec8aa66-f6b6-4e5a-b055-c6321063f024,network=Network(5a401ccf-f76c-407a-8684-f55009848833),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec8aa66-f6') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG os_vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:92:9e,bridge_name='br-int',has_traffic_filtering=True,id=dec8aa66-f6b6-4e5a-b055-c6321063f024,network=Network(5a401ccf-f76c-407a-8684-f55009848833),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec8aa66-f6') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c89670c-2496-5ae9-b8d0-5b2563cf79de', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdec8aa66-f6, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdec8aa66-f6, col_values=(('qos', UUID('bfd0f0be-b2f2-462f-a070-8c5c1a32aa2f')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdec8aa66-f6, col_values=(('external_ids', {'iface-id': 'dec8aa66-f6b6-4e5a-b055-c6321063f024', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:92:9e', 'vm-uuid': '17cffd89-efcd-4c35-8c12-75393c8776f8'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: INFO os_vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:92:9e,bridge_name='br-int',has_traffic_filtering=True,id=dec8aa66-f6b6-4e5a-b055-c6321063f024,network=Network(5a401ccf-f76c-407a-8684-f55009848833),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec8aa66-f6')
Nov 28 20:15:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ea:4f,bridge_name='br-int',has_traffic_filtering=True,id=5923f2c1-af01-4178-8faf-143583adb2d9,network=Network(5a401ccf-f76c-407a-8684-f55009848833),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5923f2c1-af') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG os_vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ea:4f,bridge_name='br-int',has_traffic_filtering=True,id=5923f2c1-af01-4178-8faf-143583adb2d9,network=Network(5a401ccf-f76c-407a-8684-f55009848833),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5923f2c1-af') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4d47f18-5f2a-5e4c-81e4-3739928afc80', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5923f2c1-af, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5923f2c1-af, col_values=(('qos', UUID('b935600c-e45d-4e39-aabf-9c2c498686b6')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5923f2c1-af, col_values=(('external_ids', {'iface-id': '5923f2c1-af01-4178-8faf-143583adb2d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:ea:4f', 'vm-uuid': '17cffd89-efcd-4c35-8c12-75393c8776f8'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:11 user nova-compute[75571]: INFO os_vif [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ea:4f,bridge_name='br-int',has_traffic_filtering=True,id=5923f2c1-af01-4178-8faf-143583adb2d9,network=Network(5a401ccf-f76c-407a-8684-f55009848833),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5923f2c1-af')
Nov 28 20:15:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] No BDM found with device name hda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] No VIF found with MAC fa:16:3e:de:65:0c, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] No VIF found with MAC fa:16:3e:46:26:0d, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:15:11 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Using config drive
Nov 28 20:15:11 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Creating config drive at /opt/stack/data/nova/instances/17cffd89-efcd-4c35-8c12-75393c8776f8/disk.config
Nov 28 20:15:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/17cffd89-efcd-4c35-8c12-75393c8776f8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk__sdasw {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/17cffd89-efcd-4c35-8c12-75393c8776f8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk__sdasw" returned: 0 in 0.060s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG nova.compute.manager [req-0b6bdb80-5345-4d3c-9f63-9e37b0c09046 req-883fdee8-14e3-49e3-8a08-fecc2b521d51 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-00fac4f4-969a-449b-a264-4d1ce345c3b6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0b6bdb80-5345-4d3c-9f63-9e37b0c09046 req-883fdee8-14e3-49e3-8a08-fecc2b521d51 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0b6bdb80-5345-4d3c-9f63-9e37b0c09046 req-883fdee8-14e3-49e3-8a08-fecc2b521d51 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0b6bdb80-5345-4d3c-9f63-9e37b0c09046 req-883fdee8-14e3-49e3-8a08-fecc2b521d51 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG nova.compute.manager [req-0b6bdb80-5345-4d3c-9f63-9e37b0c09046 req-883fdee8-14e3-49e3-8a08-fecc2b521d51 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-00fac4f4-969a-449b-a264-4d1ce345c3b6 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:13 user nova-compute[75571]: WARNING nova.compute.manager [req-0b6bdb80-5345-4d3c-9f63-9e37b0c09046 req-883fdee8-14e3-49e3-8a08-fecc2b521d51 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-00fac4f4-969a-449b-a264-4d1ce345c3b6 for instance with vm_state building and task_state spawning.
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-7e58977c-d4f2-4096-8785-8163e0ef8265 req-a0dde3c0-810c-428c-85ec-1712e59b9084 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-2eb26bff-1c84-413b-b3b4-fbc18940f912 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7e58977c-d4f2-4096-8785-8163e0ef8265 req-a0dde3c0-810c-428c-85ec-1712e59b9084 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7e58977c-d4f2-4096-8785-8163e0ef8265 req-a0dde3c0-810c-428c-85ec-1712e59b9084 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7e58977c-d4f2-4096-8785-8163e0ef8265 req-a0dde3c0-810c-428c-85ec-1712e59b9084 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-7e58977c-d4f2-4096-8785-8163e0ef8265 req-a0dde3c0-810c-428c-85ec-1712e59b9084 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-2eb26bff-1c84-413b-b3b4-fbc18940f912 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:14 user nova-compute[75571]: WARNING nova.compute.manager [req-7e58977c-d4f2-4096-8785-8163e0ef8265 req-a0dde3c0-810c-428c-85ec-1712e59b9084 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-2eb26bff-1c84-413b-b3b4-fbc18940f912 for instance with vm_state building and task_state spawning.
Nov 28 20:15:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-482a00da-55a8-4fdb-94d4-cdadfe18b0af req-71daba02-aa0f-46da-9b03-9f046da0ea2f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-90cdd786-4498-4e1d-8eff-7407674beb52 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-482a00da-55a8-4fdb-94d4-cdadfe18b0af req-71daba02-aa0f-46da-9b03-9f046da0ea2f service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-482a00da-55a8-4fdb-94d4-cdadfe18b0af req-71daba02-aa0f-46da-9b03-9f046da0ea2f service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-482a00da-55a8-4fdb-94d4-cdadfe18b0af req-71daba02-aa0f-46da-9b03-9f046da0ea2f service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-482a00da-55a8-4fdb-94d4-cdadfe18b0af req-71daba02-aa0f-46da-9b03-9f046da0ea2f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-90cdd786-4498-4e1d-8eff-7407674beb52 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:14 user nova-compute[75571]: WARNING nova.compute.manager [req-482a00da-55a8-4fdb-94d4-cdadfe18b0af req-71daba02-aa0f-46da-9b03-9f046da0ea2f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-90cdd786-4498-4e1d-8eff-7407674beb52 for instance with vm_state building and task_state spawning.
Nov 28 20:15:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-00fac4f4-969a-449b-a264-4d1ce345c3b6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-00fac4f4-969a-449b-a264-4d1ce345c3b6 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:15 user nova-compute[75571]: WARNING nova.compute.manager [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-00fac4f4-969a-449b-a264-4d1ce345c3b6 for instance with vm_state building and task_state spawning.
Nov 28 20:15:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-13d2eb0a-77c7-4db6-96c1-547dc7781057 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-13d2eb0a-77c7-4db6-96c1-547dc7781057 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:15 user nova-compute[75571]: WARNING nova.compute.manager [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-13d2eb0a-77c7-4db6-96c1-547dc7781057 for instance with vm_state building and task_state spawning.
Nov 28 20:15:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-13d2eb0a-77c7-4db6-96c1-547dc7781057 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-13d2eb0a-77c7-4db6-96c1-547dc7781057 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:15 user nova-compute[75571]: WARNING nova.compute.manager [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-13d2eb0a-77c7-4db6-96c1-547dc7781057 for instance with vm_state building and task_state spawning.
Nov 28 20:15:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-78aeb66d-2196-43e4-80fb-ffbf4559d29f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-78aeb66d-2196-43e4-80fb-ffbf4559d29f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:15 user nova-compute[75571]: WARNING nova.compute.manager [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-78aeb66d-2196-43e4-80fb-ffbf4559d29f for instance with vm_state building and task_state spawning.
Nov 28 20:15:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-78aeb66d-2196-43e4-80fb-ffbf4559d29f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-78aeb66d-2196-43e4-80fb-ffbf4559d29f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:15 user nova-compute[75571]: WARNING nova.compute.manager [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-78aeb66d-2196-43e4-80fb-ffbf4559d29f for instance with vm_state building and task_state spawning.
Nov 28 20:15:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-ea055542-abfd-49fe-9cb7-d01d61d77545 req-05c66bea-a128-458a-8e46-435f10495b96 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-2eb26bff-1c84-413b-b3b4-fbc18940f912 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ea055542-abfd-49fe-9cb7-d01d61d77545 req-05c66bea-a128-458a-8e46-435f10495b96 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ea055542-abfd-49fe-9cb7-d01d61d77545 req-05c66bea-a128-458a-8e46-435f10495b96 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ea055542-abfd-49fe-9cb7-d01d61d77545 req-05c66bea-a128-458a-8e46-435f10495b96 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-ea055542-abfd-49fe-9cb7-d01d61d77545 req-05c66bea-a128-458a-8e46-435f10495b96 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-2eb26bff-1c84-413b-b3b4-fbc18940f912 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:16 user nova-compute[75571]: WARNING nova.compute.manager [req-ea055542-abfd-49fe-9cb7-d01d61d77545 req-05c66bea-a128-458a-8e46-435f10495b96 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-2eb26bff-1c84-413b-b3b4-fbc18940f912 for instance with vm_state building and task_state spawning.
Nov 28 20:15:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-90cdd786-4498-4e1d-8eff-7407674beb52 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-90cdd786-4498-4e1d-8eff-7407674beb52 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:16 user nova-compute[75571]: WARNING nova.compute.manager [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-90cdd786-4498-4e1d-8eff-7407674beb52 for instance with vm_state building and task_state spawning.
Nov 28 20:15:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-dec8aa66-f6b6-4e5a-b055-c6321063f024 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-dec8aa66-f6b6-4e5a-b055-c6321063f024 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:16 user nova-compute[75571]: WARNING nova.compute.manager [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-dec8aa66-f6b6-4e5a-b055-c6321063f024 for instance with vm_state building and task_state spawning.
Nov 28 20:15:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-dec8aa66-f6b6-4e5a-b055-c6321063f024 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-dec8aa66-f6b6-4e5a-b055-c6321063f024 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:16 user nova-compute[75571]: WARNING nova.compute.manager [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-dec8aa66-f6b6-4e5a-b055-c6321063f024 for instance with vm_state building and task_state spawning.
Nov 28 20:15:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-5923f2c1-af01-4178-8faf-143583adb2d9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-5923f2c1-af01-4178-8faf-143583adb2d9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:16 user nova-compute[75571]: WARNING nova.compute.manager [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-5923f2c1-af01-4178-8faf-143583adb2d9 for instance with vm_state building and task_state spawning.
Nov 28 20:15:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-5923f2c1-af01-4178-8faf-143583adb2d9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-5923f2c1-af01-4178-8faf-143583adb2d9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:16 user nova-compute[75571]: WARNING nova.compute.manager [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-5923f2c1-af01-4178-8faf-143583adb2d9 for instance with vm_state building and task_state spawning.
Nov 28 20:15:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG nova.compute.manager [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:15:17 user nova-compute[75571]: INFO nova.compute.claims [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Claim successful on node user
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:15:17 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Instance spawned successfully.
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.network.neutron [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:15:17 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:15:17 user nova-compute[75571]: INFO nova.compute.manager [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Took 11.58 seconds to spawn the instance on the hypervisor.
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:15:17 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Creating image(s)
Nov 28 20:15:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:17 user nova-compute[75571]: DEBUG nova.policy [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3de9c75fa13b4cfdaa348ed6e28e9d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb04f7bcf944c58f07769918fb18ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:15:17 user nova-compute[75571]: INFO nova.compute.manager [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Took 36.06 seconds to build instance.
Nov 28 20:15:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.151s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.193s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk 1073741824" returned: 0 in 0.059s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.206s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG nova.network.neutron [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Successfully created port: cce19286-ec4f-4349-94c7-67f6ab63551c {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Cannot resize image /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Ensure instance console log exists: /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.network.neutron [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Successfully updated port: cce19286-ec4f-4349-94c7-67f6ab63551c {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquired lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.network.neutron [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-9e45da63-5185-4127-b1f3-53a76602a88c req-5b4c6983-9b8c-4441-afc0-7b0098906771 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received event network-changed-cce19286-ec4f-4349-94c7-67f6ab63551c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-9e45da63-5185-4127-b1f3-53a76602a88c req-5b4c6983-9b8c-4441-afc0-7b0098906771 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Refreshing instance network info cache due to event network-changed-cce19286-ec4f-4349-94c7-67f6ab63551c. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9e45da63-5185-4127-b1f3-53a76602a88c req-5b4c6983-9b8c-4441-afc0-7b0098906771 service nova] Acquiring lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.network.neutron [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.network.neutron [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Updating instance_info_cache with network_info: [{"id": "cce19286-ec4f-4349-94c7-67f6ab63551c", "address": "fa:16:3e:99:11:08", "network": {"id": "268f60cb-1235-41c9-88d5-7b68c1de2795", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-595792232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce19286-ec", "ovs_interfaceid": "cce19286-ec4f-4349-94c7-67f6ab63551c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Releasing lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.compute.manager [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Instance network_info: |[{"id": "cce19286-ec4f-4349-94c7-67f6ab63551c", "address": "fa:16:3e:99:11:08", "network": {"id": "268f60cb-1235-41c9-88d5-7b68c1de2795", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-595792232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce19286-ec", "ovs_interfaceid": "cce19286-ec4f-4349-94c7-67f6ab63551c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9e45da63-5185-4127-b1f3-53a76602a88c req-5b4c6983-9b8c-4441-afc0-7b0098906771 service nova] Acquired lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.network.neutron [req-9e45da63-5185-4127-b1f3-53a76602a88c req-5b4c6983-9b8c-4441-afc0-7b0098906771 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Refreshing network info cache for port cce19286-ec4f-4349-94c7-67f6ab63551c {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Start _get_guest_xml network_info=[{"id": "cce19286-ec4f-4349-94c7-67f6ab63551c", "address": "fa:16:3e:99:11:08", "network": {"id": "268f60cb-1235-41c9-88d5-7b68c1de2795", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-595792232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce19286-ec", "ovs_interfaceid": "cce19286-ec4f-4349-94c7-67f6ab63551c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:15:19 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:15:19 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-314385621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-314385621',id=15,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJygV2sBwSu97x/mNv3tb+z8vi+uhgqoT2QUgvIa02FX6CxSOX0/P5GPCbQ7xDIoAjiVsAURNLlcT6927/eZSkKqdRK7mwgjh5qS2dEgtINUouxWTKkh2D8D/z/+oLMOWQ==',key_name='tempest-keypair-1640947232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82eb04f7bcf944c58f07769918fb18ed',ramdisk_id='',reservation_id='r-06w0ycsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1139944601',owner_user_name='tempest-TaggedAttachmentsTest-1139944601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3de9c75fa13b4cfdaa348ed6e28e9d97',uuid=f6e9eab9-0445-4dcd-bd67-ef73e102c909,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cce19286-ec4f-4349-94c7-67f6ab63551c", "address": "fa:16:3e:99:11:08", "network": {"id": "268f60cb-1235-41c9-88d5-7b68c1de2795", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-595792232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce19286-ec", "ovs_interfaceid": "cce19286-ec4f-4349-94c7-67f6ab63551c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Converting VIF {"id": "cce19286-ec4f-4349-94c7-67f6ab63551c", "address": "fa:16:3e:99:11:08", "network": {"id": "268f60cb-1235-41c9-88d5-7b68c1de2795", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-595792232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce19286-ec", "ovs_interfaceid": "cce19286-ec4f-4349-94c7-67f6ab63551c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:11:08,bridge_name='br-int',has_traffic_filtering=True,id=cce19286-ec4f-4349-94c7-67f6ab63551c,network=Network(268f60cb-1235-41c9-88d5-7b68c1de2795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce19286-ec') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.objects.instance [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lazy-loading 'pci_devices' on Instance uuid f6e9eab9-0445-4dcd-bd67-ef73e102c909 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:15:19 user nova-compute[75571]:   <uuid>f6e9eab9-0445-4dcd-bd67-ef73e102c909</uuid>
Nov 28 20:15:19 user nova-compute[75571]:   <name>instance-0000000f</name>
Nov 28 20:15:19 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:15:19 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:15:19 user nova-compute[75571]:   <metadata>
Nov 28 20:15:19 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:15:19 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:15:19 user nova-compute[75571]:       <nova:name>tempest-device-tagging-server-314385621</nova:name>
Nov 28 20:15:19 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:15:19</nova:creationTime>
Nov 28 20:15:19 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:15:19 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:15:19 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:15:19 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:15:19 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:15:19 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:15:19 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:15:19 user nova-compute[75571]:       <nova:owner>
Nov 28 20:15:19 user nova-compute[75571]:         <nova:user uuid="3de9c75fa13b4cfdaa348ed6e28e9d97">tempest-TaggedAttachmentsTest-1139944601-project-member</nova:user>
Nov 28 20:15:19 user nova-compute[75571]:         <nova:project uuid="82eb04f7bcf944c58f07769918fb18ed">tempest-TaggedAttachmentsTest-1139944601</nova:project>
Nov 28 20:15:19 user nova-compute[75571]:       </nova:owner>
Nov 28 20:15:19 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:15:19 user nova-compute[75571]:       <nova:ports>
Nov 28 20:15:19 user nova-compute[75571]:         <nova:port uuid="cce19286-ec4f-4349-94c7-67f6ab63551c">
Nov 28 20:15:19 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:15:19 user nova-compute[75571]:         </nova:port>
Nov 28 20:15:19 user nova-compute[75571]:       </nova:ports>
Nov 28 20:15:19 user nova-compute[75571]:     </nova:instance>
Nov 28 20:15:19 user nova-compute[75571]:   </metadata>
Nov 28 20:15:19 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:15:19 user nova-compute[75571]:     <system>
Nov 28 20:15:19 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:15:19 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:15:19 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:15:19 user nova-compute[75571]:       <entry name="serial">f6e9eab9-0445-4dcd-bd67-ef73e102c909</entry>
Nov 28 20:15:19 user nova-compute[75571]:       <entry name="uuid">f6e9eab9-0445-4dcd-bd67-ef73e102c909</entry>
Nov 28 20:15:19 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:15:19 user nova-compute[75571]:     </system>
Nov 28 20:15:19 user nova-compute[75571]:   </sysinfo>
Nov 28 20:15:19 user nova-compute[75571]:   <os>
Nov 28 20:15:19 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:15:19 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:15:19 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:15:19 user nova-compute[75571]:   </os>
Nov 28 20:15:19 user nova-compute[75571]:   <features>
Nov 28 20:15:19 user nova-compute[75571]:     <acpi/>
Nov 28 20:15:19 user nova-compute[75571]:     <apic/>
Nov 28 20:15:19 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:15:19 user nova-compute[75571]:   </features>
Nov 28 20:15:19 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:15:19 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:15:19 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:15:19 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:15:19 user nova-compute[75571]:   </clock>
Nov 28 20:15:19 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:15:19 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:15:19 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:15:19 user nova-compute[75571]:   </cpu>
Nov 28 20:15:19 user nova-compute[75571]:   <devices>
Nov 28 20:15:19 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:15:19 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:15:19 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk"/>
Nov 28 20:15:19 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:15:19 user nova-compute[75571]:     </disk>
Nov 28 20:15:19 user nova-compute[75571]:     <disk type="file" device="cdrom">
Nov 28 20:15:19 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 20:15:19 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk.config"/>
Nov 28 20:15:19 user nova-compute[75571]:       <target dev="hda" bus="ide"/>
Nov 28 20:15:19 user nova-compute[75571]:     </disk>
Nov 28 20:15:19 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:15:19 user nova-compute[75571]:       <mac address="fa:16:3e:99:11:08"/>
Nov 28 20:15:19 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:15:19 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:15:19 user nova-compute[75571]:       <target dev="tapcce19286-ec"/>
Nov 28 20:15:19 user nova-compute[75571]:     </interface>
Nov 28 20:15:19 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:15:19 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/console.log" append="off"/>
Nov 28 20:15:19 user nova-compute[75571]:     </serial>
Nov 28 20:15:19 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:15:19 user nova-compute[75571]:     <video>
Nov 28 20:15:19 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:15:19 user nova-compute[75571]:     </video>
Nov 28 20:15:19 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:15:19 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:15:19 user nova-compute[75571]:     </rng>
Nov 28 20:15:19 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:15:19 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:15:19 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:15:19 user nova-compute[75571]:     </memballoon>
Nov 28 20:15:19 user nova-compute[75571]:   </devices>
Nov 28 20:15:19 user nova-compute[75571]: </domain>
Nov 28 20:15:19 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-314385621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-314385621',id=15,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJygV2sBwSu97x/mNv3tb+z8vi+uhgqoT2QUgvIa02FX6CxSOX0/P5GPCbQ7xDIoAjiVsAURNLlcT6927/eZSkKqdRK7mwgjh5qS2dEgtINUouxWTKkh2D8D/z/+oLMOWQ==',key_name='tempest-keypair-1640947232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82eb04f7bcf944c58f07769918fb18ed',ramdisk_id='',reservation_id='r-06w0ycsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1139944601',owner_user_name='tempest-TaggedAttachmentsTest-1139944601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3de9c75fa13b4cfdaa348ed6e28e9d97',uuid=f6e9eab9-0445-4dcd-bd67-ef73e102c909,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cce19286-ec4f-4349-94c7-67f6ab63551c", "address": "fa:16:3e:99:11:08", "network": {"id": "268f60cb-1235-41c9-88d5-7b68c1de2795", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-595792232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce19286-ec", "ovs_interfaceid": "cce19286-ec4f-4349-94c7-67f6ab63551c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Converting VIF {"id": "cce19286-ec4f-4349-94c7-67f6ab63551c", "address": "fa:16:3e:99:11:08", "network": {"id": "268f60cb-1235-41c9-88d5-7b68c1de2795", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-595792232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce19286-ec", "ovs_interfaceid": "cce19286-ec4f-4349-94c7-67f6ab63551c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:11:08,bridge_name='br-int',has_traffic_filtering=True,id=cce19286-ec4f-4349-94c7-67f6ab63551c,network=Network(268f60cb-1235-41c9-88d5-7b68c1de2795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce19286-ec') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG os_vif [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:11:08,bridge_name='br-int',has_traffic_filtering=True,id=cce19286-ec4f-4349-94c7-67f6ab63551c,network=Network(268f60cb-1235-41c9-88d5-7b68c1de2795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce19286-ec') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0869ece-6837-568b-b2be-3b3a63be0c23', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcce19286-ec, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcce19286-ec, col_values=(('qos', UUID('719aa465-28d0-4062-ad8d-32f1e2f12369')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcce19286-ec, col_values=(('external_ids', {'iface-id': 'cce19286-ec4f-4349-94c7-67f6ab63551c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:11:08', 'vm-uuid': 'f6e9eab9-0445-4dcd-bd67-ef73e102c909'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:19 user nova-compute[75571]: INFO os_vif [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:11:08,bridge_name='br-int',has_traffic_filtering=True,id=cce19286-ec4f-4349-94c7-67f6ab63551c,network=Network(268f60cb-1235-41c9-88d5-7b68c1de2795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce19286-ec')
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] No BDM found with device name hda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:15:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] No VIF found with MAC fa:16:3e:99:11:08, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:15:19 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Using config drive
Nov 28 20:15:20 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Creating config drive at /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk.config
Nov 28 20:15:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo2thdp7q {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo2thdp7q" returned: 0 in 0.057s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:20 user nova-compute[75571]: DEBUG nova.network.neutron [req-9e45da63-5185-4127-b1f3-53a76602a88c req-5b4c6983-9b8c-4441-afc0-7b0098906771 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Updated VIF entry in instance network info cache for port cce19286-ec4f-4349-94c7-67f6ab63551c. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:15:20 user nova-compute[75571]: DEBUG nova.network.neutron [req-9e45da63-5185-4127-b1f3-53a76602a88c req-5b4c6983-9b8c-4441-afc0-7b0098906771 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Updating instance_info_cache with network_info: [{"id": "cce19286-ec4f-4349-94c7-67f6ab63551c", "address": "fa:16:3e:99:11:08", "network": {"id": "268f60cb-1235-41c9-88d5-7b68c1de2795", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-595792232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce19286-ec", "ovs_interfaceid": "cce19286-ec4f-4349-94c7-67f6ab63551c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:15:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9e45da63-5185-4127-b1f3-53a76602a88c req-5b4c6983-9b8c-4441-afc0-7b0098906771 service nova] Releasing lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:15:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-eca34c33-29e2-4bb6-8692-77d4a4e958af req-2a7394b7-ca07-4f79-b205-46dc44d17620 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received event network-vif-plugged-cce19286-ec4f-4349-94c7-67f6ab63551c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-eca34c33-29e2-4bb6-8692-77d4a4e958af req-2a7394b7-ca07-4f79-b205-46dc44d17620 service nova] Acquiring lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-eca34c33-29e2-4bb6-8692-77d4a4e958af req-2a7394b7-ca07-4f79-b205-46dc44d17620 service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-eca34c33-29e2-4bb6-8692-77d4a4e958af req-2a7394b7-ca07-4f79-b205-46dc44d17620 service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-eca34c33-29e2-4bb6-8692-77d4a4e958af req-2a7394b7-ca07-4f79-b205-46dc44d17620 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] No waiting events found dispatching network-vif-plugged-cce19286-ec4f-4349-94c7-67f6ab63551c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:21 user nova-compute[75571]: WARNING nova.compute.manager [req-eca34c33-29e2-4bb6-8692-77d4a4e958af req-2a7394b7-ca07-4f79-b205-46dc44d17620 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received unexpected event network-vif-plugged-cce19286-ec4f-4349-94c7-67f6ab63551c for instance with vm_state building and task_state spawning.
Nov 28 20:15:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-8be45b5e-89fc-4c99-9fb9-d33d211d3f1e req-7d3ad0e5-82b0-44f2-a180-65b735add47d service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received event network-vif-plugged-cce19286-ec4f-4349-94c7-67f6ab63551c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8be45b5e-89fc-4c99-9fb9-d33d211d3f1e req-7d3ad0e5-82b0-44f2-a180-65b735add47d service nova] Acquiring lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8be45b5e-89fc-4c99-9fb9-d33d211d3f1e req-7d3ad0e5-82b0-44f2-a180-65b735add47d service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8be45b5e-89fc-4c99-9fb9-d33d211d3f1e req-7d3ad0e5-82b0-44f2-a180-65b735add47d service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-8be45b5e-89fc-4c99-9fb9-d33d211d3f1e req-7d3ad0e5-82b0-44f2-a180-65b735add47d service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] No waiting events found dispatching network-vif-plugged-cce19286-ec4f-4349-94c7-67f6ab63551c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:23 user nova-compute[75571]: WARNING nova.compute.manager [req-8be45b5e-89fc-4c99-9fb9-d33d211d3f1e req-7d3ad0e5-82b0-44f2-a180-65b735add47d service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received unexpected event network-vif-plugged-cce19286-ec4f-4349-94c7-67f6ab63551c for instance with vm_state building and task_state spawning.
Nov 28 20:15:23 user nova-compute[75571]: DEBUG nova.compute.manager [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:15:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:15:23 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Instance spawned successfully.
Nov 28 20:15:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:15:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:24 user nova-compute[75571]: INFO nova.compute.manager [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Took 6.20 seconds to spawn the instance on the hypervisor.
Nov 28 20:15:24 user nova-compute[75571]: DEBUG nova.compute.manager [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:15:24 user nova-compute[75571]: INFO nova.compute.manager [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Took 7.25 seconds to build instance.
Nov 28 20:15:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.366s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:24 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a8112c4a-cb42-49df-81a7-97b42f5cc87d is timed out.
Nov 28 20:15:24 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Successfully detached device vdb from instance a8112c4a-cb42-49df-81a7-97b42f5cc87d from the live domain config.
Nov 28 20:15:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:15:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bfvnHdNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:15:24 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:15:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:15:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:15:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b26b1b-1924-4cf5-9034-ffe9b48ee8cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:15:24 user nova-compute[75571]: No targets found.
Nov 28 20:15:24 user nova-compute[75571]: iSNS:
Nov 28 20:15:24 user nova-compute[75571]: No targets found.
Nov 28 20:15:24 user nova-compute[75571]: STATIC:
Nov 28 20:15:24 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91
Nov 28 20:15:24 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:15:24 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:15:24 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3
Nov 28 20:15:24 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:15:24 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:15:24 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4
Nov 28 20:15:24 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:15:24 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:15:24 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72
Nov 28 20:15:24 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:15:24 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:15:24 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a
Nov 28 20:15:24 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:15:24 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:15:24 user nova-compute[75571]: FIRMWARE:
Nov 28 20:15:24 user nova-compute[75571]: No targets found.
Nov 28 20:15:24 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:15:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:15:24 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:15:24 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:15:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:15:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[79df64bb-b88b-4a13-abb3-903c52614e28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bea9416-be1d-49cf-b028-0cd37c981a7d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:25 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:25 user nova-compute[75571]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:15:25 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:15:25 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:15:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:25 user nova-compute[75571]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 (non-flash)
Nov 28 20:15:25 user nova-compute[75571]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:15:25 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:15:25 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:15:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77682f5c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91'): ({'sdc'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Removing single pathed devices sdc {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d23905f-ae6c-4ab0-b36c-4459cf3c6aa0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f884b6c-4602-47f8-861b-492f050269e5]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Flushing IO for device /dev/sdc {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff81620c-2c93-400a-b154-2ffe30dfc6eb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[684a9f0b-0734-4787-907f-73bfd9ece745]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec80c4ad-8c37-4a78-bb94-6da4e5b80aa8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aad4f1-57c5-4a1a-9135-2279809692f5]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91, portal: 172.16.0.220,3260]
Nov 28 20:15:25 user nova-compute[75571]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91, portal: 172.16.0.220,3260] successful.
Nov 28 20:15:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55971858-8dd0-45f6-ba68-a481db871e91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3b1ced-29e4-4131-9768-c26728b5a279]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] <== disconnect_volume: return (374ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:15:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:15:26 user nova-compute[75571]: DEBUG nova.objects.instance [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lazy-loading 'flavor' on Instance uuid a8112c4a-cb42-49df-81a7-97b42f5cc87d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:15:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.164s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "59a360a3-bce3-4673-b79e-cd0460d2a69a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:26 user nova-compute[75571]: INFO nova.compute.manager [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Terminating instance
Nov 28 20:15:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:15:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "e05b0276-16f8-4876-b37b-711b63d65823" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "e05b0276-16f8-4876-b37b-711b63d65823" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:15:27 user nova-compute[75571]: INFO nova.compute.claims [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Claim successful on node user
Nov 28 20:15:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:27 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Instance destroyed successfully.
Nov 28 20:15:27 user nova-compute[75571]: DEBUG nova.objects.instance [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lazy-loading 'resources' on Instance uuid 59a360a3-bce3-4673-b79e-cd0460d2a69a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T20:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1642565132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-875799677',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6AuAWbbxZ0a6c7k1XS3X9t+pB3TAuStJooLKz16kYFR2aaVuQipo+CXoACBi2Birf2Rm15MEr9uQoGxphTgBDTn1HrWp9mOU4ZppNU69KCYDLZF6bXiACp5QJvGeeHcw==',key_name='tempest-keypair-1302784070',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:14:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fed1996731e94c8eb5c16e6327b32f39',ramdisk_id='',reservation_id='r-lg4xji60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-323010200',owner_user_name='tempest-ServerActionsV293TestJSON-323010200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:14:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d313e776858a411ea463adecd1f36819',uuid=59a360a3-bce3-4673-b79e-cd0460d2a69a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Converting VIF {"id": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "address": "fa:16:3e:23:9b:4a", "network": {"id": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1397529441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed1996731e94c8eb5c16e6327b32f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1934d1e-ff", "ovs_interfaceid": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:9b:4a,bridge_name='br-int',has_traffic_filtering=True,id=d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c,network=Network(8b0c6ae3-604b-433f-920b-f28cc17a9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1934d1e-ff') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_vif [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:9b:4a,bridge_name='br-int',has_traffic_filtering=True,id=d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c,network=Network(8b0c6ae3-604b-433f-920b-f28cc17a9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1934d1e-ff') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1934d1e-ff, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6ecff0a-496e-441f-a2b5-a41805b05600) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:27 user nova-compute[75571]: INFO os_vif [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:9b:4a,bridge_name='br-int',has_traffic_filtering=True,id=d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c,network=Network(8b0c6ae3-604b-433f-920b-f28cc17a9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1934d1e-ff')
Nov 28 20:15:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLvfdWST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:15:27 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd71ca0a-9215-46b5-adaa-574eff7cef48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:15:27 user nova-compute[75571]: No targets found.
Nov 28 20:15:27 user nova-compute[75571]: iSNS:
Nov 28 20:15:27 user nova-compute[75571]: No targets found.
Nov 28 20:15:27 user nova-compute[75571]: STATIC:
Nov 28 20:15:27 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3
Nov 28 20:15:27 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:15:27 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:15:27 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4
Nov 28 20:15:27 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:15:27 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:15:27 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72
Nov 28 20:15:27 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:15:27 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:15:27 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a
Nov 28 20:15:27 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:15:27 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:15:27 user nova-compute[75571]: FIRMWARE:
Nov 28 20:15:27 user nova-compute[75571]: No targets found.
Nov 28 20:15:27 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:15:27 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:15:27 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a20f35-cd58-470d-87fb-2e12c7e7f4db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbecdb76-7997-4671-bd8e-0ebd8267557b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:27 user nova-compute[75571]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:15:27 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:15:27 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:15:27 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 (non-flash)
Nov 28 20:15:27 user nova-compute[75571]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:15:27 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:15:27 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:15:27 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77687f2b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9c0a8a-c199-48c8-b996-fabf007f03f2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28376cc-f207-4322-9eed-3ba109c3bb33]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[236296f3-f8b4-4dad-8e74-55f6f335f1fd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.074s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc8347e-cca6-4e33-918d-6695b60d29f3]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5139ddec-a32d-40af-be12-8874a56efdb5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:15:27 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5c655d-cd76-40b5-b31e-9c1ed6b8bc3e]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260]
Nov 28 20:15:28 user nova-compute[75571]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72, portal: 172.16.0.220,3260] successful.
Nov 28 20:15:28 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0184f2-4a56-4d02-95cb-f5b41506ed72 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3996221a-2802-430c-a9b1-71606c8f1c70]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.454s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] <== disconnect_volume: return (454ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:15:28 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Deleting instance files /opt/stack/data/nova/instances/59a360a3-bce3-4673-b79e-cd0460d2a69a_del
Nov 28 20:15:28 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Deletion of /opt/stack/data/nova/instances/59a360a3-bce3-4673-b79e-cd0460d2a69a_del complete
Nov 28 20:15:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:15:28 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:15:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:15:28 user nova-compute[75571]: INFO nova.compute.manager [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG nova.policy [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '854e01c9d8d644299bbf6b9a18e00fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed5b9f19e584ca5bd8bf2d75b5ee765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:15:28 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Creating image(s)
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "/opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "/opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "/opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.204s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.009s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.207s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk 1073741824" returned: 0 in 0.052s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:28 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Successfully created port: 3f17c541-af4d-4b2a-97c2-ede6623f7609 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.218s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Cannot resize image /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Ensure instance console log exists: /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Successfully updated port: 3f17c541-af4d-4b2a-97c2-ede6623f7609 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "refresh_cache-e05b0276-16f8-4876-b37b-711b63d65823" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquired lock "refresh_cache-e05b0276-16f8-4876-b37b-711b63d65823" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-902a6081-75a2-4c57-a289-ff3ac8dde0b6 req-1a5f2b0e-e0dd-4c18-902d-034337cb7fe3 service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Received event network-changed-3f17c541-af4d-4b2a-97c2-ede6623f7609 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-902a6081-75a2-4c57-a289-ff3ac8dde0b6 req-1a5f2b0e-e0dd-4c18-902d-034337cb7fe3 service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Refreshing instance network info cache due to event network-changed-3f17c541-af4d-4b2a-97c2-ede6623f7609. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-902a6081-75a2-4c57-a289-ff3ac8dde0b6 req-1a5f2b0e-e0dd-4c18-902d-034337cb7fe3 service nova] Acquiring lock "refresh_cache-e05b0276-16f8-4876-b37b-711b63d65823" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:15:29 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:15:29 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Took 1.76 seconds to deallocate network for instance.
Nov 28 20:15:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-054b1ec5-41a5-4eaa-b6ac-64f6029ebee5 req-4f6c7ee1-492b-4d6b-805c-623c6f7b7e6d service nova] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Received event network-vif-deleted-d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Updating instance_info_cache with network_info: [{"id": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "address": "fa:16:3e:17:b7:60", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f17c541-af", "ovs_interfaceid": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Releasing lock "refresh_cache-e05b0276-16f8-4876-b37b-711b63d65823" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Instance network_info: |[{"id": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "address": "fa:16:3e:17:b7:60", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f17c541-af", "ovs_interfaceid": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-902a6081-75a2-4c57-a289-ff3ac8dde0b6 req-1a5f2b0e-e0dd-4c18-902d-034337cb7fe3 service nova] Acquired lock "refresh_cache-e05b0276-16f8-4876-b37b-711b63d65823" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.network.neutron [req-902a6081-75a2-4c57-a289-ff3ac8dde0b6 req-1a5f2b0e-e0dd-4c18-902d-034337cb7fe3 service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Refreshing network info cache for port 3f17c541-af4d-4b2a-97c2-ede6623f7609 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Start _get_guest_xml network_info=[{"id": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "address": "fa:16:3e:17:b7:60", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f17c541-af", "ovs_interfaceid": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:15:30 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:15:30 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-489468757',display_name='tempest-VolumesActionsTest-instance-489468757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-489468757',id=16,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed5b9f19e584ca5bd8bf2d75b5ee765',ramdisk_id='',reservation_id='r-zjcbaw0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1803837223',owner_user_name='tempest-VolumesActionsTest-1803837223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:15:28Z,user_data=None,user_id='854e01c9d8d644299bbf6b9a18e00fcd',uuid=e05b0276-16f8-4876-b37b-711b63d65823,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "address": "fa:16:3e:17:b7:60", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f17c541-af", "ovs_interfaceid": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Converting VIF {"id": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "address": "fa:16:3e:17:b7:60", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f17c541-af", "ovs_interfaceid": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:b7:60,bridge_name='br-int',has_traffic_filtering=True,id=3f17c541-af4d-4b2a-97c2-ede6623f7609,network=Network(00de1a40-1743-4c1d-a032-0ae863c7e009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f17c541-af') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.objects.instance [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lazy-loading 'pci_devices' on Instance uuid e05b0276-16f8-4876-b37b-711b63d65823 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:15:30 user nova-compute[75571]:   <uuid>e05b0276-16f8-4876-b37b-711b63d65823</uuid>
Nov 28 20:15:30 user nova-compute[75571]:   <name>instance-00000010</name>
Nov 28 20:15:30 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:15:30 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:15:30 user nova-compute[75571]:   <metadata>
Nov 28 20:15:30 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:15:30 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:15:30 user nova-compute[75571]:       <nova:name>tempest-VolumesActionsTest-instance-489468757</nova:name>
Nov 28 20:15:30 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:15:30</nova:creationTime>
Nov 28 20:15:30 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:15:30 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:15:30 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:15:30 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:15:30 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:15:30 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:15:30 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:15:30 user nova-compute[75571]:       <nova:owner>
Nov 28 20:15:30 user nova-compute[75571]:         <nova:user uuid="854e01c9d8d644299bbf6b9a18e00fcd">tempest-VolumesActionsTest-1803837223-project-member</nova:user>
Nov 28 20:15:30 user nova-compute[75571]:         <nova:project uuid="bed5b9f19e584ca5bd8bf2d75b5ee765">tempest-VolumesActionsTest-1803837223</nova:project>
Nov 28 20:15:30 user nova-compute[75571]:       </nova:owner>
Nov 28 20:15:30 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:15:30 user nova-compute[75571]:       <nova:ports>
Nov 28 20:15:30 user nova-compute[75571]:         <nova:port uuid="3f17c541-af4d-4b2a-97c2-ede6623f7609">
Nov 28 20:15:30 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 20:15:30 user nova-compute[75571]:         </nova:port>
Nov 28 20:15:30 user nova-compute[75571]:       </nova:ports>
Nov 28 20:15:30 user nova-compute[75571]:     </nova:instance>
Nov 28 20:15:30 user nova-compute[75571]:   </metadata>
Nov 28 20:15:30 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:15:30 user nova-compute[75571]:     <system>
Nov 28 20:15:30 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:15:30 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:15:30 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:15:30 user nova-compute[75571]:       <entry name="serial">e05b0276-16f8-4876-b37b-711b63d65823</entry>
Nov 28 20:15:30 user nova-compute[75571]:       <entry name="uuid">e05b0276-16f8-4876-b37b-711b63d65823</entry>
Nov 28 20:15:30 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:15:30 user nova-compute[75571]:     </system>
Nov 28 20:15:30 user nova-compute[75571]:   </sysinfo>
Nov 28 20:15:30 user nova-compute[75571]:   <os>
Nov 28 20:15:30 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:15:30 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:15:30 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:15:30 user nova-compute[75571]:   </os>
Nov 28 20:15:30 user nova-compute[75571]:   <features>
Nov 28 20:15:30 user nova-compute[75571]:     <acpi/>
Nov 28 20:15:30 user nova-compute[75571]:     <apic/>
Nov 28 20:15:30 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:15:30 user nova-compute[75571]:   </features>
Nov 28 20:15:30 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:15:30 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:15:30 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:15:30 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:15:30 user nova-compute[75571]:   </clock>
Nov 28 20:15:30 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:15:30 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:15:30 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:15:30 user nova-compute[75571]:   </cpu>
Nov 28 20:15:30 user nova-compute[75571]:   <devices>
Nov 28 20:15:30 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:15:30 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:15:30 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk"/>
Nov 28 20:15:30 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:15:30 user nova-compute[75571]:     </disk>
Nov 28 20:15:30 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:15:30 user nova-compute[75571]:       <mac address="fa:16:3e:17:b7:60"/>
Nov 28 20:15:30 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:15:30 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:15:30 user nova-compute[75571]:       <target dev="tap3f17c541-af"/>
Nov 28 20:15:30 user nova-compute[75571]:     </interface>
Nov 28 20:15:30 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:15:30 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/console.log" append="off"/>
Nov 28 20:15:30 user nova-compute[75571]:     </serial>
Nov 28 20:15:30 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:15:30 user nova-compute[75571]:     <video>
Nov 28 20:15:30 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:15:30 user nova-compute[75571]:     </video>
Nov 28 20:15:30 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:15:30 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:15:30 user nova-compute[75571]:     </rng>
Nov 28 20:15:30 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:15:30 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:15:30 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:15:30 user nova-compute[75571]:     </memballoon>
Nov 28 20:15:30 user nova-compute[75571]:   </devices>
Nov 28 20:15:30 user nova-compute[75571]: </domain>
Nov 28 20:15:30 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-489468757',display_name='tempest-VolumesActionsTest-instance-489468757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-489468757',id=16,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed5b9f19e584ca5bd8bf2d75b5ee765',ramdisk_id='',reservation_id='r-zjcbaw0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1803837223',owner_user_name='tempest-VolumesActionsTest-1803837223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:15:28Z,user_data=None,user_id='854e01c9d8d644299bbf6b9a18e00fcd',uuid=e05b0276-16f8-4876-b37b-711b63d65823,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "address": "fa:16:3e:17:b7:60", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f17c541-af", "ovs_interfaceid": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Converting VIF {"id": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "address": "fa:16:3e:17:b7:60", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f17c541-af", "ovs_interfaceid": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:b7:60,bridge_name='br-int',has_traffic_filtering=True,id=3f17c541-af4d-4b2a-97c2-ede6623f7609,network=Network(00de1a40-1743-4c1d-a032-0ae863c7e009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f17c541-af') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG os_vif [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:b7:60,bridge_name='br-int',has_traffic_filtering=True,id=3f17c541-af4d-4b2a-97c2-ede6623f7609,network=Network(00de1a40-1743-4c1d-a032-0ae863c7e009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f17c541-af') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc7b93c8-fc20-587c-8330-a1d5c69dedec', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f17c541-af, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f17c541-af, col_values=(('qos', UUID('90cb8fa7-4dbf-4e47-ab6a-772689eb409d')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f17c541-af, col_values=(('external_ids', {'iface-id': '3f17c541-af4d-4b2a-97c2-ede6623f7609', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:b7:60', 'vm-uuid': 'e05b0276-16f8-4876-b37b-711b63d65823'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:30 user nova-compute[75571]: INFO os_vif [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:b7:60,bridge_name='br-int',has_traffic_filtering=True,id=3f17c541-af4d-4b2a-97c2-ede6623f7609,network=Network(00de1a40-1743-4c1d-a032-0ae863c7e009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f17c541-af')
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] No VIF found with MAC fa:16:3e:17:b7:60, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.network.neutron [req-902a6081-75a2-4c57-a289-ff3ac8dde0b6 req-1a5f2b0e-e0dd-4c18-902d-034337cb7fe3 service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Updated VIF entry in instance network info cache for port 3f17c541-af4d-4b2a-97c2-ede6623f7609. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG nova.network.neutron [req-902a6081-75a2-4c57-a289-ff3ac8dde0b6 req-1a5f2b0e-e0dd-4c18-902d-034337cb7fe3 service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Updating instance_info_cache with network_info: [{"id": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "address": "fa:16:3e:17:b7:60", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f17c541-af", "ovs_interfaceid": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:15:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-902a6081-75a2-4c57-a289-ff3ac8dde0b6 req-1a5f2b0e-e0dd-4c18-902d-034337cb7fe3 service nova] Releasing lock "refresh_cache-e05b0276-16f8-4876-b37b-711b63d65823" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:15:31 user nova-compute[75571]: INFO nova.compute.manager [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Took 1.07 seconds to detach 1 volumes for instance.
Nov 28 20:15:31 user nova-compute[75571]: DEBUG nova.compute.manager [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Deleting volume: fa0184f2-4a56-4d02-95cb-f5b41506ed72 {{(pid=75571) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 20:15:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:31 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:15:31 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:15:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.757s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:31 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Deleted allocations for instance 59a360a3-bce3-4673-b79e-cd0460d2a69a
Nov 28 20:15:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "59a360a3-bce3-4673-b79e-cd0460d2a69a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.450s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "40ac5386-d43f-443c-ac15-186b368728f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:32 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-b167e356-329c-42f7-a0c6-b813071b7466 req-e9686df8-7e66-40e4-a3e5-f06bb60b3e59 service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Received event network-vif-plugged-3f17c541-af4d-4b2a-97c2-ede6623f7609 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b167e356-329c-42f7-a0c6-b813071b7466 req-e9686df8-7e66-40e4-a3e5-f06bb60b3e59 service nova] Acquiring lock "e05b0276-16f8-4876-b37b-711b63d65823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b167e356-329c-42f7-a0c6-b813071b7466 req-e9686df8-7e66-40e4-a3e5-f06bb60b3e59 service nova] Lock "e05b0276-16f8-4876-b37b-711b63d65823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b167e356-329c-42f7-a0c6-b813071b7466 req-e9686df8-7e66-40e4-a3e5-f06bb60b3e59 service nova] Lock "e05b0276-16f8-4876-b37b-711b63d65823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-b167e356-329c-42f7-a0c6-b813071b7466 req-e9686df8-7e66-40e4-a3e5-f06bb60b3e59 service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] No waiting events found dispatching network-vif-plugged-3f17c541-af4d-4b2a-97c2-ede6623f7609 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:33 user nova-compute[75571]: WARNING nova.compute.manager [req-b167e356-329c-42f7-a0c6-b813071b7466 req-e9686df8-7e66-40e4-a3e5-f06bb60b3e59 service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Received unexpected event network-vif-plugged-3f17c541-af4d-4b2a-97c2-ede6623f7609 for instance with vm_state building and task_state spawning.
Nov 28 20:15:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:15:33 user nova-compute[75571]: INFO nova.compute.claims [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Claim successful on node user
Nov 28 20:15:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.692s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:15:33 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:15:33 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:15:33 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:15:34 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Creating image(s)
Nov 28 20:15:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "/opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "/opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "/opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG nova.policy [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.210s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.199s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk 1073741824" returned: 0 in 0.062s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.183s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:15:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Cannot resize image /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Ensure instance console log exists: /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-9933c64d-13a6-4319-a8e1-edba36560fb8 req-1244bb9e-bb59-4d90-be50-0ba51ebf750c service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Received event network-vif-plugged-3f17c541-af4d-4b2a-97c2-ede6623f7609 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9933c64d-13a6-4319-a8e1-edba36560fb8 req-1244bb9e-bb59-4d90-be50-0ba51ebf750c service nova] Acquiring lock "e05b0276-16f8-4876-b37b-711b63d65823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9933c64d-13a6-4319-a8e1-edba36560fb8 req-1244bb9e-bb59-4d90-be50-0ba51ebf750c service nova] Lock "e05b0276-16f8-4876-b37b-711b63d65823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9933c64d-13a6-4319-a8e1-edba36560fb8 req-1244bb9e-bb59-4d90-be50-0ba51ebf750c service nova] Lock "e05b0276-16f8-4876-b37b-711b63d65823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-9933c64d-13a6-4319-a8e1-edba36560fb8 req-1244bb9e-bb59-4d90-be50-0ba51ebf750c service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] No waiting events found dispatching network-vif-plugged-3f17c541-af4d-4b2a-97c2-ede6623f7609 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:35 user nova-compute[75571]: WARNING nova.compute.manager [req-9933c64d-13a6-4319-a8e1-edba36560fb8 req-1244bb9e-bb59-4d90-be50-0ba51ebf750c service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Received unexpected event network-vif-plugged-3f17c541-af4d-4b2a-97c2-ede6623f7609 for instance with vm_state building and task_state spawning.
Nov 28 20:15:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:15:35 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Instance spawned successfully.
Nov 28 20:15:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:35 user nova-compute[75571]: INFO nova.compute.manager [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Took 7.39 seconds to spawn the instance on the hypervisor.
Nov 28 20:15:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:15:36 user nova-compute[75571]: INFO nova.compute.manager [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Took 8.71 seconds to build instance.
Nov 28 20:15:36 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Successfully created port: 38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:15:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "e05b0276-16f8-4876-b37b-711b63d65823" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.098s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Successfully updated port: 38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquired lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-c5a3bd3a-1de6-46e8-acf7-3d91b7d091e8 req-42abde45-19a7-4903-897c-c4a652edd776 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-changed-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-c5a3bd3a-1de6-46e8-acf7-3d91b7d091e8 req-42abde45-19a7-4903-897c-c4a652edd776 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Refreshing instance network info cache due to event network-changed-38a389ab-f2f2-413a-85e1-b40415fc156c. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c5a3bd3a-1de6-46e8-acf7-3d91b7d091e8 req-42abde45-19a7-4903-897c-c4a652edd776 service nova] Acquiring lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating instance_info_cache with network_info: [{"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Releasing lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Instance network_info: |[{"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c5a3bd3a-1de6-46e8-acf7-3d91b7d091e8 req-42abde45-19a7-4903-897c-c4a652edd776 service nova] Acquired lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.network.neutron [req-c5a3bd3a-1de6-46e8-acf7-3d91b7d091e8 req-42abde45-19a7-4903-897c-c4a652edd776 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Refreshing network info cache for port 38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Start _get_guest_xml network_info=[{"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:15:37 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:15:37 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2039159279',display_name='tempest-ServerActionsTestOtherB-server-2039159279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2039159279',id=17,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGleHnng/iZf+pKcaRfN4ki3/kKcZ1lAUwQTncf758ioT4v9Nu4+2KyDgP5bUFKo8JEMegAuoMjbKaD/3O2Xdr1tfYfEaBfckP1a0BpsnLhWEjCdte2x0agDjBhSwM7chQ==',key_name='tempest-keypair-1179232993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8895df748b4644e9bad362ea318e04c7',ramdisk_id='',reservation_id='r-dfynuxpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1446981498',owner_user_name='tempest-ServerActionsTestOtherB-1446981498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:15:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ffae0c69e0c40e0917cf412e7757616',uuid=40ac5386-d43f-443c-ac15-186b368728f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converting VIF {"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.objects.instance [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lazy-loading 'pci_devices' on Instance uuid 40ac5386-d43f-443c-ac15-186b368728f8 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:15:37 user nova-compute[75571]:   <uuid>40ac5386-d43f-443c-ac15-186b368728f8</uuid>
Nov 28 20:15:37 user nova-compute[75571]:   <name>instance-00000011</name>
Nov 28 20:15:37 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:15:37 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:15:37 user nova-compute[75571]:   <metadata>
Nov 28 20:15:37 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:15:37 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:15:37 user nova-compute[75571]:       <nova:name>tempest-ServerActionsTestOtherB-server-2039159279</nova:name>
Nov 28 20:15:37 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:15:37</nova:creationTime>
Nov 28 20:15:37 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:15:37 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:15:37 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:15:37 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:15:37 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:15:37 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:15:37 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:15:37 user nova-compute[75571]:       <nova:owner>
Nov 28 20:15:37 user nova-compute[75571]:         <nova:user uuid="0ffae0c69e0c40e0917cf412e7757616">tempest-ServerActionsTestOtherB-1446981498-project-member</nova:user>
Nov 28 20:15:37 user nova-compute[75571]:         <nova:project uuid="8895df748b4644e9bad362ea318e04c7">tempest-ServerActionsTestOtherB-1446981498</nova:project>
Nov 28 20:15:37 user nova-compute[75571]:       </nova:owner>
Nov 28 20:15:37 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:15:37 user nova-compute[75571]:       <nova:ports>
Nov 28 20:15:37 user nova-compute[75571]:         <nova:port uuid="38a389ab-f2f2-413a-85e1-b40415fc156c">
Nov 28 20:15:37 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:15:37 user nova-compute[75571]:         </nova:port>
Nov 28 20:15:37 user nova-compute[75571]:       </nova:ports>
Nov 28 20:15:37 user nova-compute[75571]:     </nova:instance>
Nov 28 20:15:37 user nova-compute[75571]:   </metadata>
Nov 28 20:15:37 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:15:37 user nova-compute[75571]:     <system>
Nov 28 20:15:37 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:15:37 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:15:37 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:15:37 user nova-compute[75571]:       <entry name="serial">40ac5386-d43f-443c-ac15-186b368728f8</entry>
Nov 28 20:15:37 user nova-compute[75571]:       <entry name="uuid">40ac5386-d43f-443c-ac15-186b368728f8</entry>
Nov 28 20:15:37 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:15:37 user nova-compute[75571]:     </system>
Nov 28 20:15:37 user nova-compute[75571]:   </sysinfo>
Nov 28 20:15:37 user nova-compute[75571]:   <os>
Nov 28 20:15:37 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:15:37 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:15:37 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:15:37 user nova-compute[75571]:   </os>
Nov 28 20:15:37 user nova-compute[75571]:   <features>
Nov 28 20:15:37 user nova-compute[75571]:     <acpi/>
Nov 28 20:15:37 user nova-compute[75571]:     <apic/>
Nov 28 20:15:37 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:15:37 user nova-compute[75571]:   </features>
Nov 28 20:15:37 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:15:37 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:15:37 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:15:37 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:15:37 user nova-compute[75571]:   </clock>
Nov 28 20:15:37 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:15:37 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:15:37 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:15:37 user nova-compute[75571]:   </cpu>
Nov 28 20:15:37 user nova-compute[75571]:   <devices>
Nov 28 20:15:37 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:15:37 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:15:37 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk"/>
Nov 28 20:15:37 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:15:37 user nova-compute[75571]:     </disk>
Nov 28 20:15:37 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:15:37 user nova-compute[75571]:       <mac address="fa:16:3e:68:de:09"/>
Nov 28 20:15:37 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:15:37 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:15:37 user nova-compute[75571]:       <target dev="tap38a389ab-f2"/>
Nov 28 20:15:37 user nova-compute[75571]:     </interface>
Nov 28 20:15:37 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:15:37 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/console.log" append="off"/>
Nov 28 20:15:37 user nova-compute[75571]:     </serial>
Nov 28 20:15:37 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:15:37 user nova-compute[75571]:     <video>
Nov 28 20:15:37 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:15:37 user nova-compute[75571]:     </video>
Nov 28 20:15:37 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:15:37 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:15:37 user nova-compute[75571]:     </rng>
Nov 28 20:15:37 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:15:37 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:15:37 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:15:37 user nova-compute[75571]:     </memballoon>
Nov 28 20:15:37 user nova-compute[75571]:   </devices>
Nov 28 20:15:37 user nova-compute[75571]: </domain>
Nov 28 20:15:37 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2039159279',display_name='tempest-ServerActionsTestOtherB-server-2039159279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2039159279',id=17,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGleHnng/iZf+pKcaRfN4ki3/kKcZ1lAUwQTncf758ioT4v9Nu4+2KyDgP5bUFKo8JEMegAuoMjbKaD/3O2Xdr1tfYfEaBfckP1a0BpsnLhWEjCdte2x0agDjBhSwM7chQ==',key_name='tempest-keypair-1179232993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8895df748b4644e9bad362ea318e04c7',ramdisk_id='',reservation_id='r-dfynuxpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1446981498',owner_user_name='tempest-ServerActionsTestOtherB-1446981498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:15:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ffae0c69e0c40e0917cf412e7757616',uuid=40ac5386-d43f-443c-ac15-186b368728f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converting VIF {"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG os_vif [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90e5cae5-b4a3-5a4f-94f1-29409c33c29f', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38a389ab-f2, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38a389ab-f2, col_values=(('qos', UUID('30966d17-d909-4329-9ac5-aab3b97c46f3')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38a389ab-f2, col_values=(('external_ids', {'iface-id': '38a389ab-f2f2-413a-85e1-b40415fc156c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:de:09', 'vm-uuid': '40ac5386-d43f-443c-ac15-186b368728f8'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:15:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:15:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:38 user nova-compute[75571]: INFO os_vif [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2')
Nov 28 20:15:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:15:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] No VIF found with MAC fa:16:3e:68:de:09, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:15:38 user nova-compute[75571]: DEBUG nova.network.neutron [req-c5a3bd3a-1de6-46e8-acf7-3d91b7d091e8 req-42abde45-19a7-4903-897c-c4a652edd776 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updated VIF entry in instance network info cache for port 38a389ab-f2f2-413a-85e1-b40415fc156c. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:15:38 user nova-compute[75571]: DEBUG nova.network.neutron [req-c5a3bd3a-1de6-46e8-acf7-3d91b7d091e8 req-42abde45-19a7-4903-897c-c4a652edd776 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating instance_info_cache with network_info: [{"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:15:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c5a3bd3a-1de6-46e8-acf7-3d91b7d091e8 req-42abde45-19a7-4903-897c-c4a652edd776 service nova] Releasing lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:15:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-1f9762fa-bfa9-43bf-b78a-2ff93fd0b243 req-0098a727-c3fc-4eed-b4f4-b9e9c4097cff service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1f9762fa-bfa9-43bf-b78a-2ff93fd0b243 req-0098a727-c3fc-4eed-b4f4-b9e9c4097cff service nova] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1f9762fa-bfa9-43bf-b78a-2ff93fd0b243 req-0098a727-c3fc-4eed-b4f4-b9e9c4097cff service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1f9762fa-bfa9-43bf-b78a-2ff93fd0b243 req-0098a727-c3fc-4eed-b4f4-b9e9c4097cff service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-1f9762fa-bfa9-43bf-b78a-2ff93fd0b243 req-0098a727-c3fc-4eed-b4f4-b9e9c4097cff service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] No waiting events found dispatching network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:40 user nova-compute[75571]: WARNING nova.compute.manager [req-1f9762fa-bfa9-43bf-b78a-2ff93fd0b243 req-0098a727-c3fc-4eed-b4f4-b9e9c4097cff service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received unexpected event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c for instance with vm_state building and task_state spawning.
Nov 28 20:15:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:15:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:15:42 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Instance spawned successfully.
Nov 28 20:15:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:15:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:15:42 user nova-compute[75571]: INFO nova.compute.manager [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Took 8.23 seconds to spawn the instance on the hypervisor.
Nov 28 20:15:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:15:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-2cb9af80-3cba-4371-a999-146a5d7fb489 req-4de3b3ac-04a8-4298-9e37-f7028aada8df service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2cb9af80-3cba-4371-a999-146a5d7fb489 req-4de3b3ac-04a8-4298-9e37-f7028aada8df service nova] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2cb9af80-3cba-4371-a999-146a5d7fb489 req-4de3b3ac-04a8-4298-9e37-f7028aada8df service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2cb9af80-3cba-4371-a999-146a5d7fb489 req-4de3b3ac-04a8-4298-9e37-f7028aada8df service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-2cb9af80-3cba-4371-a999-146a5d7fb489 req-4de3b3ac-04a8-4298-9e37-f7028aada8df service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] No waiting events found dispatching network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:15:42 user nova-compute[75571]: WARNING nova.compute.manager [req-2cb9af80-3cba-4371-a999-146a5d7fb489 req-4de3b3ac-04a8-4298-9e37-f7028aada8df service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received unexpected event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c for instance with vm_state building and task_state spawning.
Nov 28 20:15:42 user nova-compute[75571]: INFO nova.compute.manager [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Took 9.41 seconds to build instance.
Nov 28 20:15:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "40ac5386-d43f-443c-ac15-186b368728f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.632s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:52 user nova-compute[75571]: DEBUG nova.compute.manager [req-403c57de-b648-4639-80b1-b88dc7d4a5ea req-36aadf06-c175-4470-a10c-d282124eb3bf service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received event network-changed-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:15:52 user nova-compute[75571]: DEBUG nova.compute.manager [req-403c57de-b648-4639-80b1-b88dc7d4a5ea req-36aadf06-c175-4470-a10c-d282124eb3bf service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Refreshing instance network info cache due to event network-changed-0bae30f2-569a-4d1d-8e35-77ad39e87209. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:15:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-403c57de-b648-4639-80b1-b88dc7d4a5ea req-36aadf06-c175-4470-a10c-d282124eb3bf service nova] Acquiring lock "refresh_cache-b4000485-c53c-46e7-b585-cec40c114ec9" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:15:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-403c57de-b648-4639-80b1-b88dc7d4a5ea req-36aadf06-c175-4470-a10c-d282124eb3bf service nova] Acquired lock "refresh_cache-b4000485-c53c-46e7-b585-cec40c114ec9" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:15:52 user nova-compute[75571]: DEBUG nova.network.neutron [req-403c57de-b648-4639-80b1-b88dc7d4a5ea req-36aadf06-c175-4470-a10c-d282124eb3bf service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Refreshing network info cache for port 0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:15:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:53 user nova-compute[75571]: DEBUG nova.network.neutron [req-403c57de-b648-4639-80b1-b88dc7d4a5ea req-36aadf06-c175-4470-a10c-d282124eb3bf service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Updated VIF entry in instance network info cache for port 0bae30f2-569a-4d1d-8e35-77ad39e87209. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:15:53 user nova-compute[75571]: DEBUG nova.network.neutron [req-403c57de-b648-4639-80b1-b88dc7d4a5ea req-36aadf06-c175-4470-a10c-d282124eb3bf service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Updating instance_info_cache with network_info: [{"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:15:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-403c57de-b648-4639-80b1-b88dc7d4a5ea req-36aadf06-c175-4470-a10c-d282124eb3bf service nova] Releasing lock "refresh_cache-b4000485-c53c-46e7-b585-cec40c114ec9" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "b4000485-c53c-46e7-b585-cec40c114ec9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "b4000485-c53c-46e7-b585-cec40c114ec9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lazy-loading 'flavor' on Instance uuid b4000485-c53c-46e7-b585-cec40c114ec9 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "b4000485-c53c-46e7-b585-cec40c114ec9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "b4000485-c53c-46e7-b585-cec40c114ec9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "b4000485-c53c-46e7-b585-cec40c114ec9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:15:54 user nova-compute[75571]: INFO nova.compute.manager [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Attaching volume be8885e7-c3ff-4344-ba63-87e0e83cf851 to /dev/vdb
Nov 28 20:15:54 user nova-compute[75571]: DEBUG os_brick.utils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db74e3e-a912-442f-a6a8-d33c9bf9134a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa422b3-9e5e-481f-8393-ca831cbd080f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.054s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7271fe-ec73-4e46-9bac-5a93922937ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3a5bb1-b335-4702-b483-f2c3e0218ff1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:15:54 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:15:54 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[818357a7-9c9a-4c29-bc98-fc23221ed6ba]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG os_brick.utils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:15:54 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Updating existing volume attachment record: 9bdf0d13-8b64-4bd7-a69b-1407bf4928f6 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:15:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:15:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:00 user nova-compute[75571]: DEBUG nova.compute.manager [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:16:00 user nova-compute[75571]: INFO nova.compute.manager [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] instance snapshotting
Nov 28 20:16:00 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Beginning live snapshot process
Nov 28 20:16:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json -f qcow2 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json -f qcow2" returned: 0 in 0.250s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json -f qcow2 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json -f qcow2" returned: 0 in 0.222s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.236s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsj6hau5q/c61615ee22a947ef92c418c851dfaf48.delta 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsj6hau5q/c61615ee22a947ef92c418c851dfaf48.delta 1073741824" returned: 0 in 0.060s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:01 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 20:16:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:16:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] COPY block job progress, current cursor: 15400960 final cursor: 75563008 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnSTsjQG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:16:03 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:16:03 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:16:03 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[92da4542-4f7f-4670-9cd8-2929e43913c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:16:03 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6acc13-d1b1-49e9-97d9-73d362181c88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851] added
Nov 28 20:16:03 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69be8bd-8ca4-4168-b706-0b06ef95b7e9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[10855798-8d08-4539-9194-6267d4f018c4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YnSTsjQG {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YnSTsjQG" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[909dc410-3432-4c42-b33f-3619f705e519]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YnSTsjQG'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46a6e51-98b4-4b4d-8032-ffa91cecbf0d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb841172-0853-4a78-b4cc-60def7a0c1fd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:16:03 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:03 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:03 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:16:03 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:03 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:03 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:16:03 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb89deec-d899-47ce-8935-8c46a22a6e5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260]
Nov 28 20:16:03 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260] successful.
Nov 28 20:16:03 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsj6hau5q/c61615ee22a947ef92c418c851dfaf48.delta /opt/stack/data/nova/instances/snapshots/tmpsj6hau5q/c61615ee22a947ef92c418c851dfaf48 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c81561-b3f5-465a-bb00-f442882a9593]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb213fa0-3f4a-4bde-aa22-4dc17f2a51db]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:16:03 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:03 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:03 user nova-compute[75571]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:16:03 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:16:03 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:03 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:03 user nova-compute[75571]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:16:03 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[11928aa9-edc6-4456-a974-54c5e6b92c83]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnSTsjQG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:16:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsj6hau5q/c61615ee22a947ef92c418c851dfaf48.delta /opt/stack/data/nova/instances/snapshots/tmpsj6hau5q/c61615ee22a947ef92c418c851dfaf48" returned: 0 in 0.847s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Snapshot extracted, beginning image upload
Nov 28 20:16:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:16:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23234353131623232', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:16:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234353131623232', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:16:04 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lazy-loading 'flavor' on Instance uuid b4000485-c53c-46e7-b585-cec40c114ec9 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:16:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:16:04 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:16:04 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:16:04 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:16:04 user nova-compute[75571]:   <serial>be8885e7-c3ff-4344-ba63-87e0e83cf851</serial>
Nov 28 20:16:04 user nova-compute[75571]: </disk>
Nov 28 20:16:04 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:16:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:16:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:16:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] No VIF found with MAC fa:16:3e:35:4b:c8, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:16:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "b4000485-c53c-46e7-b585-cec40c114ec9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.904s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:16:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 3b0d4ca0-b527-4131-97ff-222cd9ced151 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updating instance_info_cache with network_info: [{"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:16:06 user nova-compute[75571]: INFO nova.compute.manager [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Rebuilding instance
Nov 28 20:16:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG nova.compute.manager [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk --force-share --output=json" returned: 0 in 0.431s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-2d7d8032-e510-43d3-91e6-293ac9ecdb58 req-88afd449-5caf-440b-a775-d74620afdcf5 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received event network-vif-unplugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2d7d8032-e510-43d3-91e6-293ac9ecdb58 req-88afd449-5caf-440b-a775-d74620afdcf5 service nova] Acquiring lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2d7d8032-e510-43d3-91e6-293ac9ecdb58 req-88afd449-5caf-440b-a775-d74620afdcf5 service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2d7d8032-e510-43d3-91e6-293ac9ecdb58 req-88afd449-5caf-440b-a775-d74620afdcf5 service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-2d7d8032-e510-43d3-91e6-293ac9ecdb58 req-88afd449-5caf-440b-a775-d74620afdcf5 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] No waiting events found dispatching network-vif-unplugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:07 user nova-compute[75571]: WARNING nova.compute.manager [req-2d7d8032-e510-43d3-91e6-293ac9ecdb58 req-88afd449-5caf-440b-a775-d74620afdcf5 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received unexpected event network-vif-unplugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance with vm_state active and task_state rebuilding.
Nov 28 20:16:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:08 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Instance destroyed successfully.
Nov 28 20:16:08 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Snapshot image upload complete
Nov 28 20:16:08 user nova-compute[75571]: INFO nova.compute.manager [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Took 8.17 seconds to snapshot the instance on the hypervisor.
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:08 user nova-compute[75571]: INFO nova.compute.manager [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Detaching volume be8885e7-c3ff-4344-ba63-87e0e83cf851
Nov 28 20:16:08 user nova-compute[75571]: INFO nova.virt.block_device [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Attempting to driver detach volume be8885e7-c3ff-4344-ba63-87e0e83cf851 from mountpoint /dev/vdb
Nov 28 20:16:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Attempting to detach device vdb from instance b4000485-c53c-46e7-b585-cec40c114ec9 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:16:08 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:16:08 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:16:08 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:16:08 user nova-compute[75571]:   <serial>be8885e7-c3ff-4344-ba63-87e0e83cf851</serial>
Nov 28 20:16:08 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:16:08 user nova-compute[75571]: </disk>
Nov 28 20:16:08 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:16:08 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Successfully detached device vdb from instance b4000485-c53c-46e7-b585-cec40c114ec9 from the persistent domain config.
Nov 28 20:16:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnSTsjQG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:16:08 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[21724845-3ef8-4c47-a77b-e22ed0461255]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:16:08 user nova-compute[75571]: No targets found.
Nov 28 20:16:08 user nova-compute[75571]: iSNS:
Nov 28 20:16:08 user nova-compute[75571]: No targets found.
Nov 28 20:16:08 user nova-compute[75571]: STATIC:
Nov 28 20:16:08 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851
Nov 28 20:16:08 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:08 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:08 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3
Nov 28 20:16:08 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:08 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:08 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4
Nov 28 20:16:08 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:08 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:08 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a
Nov 28 20:16:08 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:08 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:08 user nova-compute[75571]: FIRMWARE:
Nov 28 20:16:08 user nova-compute[75571]: No targets found.
Nov 28 20:16:08 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:16:08 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:16:08 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca73a89-ef1e-4a84-8565-5da161499e4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfbb1bb-85ed-4bf6-a29d-f662e064c4ac]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:16:08 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:08 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:08 user nova-compute[75571]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:16:08 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:16:08 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:08 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:08 user nova-compute[75571]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:16:08 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768789d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecec9f3-6cf1-4c97-8f0c-c3734a2c073c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a403038-7487-4494-8358-8b7b44820186]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5496fb9-5a1b-4810-9670-c0ed272f870c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e49007-384c-4e81-bd36-6cb6af28ec3b]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[105867a2-a850-4100-9666-5d1d8e224e6f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9fb8b5-1734-4e4d-b756-fcf078a22489]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260]
Nov 28 20:16:08 user nova-compute[75571]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260] successful.
Nov 28 20:16:08 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2481d06d-fd64-412a-8ac7-480b55b1f09e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] <== disconnect_volume: return (423ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-f0c5503a-2580-482f-9adc-286486740414 req-0b9053d7-372a-4760-933d-56f2b05cf631 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received event network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f0c5503a-2580-482f-9adc-286486740414 req-0b9053d7-372a-4760-933d-56f2b05cf631 service nova] Acquiring lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f0c5503a-2580-482f-9adc-286486740414 req-0b9053d7-372a-4760-933d-56f2b05cf631 service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f0c5503a-2580-482f-9adc-286486740414 req-0b9053d7-372a-4760-933d-56f2b05cf631 service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-f0c5503a-2580-482f-9adc-286486740414 req-0b9053d7-372a-4760-933d-56f2b05cf631 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] No waiting events found dispatching network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:09 user nova-compute[75571]: WARNING nova.compute.manager [req-f0c5503a-2580-482f-9adc-286486740414 req-0b9053d7-372a-4760-933d-56f2b05cf631 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received unexpected event network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance with vm_state active and task_state rebuilding.
Nov 28 20:16:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:09 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Instance destroyed successfully.
Nov 28 20:16:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:13:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-966969358',display_name='tempest-ServerActionsTestOtherA-server-1075406910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-966969358',id=12,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcv8uQz+nR5/2Kyh5iIwf3OHys6PaLMAb2ymkOGNgmsCNHOoLJgjnILAd0z5T3cqhz2i9h9soKwPeCr9xdFkv0bMWCGWMfoC+gS3+jMXGPbetTiYDkWA2a0ddXyoobpZQ==',key_name='tempest-keypair-1082993848',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:14:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a85595c9e1704e71903d25a65f5b696c',ramdisk_id='',reservation_id='r-w442wsrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-390918760',owner_user_name='tempest-ServerActionsTestOtherA-390918760-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:16:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098319d33fa243f5a044cf3f3c9f983c',uuid=b4000485-c53c-46e7-b585-cec40c114ec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converting VIF {"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:4b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0bae30f2-569a-4d1d-8e35-77ad39e87209,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bae30f2-56') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:09 user nova-compute[75571]: DEBUG os_vif [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:4b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0bae30f2-569a-4d1d-8e35-77ad39e87209,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bae30f2-56') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bae30f2-56, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb28f009-0f3b-4a18-89a8-7edf3ef59706) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:16:10 user nova-compute[75571]: INFO os_vif [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:4b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0bae30f2-569a-4d1d-8e35-77ad39e87209,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bae30f2-56')
Nov 28 20:16:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnSTsjQG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:16:10 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac9cc97-eaa8-4c7b-beb7-25138adc26c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:16:10 user nova-compute[75571]: No targets found.
Nov 28 20:16:10 user nova-compute[75571]: iSNS:
Nov 28 20:16:10 user nova-compute[75571]: No targets found.
Nov 28 20:16:10 user nova-compute[75571]: STATIC:
Nov 28 20:16:10 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3
Nov 28 20:16:10 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:10 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:10 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4
Nov 28 20:16:10 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:10 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:10 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a
Nov 28 20:16:10 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:10 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:10 user nova-compute[75571]: FIRMWARE:
Nov 28 20:16:10 user nova-compute[75571]: No targets found.
Nov 28 20:16:10 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:16:10 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:16:10 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff6b2e3-31e6-4923-a623-ab6ce90b497c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c559a6-0d2b-4376-af77-0906a582cade]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:16:10 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:10 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:10 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:16:10 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:10 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:10 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f776814e200>, {}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Disconnecting from: [] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.110s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] <== disconnect_volume: return (113ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:16:10 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Deleting instance files /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9_del
Nov 28 20:16:10 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Deletion of /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9_del complete
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:10 user nova-compute[75571]: INFO nova.virt.block_device [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Booting with volume be8885e7-c3ff-4344-ba63-87e0e83cf851 at /dev/vdb
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.utils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[81eee2e4-d387-4ca8-9e16-96410ddf3f16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[714da45a-c136-4c44-b8e1-4592472a9147]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c898d8fc-0e6f-4f02-b9a5-d426b0f095e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[957b350e-dcd6-4c2a-944d-8f9d44ebd1cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:16:10 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3abe1bd-7f69-4aab-ab8c-8154504d9f2d]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG os_brick.utils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Updating existing volume attachment record: a964f919-36aa-435f-9212-f1a91bca3fc6 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:16:11 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:16:11 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:16:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=7424MB free_disk=25.388317108154297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance fe726611-331a-495f-a6bd-ced2d1a305b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance a8112c4a-cb42-49df-81a7-97b42f5cc87d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance b4000485-c53c-46e7-b585-cec40c114ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4cdf5581-3412-46dc-a702-30f759bf2b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 17cffd89-efcd-4c35-8c12-75393c8776f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e05b0276-16f8-4876-b37b-711b63d65823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 40ac5386-d43f-443c-ac15-186b368728f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 785632ec-4b56-4fca-82a5-67e3d52de9cb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:16:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:16:12 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:16:12 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:16:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:16:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.640s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.597s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:12 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:16:12 user nova-compute[75571]: INFO nova.compute.claims [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Claim successful on node user
Nov 28 20:16:12 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:16:12 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:16:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:16:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:16:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:16:12 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:16:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:16:12 user nova-compute[75571]: DEBUG nova.policy [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29664fb367db470abbd15cfbf39dd38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742419219fb94804bef60efd10716a41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:16:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:16:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:16:13 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Creating image(s)
Nov 28 20:16:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "/opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "/opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "/opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "e6099f48fdc9fa43ccc8504641002373d7f7e2fa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "e6099f48fdc9fa43ccc8504641002373d7f7e2fa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa.part --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:14 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Successfully created port: 68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:16:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa.part --force-share --output=json" returned: 0 in 0.218s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:14 user nova-compute[75571]: DEBUG nova.virt.images [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 7a729520-30cc-462f-9b0b-638e92e6c4b9 was qcow2, converting to raw {{(pid=75571) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 20:16:14 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:16:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa.part /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa.converted {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa.part /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa.converted" returned: 0 in 0.619s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa.converted --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Successfully updated port: 68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa.converted --force-share --output=json" returned: 0 in 0.222s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "e6099f48fdc9fa43ccc8504641002373d7f7e2fa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.153s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "refresh_cache-785632ec-4b56-4fca-82a5-67e3d52de9cb" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquired lock "refresh_cache-785632ec-4b56-4fca-82a5-67e3d52de9cb" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-0298f7a0-b7ba-4c03-bc1f-d5318087fc74 req-8494c41c-7891-4c40-a4e7-86a2600ede52 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received event network-changed-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-0298f7a0-b7ba-4c03-bc1f-d5318087fc74 req-8494c41c-7891-4c40-a4e7-86a2600ede52 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Refreshing instance network info cache due to event network-changed-68b6901f-6f94-4e02-af4c-d45b8f67fbea. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0298f7a0-b7ba-4c03-bc1f-d5318087fc74 req-8494c41c-7891-4c40-a4e7-86a2600ede52 service nova] Acquiring lock "refresh_cache-785632ec-4b56-4fca-82a5-67e3d52de9cb" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa --force-share --output=json" returned: 0 in 0.229s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "e6099f48fdc9fa43ccc8504641002373d7f7e2fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "e6099f48fdc9fa43ccc8504641002373d7f7e2fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa --force-share --output=json" returned: 0 in 0.230s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa,backing_fmt=raw /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Updating instance_info_cache with network_info: [{"id": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "address": "fa:16:3e:42:74:e1", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b6901f-6f", "ovs_interfaceid": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa,backing_fmt=raw /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk 1073741824" returned: 0 in 0.070s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "e6099f48fdc9fa43ccc8504641002373d7f7e2fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Releasing lock "refresh_cache-785632ec-4b56-4fca-82a5-67e3d52de9cb" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Instance network_info: |[{"id": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "address": "fa:16:3e:42:74:e1", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b6901f-6f", "ovs_interfaceid": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0298f7a0-b7ba-4c03-bc1f-d5318087fc74 req-8494c41c-7891-4c40-a4e7-86a2600ede52 service nova] Acquired lock "refresh_cache-785632ec-4b56-4fca-82a5-67e3d52de9cb" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:16:15 user nova-compute[75571]: DEBUG nova.network.neutron [req-0298f7a0-b7ba-4c03-bc1f-d5318087fc74 req-8494c41c-7891-4c40-a4e7-86a2600ede52 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Refreshing network info cache for port 68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa --force-share --output=json" returned: 0 in 0.261s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Ensure instance console log exists: /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Start _get_guest_xml network_info=[{"id": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "address": "fa:16:3e:42:74:e1", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b6901f-6f", "ovs_interfaceid": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='24e5cceb4a9b8cef74a0b0d3ad024c58',container_format='bare',created_at=2023-11-28T20:16:00Z,direct_url=<?>,disk_format='qcow2',id=7a729520-30cc-462f-9b0b-638e92e6c4b9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1853734182',owner='742419219fb94804bef60efd10716a41',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T20:16:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '7a729520-30cc-462f-9b0b-638e92e6c4b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:16:16 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:16:16 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='24e5cceb4a9b8cef74a0b0d3ad024c58',container_format='bare',created_at=2023-11-28T20:16:00Z,direct_url=<?>,disk_format='qcow2',id=7a729520-30cc-462f-9b0b-638e92e6c4b9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1853734182',owner='742419219fb94804bef60efd10716a41',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T20:16:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-246226610',display_name='tempest-TestStampPattern-server-246226610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-246226610',id=18,image_ref='7a729520-30cc-462f-9b0b-638e92e6c4b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKHSIcqSS6r5Xbk8DWkPtgQAYtxPI66k2MpIys7luJ+eXKJCwl3YX7s+WE2XtlqbyhCHYbp1Jbg6h1ZtUXzTkBXgQiD1zygrVkmZ1u0tehRUXvexgqD4sXlJ9Q5zsLuRw==',key_name='tempest-TestStampPattern-550063434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='742419219fb94804bef60efd10716a41',ramdisk_id='',reservation_id='r-wp92nl87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a8112c4a-cb42-49df-81a7-97b42f5cc87d',image_min_disk='1',image_min_ram='0',image_owner_id='742419219fb94804bef60efd10716a41',image_owner_project_name='tempest-TestStampPattern-152273837',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-152273837-project-member',image_user_id='29664fb367db470abbd15cfbf39dd38a',network_allocated='True',owner_project_name='tempest-TestStampPattern-152273837',owner_user_name='tempest-TestStampPattern-152273837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:16:13Z,user_data=None,user_id='29664fb367db470abbd15cfbf39dd38a',uuid=785632ec-4b56-4fca-82a5-67e3d52de9cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "address": "fa:16:3e:42:74:e1", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b6901f-6f", "ovs_interfaceid": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Converting VIF {"id": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "address": "fa:16:3e:42:74:e1", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b6901f-6f", "ovs_interfaceid": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:74:e1,bridge_name='br-int',has_traffic_filtering=True,id=68b6901f-6f94-4e02-af4c-d45b8f67fbea,network=Network(3f7305f6-e668-4fc6-82bd-f6f519c2bd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b6901f-6f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.objects.instance [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lazy-loading 'pci_devices' on Instance uuid 785632ec-4b56-4fca-82a5-67e3d52de9cb {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:16:16 user nova-compute[75571]:   <uuid>785632ec-4b56-4fca-82a5-67e3d52de9cb</uuid>
Nov 28 20:16:16 user nova-compute[75571]:   <name>instance-00000012</name>
Nov 28 20:16:16 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:16:16 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:16:16 user nova-compute[75571]:   <metadata>
Nov 28 20:16:16 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:16:16 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:16:16 user nova-compute[75571]:       <nova:name>tempest-TestStampPattern-server-246226610</nova:name>
Nov 28 20:16:16 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:16:16</nova:creationTime>
Nov 28 20:16:16 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:16:16 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:16:16 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:16:16 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:16:16 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:16:16 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:16:16 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:16:16 user nova-compute[75571]:       <nova:owner>
Nov 28 20:16:16 user nova-compute[75571]:         <nova:user uuid="29664fb367db470abbd15cfbf39dd38a">tempest-TestStampPattern-152273837-project-member</nova:user>
Nov 28 20:16:16 user nova-compute[75571]:         <nova:project uuid="742419219fb94804bef60efd10716a41">tempest-TestStampPattern-152273837</nova:project>
Nov 28 20:16:16 user nova-compute[75571]:       </nova:owner>
Nov 28 20:16:16 user nova-compute[75571]:       <nova:root type="image" uuid="7a729520-30cc-462f-9b0b-638e92e6c4b9"/>
Nov 28 20:16:16 user nova-compute[75571]:       <nova:ports>
Nov 28 20:16:16 user nova-compute[75571]:         <nova:port uuid="68b6901f-6f94-4e02-af4c-d45b8f67fbea">
Nov 28 20:16:16 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 20:16:16 user nova-compute[75571]:         </nova:port>
Nov 28 20:16:16 user nova-compute[75571]:       </nova:ports>
Nov 28 20:16:16 user nova-compute[75571]:     </nova:instance>
Nov 28 20:16:16 user nova-compute[75571]:   </metadata>
Nov 28 20:16:16 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:16:16 user nova-compute[75571]:     <system>
Nov 28 20:16:16 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:16:16 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:16:16 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:16:16 user nova-compute[75571]:       <entry name="serial">785632ec-4b56-4fca-82a5-67e3d52de9cb</entry>
Nov 28 20:16:16 user nova-compute[75571]:       <entry name="uuid">785632ec-4b56-4fca-82a5-67e3d52de9cb</entry>
Nov 28 20:16:16 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:16:16 user nova-compute[75571]:     </system>
Nov 28 20:16:16 user nova-compute[75571]:   </sysinfo>
Nov 28 20:16:16 user nova-compute[75571]:   <os>
Nov 28 20:16:16 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:16:16 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:16:16 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:16:16 user nova-compute[75571]:   </os>
Nov 28 20:16:16 user nova-compute[75571]:   <features>
Nov 28 20:16:16 user nova-compute[75571]:     <acpi/>
Nov 28 20:16:16 user nova-compute[75571]:     <apic/>
Nov 28 20:16:16 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:16:16 user nova-compute[75571]:   </features>
Nov 28 20:16:16 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:16:16 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:16:16 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:16:16 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:16:16 user nova-compute[75571]:   </clock>
Nov 28 20:16:16 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:16:16 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:16:16 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:16:16 user nova-compute[75571]:   </cpu>
Nov 28 20:16:16 user nova-compute[75571]:   <devices>
Nov 28 20:16:16 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:16:16 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:16:16 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk"/>
Nov 28 20:16:16 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:16:16 user nova-compute[75571]:     </disk>
Nov 28 20:16:16 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:16:16 user nova-compute[75571]:       <mac address="fa:16:3e:42:74:e1"/>
Nov 28 20:16:16 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:16:16 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:16:16 user nova-compute[75571]:       <target dev="tap68b6901f-6f"/>
Nov 28 20:16:16 user nova-compute[75571]:     </interface>
Nov 28 20:16:16 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:16:16 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/console.log" append="off"/>
Nov 28 20:16:16 user nova-compute[75571]:     </serial>
Nov 28 20:16:16 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:16:16 user nova-compute[75571]:     <video>
Nov 28 20:16:16 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:16:16 user nova-compute[75571]:     </video>
Nov 28 20:16:16 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:16:16 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:16:16 user nova-compute[75571]:     </rng>
Nov 28 20:16:16 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:16:16 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:16:16 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:16:16 user nova-compute[75571]:     </memballoon>
Nov 28 20:16:16 user nova-compute[75571]:   </devices>
Nov 28 20:16:16 user nova-compute[75571]: </domain>
Nov 28 20:16:16 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-246226610',display_name='tempest-TestStampPattern-server-246226610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-246226610',id=18,image_ref='7a729520-30cc-462f-9b0b-638e92e6c4b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKHSIcqSS6r5Xbk8DWkPtgQAYtxPI66k2MpIys7luJ+eXKJCwl3YX7s+WE2XtlqbyhCHYbp1Jbg6h1ZtUXzTkBXgQiD1zygrVkmZ1u0tehRUXvexgqD4sXlJ9Q5zsLuRw==',key_name='tempest-TestStampPattern-550063434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='742419219fb94804bef60efd10716a41',ramdisk_id='',reservation_id='r-wp92nl87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a8112c4a-cb42-49df-81a7-97b42f5cc87d',image_min_disk='1',image_min_ram='0',image_owner_id='742419219fb94804bef60efd10716a41',image_owner_project_name='tempest-TestStampPattern-152273837',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-152273837-project-member',image_user_id='29664fb367db470abbd15cfbf39dd38a',network_allocated='True',owner_project_name='tempest-TestStampPattern-152273837',owner_user_name='tempest-TestStampPattern-152273837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:16:13Z,user_data=None,user_id='29664fb367db470abbd15cfbf39dd38a',uuid=785632ec-4b56-4fca-82a5-67e3d52de9cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "address": "fa:16:3e:42:74:e1", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b6901f-6f", "ovs_interfaceid": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Converting VIF {"id": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "address": "fa:16:3e:42:74:e1", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b6901f-6f", "ovs_interfaceid": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:74:e1,bridge_name='br-int',has_traffic_filtering=True,id=68b6901f-6f94-4e02-af4c-d45b8f67fbea,network=Network(3f7305f6-e668-4fc6-82bd-f6f519c2bd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b6901f-6f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG os_vif [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:74:e1,bridge_name='br-int',has_traffic_filtering=True,id=68b6901f-6f94-4e02-af4c-d45b8f67fbea,network=Network(3f7305f6-e668-4fc6-82bd-f6f519c2bd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b6901f-6f') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e0c3072-8c39-5704-a2ac-21a6554bfeb1', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68b6901f-6f, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68b6901f-6f, col_values=(('qos', UUID('96d991ec-b9d9-4af6-acb4-bedcd8e08b15')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68b6901f-6f, col_values=(('external_ids', {'iface-id': '68b6901f-6f94-4e02-af4c-d45b8f67fbea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:74:e1', 'vm-uuid': '785632ec-4b56-4fca-82a5-67e3d52de9cb'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:16 user nova-compute[75571]: INFO os_vif [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:74:e1,bridge_name='br-int',has_traffic_filtering=True,id=68b6901f-6f94-4e02-af4c-d45b8f67fbea,network=Network(3f7305f6-e668-4fc6-82bd-f6f519c2bd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b6901f-6f')
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] No VIF found with MAC fa:16:3e:42:74:e1, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.network.neutron [req-0298f7a0-b7ba-4c03-bc1f-d5318087fc74 req-8494c41c-7891-4c40-a4e7-86a2600ede52 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Updated VIF entry in instance network info cache for port 68b6901f-6f94-4e02-af4c-d45b8f67fbea. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG nova.network.neutron [req-0298f7a0-b7ba-4c03-bc1f-d5318087fc74 req-8494c41c-7891-4c40-a4e7-86a2600ede52 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Updating instance_info_cache with network_info: [{"id": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "address": "fa:16:3e:42:74:e1", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b6901f-6f", "ovs_interfaceid": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:16:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0298f7a0-b7ba-4c03-bc1f-d5318087fc74 req-8494c41c-7891-4c40-a4e7-86a2600ede52 service nova] Releasing lock "refresh_cache-785632ec-4b56-4fca-82a5-67e3d52de9cb" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:16:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "4cdf5581-3412-46dc-a702-30f759bf2b05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "4cdf5581-3412-46dc-a702-30f759bf2b05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "4cdf5581-3412-46dc-a702-30f759bf2b05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "4cdf5581-3412-46dc-a702-30f759bf2b05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "4cdf5581-3412-46dc-a702-30f759bf2b05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:17 user nova-compute[75571]: INFO nova.compute.manager [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Terminating instance
Nov 28 20:16:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:16:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-a652e1c5-0b3e-406c-8015-91b17a82354f req-ba8c23b5-7f89-4af9-8f5c-4151809a1c13 service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Received event network-vif-unplugged-dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a652e1c5-0b3e-406c-8015-91b17a82354f req-ba8c23b5-7f89-4af9-8f5c-4151809a1c13 service nova] Acquiring lock "4cdf5581-3412-46dc-a702-30f759bf2b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a652e1c5-0b3e-406c-8015-91b17a82354f req-ba8c23b5-7f89-4af9-8f5c-4151809a1c13 service nova] Lock "4cdf5581-3412-46dc-a702-30f759bf2b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a652e1c5-0b3e-406c-8015-91b17a82354f req-ba8c23b5-7f89-4af9-8f5c-4151809a1c13 service nova] Lock "4cdf5581-3412-46dc-a702-30f759bf2b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-a652e1c5-0b3e-406c-8015-91b17a82354f req-ba8c23b5-7f89-4af9-8f5c-4151809a1c13 service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] No waiting events found dispatching network-vif-unplugged-dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-a652e1c5-0b3e-406c-8015-91b17a82354f req-ba8c23b5-7f89-4af9-8f5c-4151809a1c13 service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Received event network-vif-unplugged-dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:16:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Instance destroyed successfully.
Nov 28 20:16:18 user nova-compute[75571]: DEBUG nova.objects.instance [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lazy-loading 'resources' on Instance uuid 4cdf5581-3412-46dc-a702-30f759bf2b05 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:14:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1259091663',display_name='tempest-VolumesAdminNegativeTest-server-1259091663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1259091663',id=13,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63ff2e349b40430a91730a22fd4a0487',ramdisk_id='',reservation_id='r-ocw6kjrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1106730846',owner_user_name='tempest-VolumesAdminNegativeTest-1106730846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:14:27Z,user_data=None,user_id='0d747c1fd611452f8d0e6ee1b423cd2c',uuid=4cdf5581-3412-46dc-a702-30f759bf2b05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "address": "fa:16:3e:b3:15:52", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabcf8a5-91", "ovs_interfaceid": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Converting VIF {"id": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "address": "fa:16:3e:b3:15:52", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabcf8a5-91", "ovs_interfaceid": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:15:52,bridge_name='br-int',has_traffic_filtering=True,id=dabcf8a5-911a-4edb-a993-c3cbfd06d4a9,network=Network(3b3bc160-310f-422a-ab1d-d8090334b344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdabcf8a5-91') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG os_vif [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:15:52,bridge_name='br-int',has_traffic_filtering=True,id=dabcf8a5-911a-4edb-a993-c3cbfd06d4a9,network=Network(3b3bc160-310f-422a-ab1d-d8090334b344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdabcf8a5-91') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdabcf8a5-91, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7eded09-d6f6-4726-a92f-d1eb8022b57b) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:18 user nova-compute[75571]: INFO os_vif [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:15:52,bridge_name='br-int',has_traffic_filtering=True,id=dabcf8a5-911a-4edb-a993-c3cbfd06d4a9,network=Network(3b3bc160-310f-422a-ab1d-d8090334b344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdabcf8a5-91')
Nov 28 20:16:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Deleting instance files /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05_del
Nov 28 20:16:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Deletion of /opt/stack/data/nova/instances/4cdf5581-3412-46dc-a702-30f759bf2b05_del complete
Nov 28 20:16:18 user nova-compute[75571]: INFO nova.compute.manager [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 28 20:16:18 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:16:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:19 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:16:19 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Took 0.82 seconds to deallocate network for instance.
Nov 28 20:16:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-eb48b261-f0e3-4daa-84ad-93b66064df04 req-982e9802-cd61-45e3-8bb7-94233abeeebb service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Received event network-vif-deleted-dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Received event network-vif-plugged-dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Acquiring lock "4cdf5581-3412-46dc-a702-30f759bf2b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Lock "4cdf5581-3412-46dc-a702-30f759bf2b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Lock "4cdf5581-3412-46dc-a702-30f759bf2b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] No waiting events found dispatching network-vif-plugged-dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:20 user nova-compute[75571]: WARNING nova.compute.manager [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Received unexpected event network-vif-plugged-dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 for instance with vm_state deleted and task_state None.
Nov 28 20:16:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received event network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Acquiring lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] No waiting events found dispatching network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:20 user nova-compute[75571]: WARNING nova.compute.manager [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received unexpected event network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance with vm_state building and task_state spawning.
Nov 28 20:16:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received event network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Acquiring lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] No waiting events found dispatching network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:20 user nova-compute[75571]: WARNING nova.compute.manager [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received unexpected event network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance with vm_state building and task_state spawning.
Nov 28 20:16:20 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:20 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Deleted allocations for instance 4cdf5581-3412-46dc-a702-30f759bf2b05
Nov 28 20:16:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:16:20 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Creating image(s)
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "/opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "/opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.534s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "4cdf5581-3412-46dc-a702-30f759bf2b05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.579s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.195s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk 1073741824" returned: 0 in 0.368s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.567s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:16:21 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Instance spawned successfully.
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:21 user nova-compute[75571]: INFO nova.compute.manager [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Took 8.52 seconds to spawn the instance on the hypervisor.
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.236s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:21 user nova-compute[75571]: INFO nova.compute.manager [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Took 10.19 seconds to build instance.
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.797s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Cannot resize image /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Ensure instance console log exists: /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Start _get_guest_xml network_info=[{"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnSTsjQG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b4000485-c53c-46e7-b585-cec40c114ec9', 'attached_at': '', 'detached_at': '', 'volume_id': 'be8885e7-c3ff-4344-ba63-87e0e83cf851', 'serial': 'be8885e7-c3ff-4344-ba63-87e0e83cf851'}, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'a964f919-36aa-435f-9212-f1a91bca3fc6', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:16:21 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 20:16:21 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.objects.instance [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lazy-loading 'vcpu_model' on Instance uuid b4000485-c53c-46e7-b585-cec40c114ec9 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnSTsjQG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:16:21 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 20:16:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:16:21 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 20:16:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:16:21 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4969c8-568f-4b30-8790-40c9b68ece89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:16:21 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[16062dfc-fbb8-4c6d-8625-69945600c0ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851] added
Nov 28 20:16:21 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7206f9ee-0fc5-434a-97a8-199642a3a990]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7e18ce-7c50-49e0-a648-ffca56697f00]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YnSTsjQG {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YnSTsjQG" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2013b937-bb7c-418c-8181-0bf3c4460a93]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YnSTsjQG'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6922d5-210f-4a25-b1e7-772fb1f6ccf8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[31824b96-7d7c-43b2-a623-2deb6946a8ce]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:16:22 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:22 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:16:22 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:22 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3e9ca3-4280-495c-8d31-7439d898314d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260]
Nov 28 20:16:22 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260] successful.
Nov 28 20:16:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6751719b-fb63-4e99-941d-c45dc99848dd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c05b90f-f30a-4789-96f4-26dc82ea46c9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:16:22 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:22 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:22 user nova-compute[75571]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:16:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:16:22 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:22 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:22 user nova-compute[75571]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:16:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b2e7f5-80f5-4b1c-bfa4-e2b8e89229e7]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:16:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnSTsjQG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23234353131623232', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234353131623232', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T20:13:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-966969358',display_name='tempest-ServerActionsTestOtherA-server-1075406910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-966969358',id=12,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcv8uQz+nR5/2Kyh5iIwf3OHys6PaLMAb2ymkOGNgmsCNHOoLJgjnILAd0z5T3cqhz2i9h9soKwPeCr9xdFkv0bMWCGWMfoC+gS3+jMXGPbetTiYDkWA2a0ddXyoobpZQ==',key_name='tempest-keypair-1082993848',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:14:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a85595c9e1704e71903d25a65f5b696c',ramdisk_id='',reservation_id='r-w442wsrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-390918760',owner_user_name='tempest-ServerActionsTestOtherA-390918760-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098319d33fa243f5a044cf3f3c9f983c',uuid=b4000485-c53c-46e7-b585-cec40c114ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converting VIF {"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:4b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0bae30f2-569a-4d1d-8e35-77ad39e87209,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bae30f2-56') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:16:23 user nova-compute[75571]:   <uuid>b4000485-c53c-46e7-b585-cec40c114ec9</uuid>
Nov 28 20:16:23 user nova-compute[75571]:   <name>instance-0000000c</name>
Nov 28 20:16:23 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:16:23 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:16:23 user nova-compute[75571]:   <metadata>
Nov 28 20:16:23 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:16:23 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:16:23 user nova-compute[75571]:       <nova:name>tempest-ServerActionsTestOtherA-server-1075406910</nova:name>
Nov 28 20:16:23 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:16:21</nova:creationTime>
Nov 28 20:16:23 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:16:23 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:16:23 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:16:23 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:16:23 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:16:23 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:16:23 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:16:23 user nova-compute[75571]:       <nova:owner>
Nov 28 20:16:23 user nova-compute[75571]:         <nova:user uuid="098319d33fa243f5a044cf3f3c9f983c">tempest-ServerActionsTestOtherA-390918760-project-member</nova:user>
Nov 28 20:16:23 user nova-compute[75571]:         <nova:project uuid="a85595c9e1704e71903d25a65f5b696c">tempest-ServerActionsTestOtherA-390918760</nova:project>
Nov 28 20:16:23 user nova-compute[75571]:       </nova:owner>
Nov 28 20:16:23 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:16:23 user nova-compute[75571]:       <nova:ports>
Nov 28 20:16:23 user nova-compute[75571]:         <nova:port uuid="0bae30f2-569a-4d1d-8e35-77ad39e87209">
Nov 28 20:16:23 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 20:16:23 user nova-compute[75571]:         </nova:port>
Nov 28 20:16:23 user nova-compute[75571]:       </nova:ports>
Nov 28 20:16:23 user nova-compute[75571]:     </nova:instance>
Nov 28 20:16:23 user nova-compute[75571]:   </metadata>
Nov 28 20:16:23 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:16:23 user nova-compute[75571]:     <system>
Nov 28 20:16:23 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:16:23 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:16:23 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:16:23 user nova-compute[75571]:       <entry name="serial">b4000485-c53c-46e7-b585-cec40c114ec9</entry>
Nov 28 20:16:23 user nova-compute[75571]:       <entry name="uuid">b4000485-c53c-46e7-b585-cec40c114ec9</entry>
Nov 28 20:16:23 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:16:23 user nova-compute[75571]:     </system>
Nov 28 20:16:23 user nova-compute[75571]:   </sysinfo>
Nov 28 20:16:23 user nova-compute[75571]:   <os>
Nov 28 20:16:23 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:16:23 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:16:23 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:16:23 user nova-compute[75571]:   </os>
Nov 28 20:16:23 user nova-compute[75571]:   <features>
Nov 28 20:16:23 user nova-compute[75571]:     <acpi/>
Nov 28 20:16:23 user nova-compute[75571]:     <apic/>
Nov 28 20:16:23 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:16:23 user nova-compute[75571]:   </features>
Nov 28 20:16:23 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:16:23 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:16:23 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:16:23 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:16:23 user nova-compute[75571]:   </clock>
Nov 28 20:16:23 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:16:23 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:16:23 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:16:23 user nova-compute[75571]:   </cpu>
Nov 28 20:16:23 user nova-compute[75571]:   <devices>
Nov 28 20:16:23 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:16:23 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:16:23 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk"/>
Nov 28 20:16:23 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:16:23 user nova-compute[75571]:     </disk>
Nov 28 20:16:23 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:16:23 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:16:23 user nova-compute[75571]:       <source dev="/dev/sdb"/>
Nov 28 20:16:23 user nova-compute[75571]:       <target dev="vdb" bus="virtio"/>
Nov 28 20:16:23 user nova-compute[75571]:       <serial>be8885e7-c3ff-4344-ba63-87e0e83cf851</serial>
Nov 28 20:16:23 user nova-compute[75571]:     </disk>
Nov 28 20:16:23 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:16:23 user nova-compute[75571]:       <mac address="fa:16:3e:35:4b:c8"/>
Nov 28 20:16:23 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:16:23 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:16:23 user nova-compute[75571]:       <target dev="tap0bae30f2-56"/>
Nov 28 20:16:23 user nova-compute[75571]:     </interface>
Nov 28 20:16:23 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:16:23 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/console.log" append="off"/>
Nov 28 20:16:23 user nova-compute[75571]:     </serial>
Nov 28 20:16:23 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:16:23 user nova-compute[75571]:     <video>
Nov 28 20:16:23 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:16:23 user nova-compute[75571]:     </video>
Nov 28 20:16:23 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:16:23 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:16:23 user nova-compute[75571]:     </rng>
Nov 28 20:16:23 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:16:23 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:16:23 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:16:23 user nova-compute[75571]:     </memballoon>
Nov 28 20:16:23 user nova-compute[75571]:   </devices>
Nov 28 20:16:23 user nova-compute[75571]: </domain>
Nov 28 20:16:23 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T20:13:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-966969358',display_name='tempest-ServerActionsTestOtherA-server-1075406910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-966969358',id=12,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcv8uQz+nR5/2Kyh5iIwf3OHys6PaLMAb2ymkOGNgmsCNHOoLJgjnILAd0z5T3cqhz2i9h9soKwPeCr9xdFkv0bMWCGWMfoC+gS3+jMXGPbetTiYDkWA2a0ddXyoobpZQ==',key_name='tempest-keypair-1082993848',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:14:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a85595c9e1704e71903d25a65f5b696c',ramdisk_id='',reservation_id='r-w442wsrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-390918760',owner_user_name='tempest-ServerActionsTestOtherA-390918760-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098319d33fa243f5a044cf3f3c9f983c',uuid=b4000485-c53c-46e7-b585-cec40c114ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converting VIF {"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:4b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0bae30f2-569a-4d1d-8e35-77ad39e87209,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bae30f2-56') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG os_vif [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:4b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0bae30f2-569a-4d1d-8e35-77ad39e87209,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bae30f2-56') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '149db1a8-f061-55ee-b0c0-0ff77e77fc98', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bae30f2-56, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bae30f2-56, col_values=(('qos', UUID('d566708e-8dd0-49f8-96b5-388718d101d2')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bae30f2-56, col_values=(('external_ids', {'iface-id': '0bae30f2-569a-4d1d-8e35-77ad39e87209', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:4b:c8', 'vm-uuid': 'b4000485-c53c-46e7-b585-cec40c114ec9'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:23 user nova-compute[75571]: INFO os_vif [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:4b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0bae30f2-569a-4d1d-8e35-77ad39e87209,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bae30f2-56')
Nov 28 20:16:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] No VIF found with MAC fa:16:3e:35:4b:c8, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-df3dd1d1-60c9-494b-8c6f-cc25851d84fa req-6cc368c2-ca6a-4812-babc-cdf442580a43 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received event network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-df3dd1d1-60c9-494b-8c6f-cc25851d84fa req-6cc368c2-ca6a-4812-babc-cdf442580a43 service nova] Acquiring lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-df3dd1d1-60c9-494b-8c6f-cc25851d84fa req-6cc368c2-ca6a-4812-babc-cdf442580a43 service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-df3dd1d1-60c9-494b-8c6f-cc25851d84fa req-6cc368c2-ca6a-4812-babc-cdf442580a43 service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-df3dd1d1-60c9-494b-8c6f-cc25851d84fa req-6cc368c2-ca6a-4812-babc-cdf442580a43 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] No waiting events found dispatching network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:27 user nova-compute[75571]: WARNING nova.compute.manager [req-df3dd1d1-60c9-494b-8c6f-cc25851d84fa req-6cc368c2-ca6a-4812-babc-cdf442580a43 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received unexpected event network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 20:16:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG nova.compute.manager [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:16:27 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Instance spawned successfully.
Nov 28 20:16:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG nova.compute.manager [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:27 user nova-compute[75571]: DEBUG nova.objects.instance [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75571) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 20:16:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.088s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-0da37f67-ca79-4226-b537-cb7d644b9f39 req-dba4eb86-fa65-4a3f-a248-6e59ae74ed76 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received event network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0da37f67-ca79-4226-b537-cb7d644b9f39 req-dba4eb86-fa65-4a3f-a248-6e59ae74ed76 service nova] Acquiring lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0da37f67-ca79-4226-b537-cb7d644b9f39 req-dba4eb86-fa65-4a3f-a248-6e59ae74ed76 service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0da37f67-ca79-4226-b537-cb7d644b9f39 req-dba4eb86-fa65-4a3f-a248-6e59ae74ed76 service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-0da37f67-ca79-4226-b537-cb7d644b9f39 req-dba4eb86-fa65-4a3f-a248-6e59ae74ed76 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] No waiting events found dispatching network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:29 user nova-compute[75571]: WARNING nova.compute.manager [req-0da37f67-ca79-4226-b537-cb7d644b9f39 req-dba4eb86-fa65-4a3f-a248-6e59ae74ed76 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received unexpected event network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance with vm_state active and task_state None.
Nov 28 20:16:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-8fec5d25-1a9e-4d86-a33d-96d916daff28 req-4b3a7794-01c6-46b0-ba12-ba781a4f7232 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-changed-00fac4f4-969a-449b-a264-4d1ce345c3b6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-8fec5d25-1a9e-4d86-a33d-96d916daff28 req-4b3a7794-01c6-46b0-ba12-ba781a4f7232 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing instance network info cache due to event network-changed-00fac4f4-969a-449b-a264-4d1ce345c3b6. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:16:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8fec5d25-1a9e-4d86-a33d-96d916daff28 req-4b3a7794-01c6-46b0-ba12-ba781a4f7232 service nova] Acquiring lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:16:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8fec5d25-1a9e-4d86-a33d-96d916daff28 req-4b3a7794-01c6-46b0-ba12-ba781a4f7232 service nova] Acquired lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:16:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-8fec5d25-1a9e-4d86-a33d-96d916daff28 req-4b3a7794-01c6-46b0-ba12-ba781a4f7232 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Refreshing network info cache for port 00fac4f4-969a-449b-a264-4d1ce345c3b6 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:16:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:35 user nova-compute[75571]: DEBUG nova.network.neutron [req-8fec5d25-1a9e-4d86-a33d-96d916daff28 req-4b3a7794-01c6-46b0-ba12-ba781a4f7232 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updated VIF entry in instance network info cache for port 00fac4f4-969a-449b-a264-4d1ce345c3b6. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:16:35 user nova-compute[75571]: DEBUG nova.network.neutron [req-8fec5d25-1a9e-4d86-a33d-96d916daff28 req-4b3a7794-01c6-46b0-ba12-ba781a4f7232 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating instance_info_cache with network_info: [{"id": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "address": "fa:16:3e:de:65:0c", "network": {"id": "f4277af4-8e9c-4147-9ca9-2cf286d9de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-271277689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fac4f4-96", "ovs_interfaceid": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "90cdd786-4498-4e1d-8eff-7407674beb52", "address": "fa:16:3e:e3:38:55", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdd786-44", "ovs_interfaceid": "90cdd786-4498-4e1d-8eff-7407674beb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "address": "fa:16:3e:46:26:0d", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78aeb66d-21", "ovs_interfaceid": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "address": "fa:16:3e:59:92:9e", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec8aa66-f6", "ovs_interfaceid": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:16:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8fec5d25-1a9e-4d86-a33d-96d916daff28 req-4b3a7794-01c6-46b0-ba12-ba781a4f7232 service nova] Releasing lock "refresh_cache-17cffd89-efcd-4c35-8c12-75393c8776f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:16:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:36 user nova-compute[75571]: DEBUG nova.compute.manager [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:16:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:36 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:16:36 user nova-compute[75571]: INFO nova.compute.claims [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Claim successful on node user
Nov 28 20:16:36 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:16:36 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:16:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:36 user nova-compute[75571]: DEBUG nova.compute.manager [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG nova.network.neutron [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:16:37 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:16:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG nova.policy [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:16:37 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Creating image(s)
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "/opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "/opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "/opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.234s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.213s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG nova.network.neutron [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Successfully created port: fc196680-3f93-4710-b508-752c9aa39f18 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk 1073741824" returned: 0 in 0.111s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:37 user nova-compute[75571]: INFO nova.compute.manager [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Terminating instance
Nov 28 20:16:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.231s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.508s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Cannot resize image /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Ensure instance console log exists: /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG nova.compute.manager [req-64fc0160-03bf-47b6-a3e2-d6e59fa080b2 req-ab4c171d-6e3a-49d6-a972-4223617d8f54 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-unplugged-2eb26bff-1c84-413b-b3b4-fbc18940f912 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-64fc0160-03bf-47b6-a3e2-d6e59fa080b2 req-ab4c171d-6e3a-49d6-a972-4223617d8f54 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-64fc0160-03bf-47b6-a3e2-d6e59fa080b2 req-ab4c171d-6e3a-49d6-a972-4223617d8f54 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-64fc0160-03bf-47b6-a3e2-d6e59fa080b2 req-ab4c171d-6e3a-49d6-a972-4223617d8f54 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG nova.compute.manager [req-64fc0160-03bf-47b6-a3e2-d6e59fa080b2 req-ab4c171d-6e3a-49d6-a972-4223617d8f54 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-unplugged-2eb26bff-1c84-413b-b3b4-fbc18940f912 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:38 user nova-compute[75571]: DEBUG nova.compute.manager [req-64fc0160-03bf-47b6-a3e2-d6e59fa080b2 req-ab4c171d-6e3a-49d6-a972-4223617d8f54 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-unplugged-2eb26bff-1c84-413b-b3b4-fbc18940f912 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-28ded1a3-df2a-490c-b52f-b5e1a769f09f req-db526f78-c484-4ea9-b9bb-e6e3d0574bd4 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-unplugged-00fac4f4-969a-449b-a264-4d1ce345c3b6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-28ded1a3-df2a-490c-b52f-b5e1a769f09f req-db526f78-c484-4ea9-b9bb-e6e3d0574bd4 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-28ded1a3-df2a-490c-b52f-b5e1a769f09f req-db526f78-c484-4ea9-b9bb-e6e3d0574bd4 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-28ded1a3-df2a-490c-b52f-b5e1a769f09f req-db526f78-c484-4ea9-b9bb-e6e3d0574bd4 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-28ded1a3-df2a-490c-b52f-b5e1a769f09f req-db526f78-c484-4ea9-b9bb-e6e3d0574bd4 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-unplugged-00fac4f4-969a-449b-a264-4d1ce345c3b6 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-28ded1a3-df2a-490c-b52f-b5e1a769f09f req-db526f78-c484-4ea9-b9bb-e6e3d0574bd4 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-unplugged-00fac4f4-969a-449b-a264-4d1ce345c3b6 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG nova.network.neutron [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Successfully updated port: fc196680-3f93-4710-b508-752c9aa39f18 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "refresh_cache-4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquired lock "refresh_cache-4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG nova.network.neutron [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-0d38f010-818d-4be8-8489-f7940fa7f65b req-f6e5dd29-e997-46c2-9a6b-9c604e76888c service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Received event network-changed-fc196680-3f93-4710-b508-752c9aa39f18 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-0d38f010-818d-4be8-8489-f7940fa7f65b req-f6e5dd29-e997-46c2-9a6b-9c604e76888c service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Refreshing instance network info cache due to event network-changed-fc196680-3f93-4710-b508-752c9aa39f18. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0d38f010-818d-4be8-8489-f7940fa7f65b req-f6e5dd29-e997-46c2-9a6b-9c604e76888c service nova] Acquiring lock "refresh_cache-4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG nova.network.neutron [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.network.neutron [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Updating instance_info_cache with network_info: [{"id": "fc196680-3f93-4710-b508-752c9aa39f18", "address": "fa:16:3e:44:80:a9", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc196680-3f", "ovs_interfaceid": "fc196680-3f93-4710-b508-752c9aa39f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Releasing lock "refresh_cache-4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.compute.manager [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Instance network_info: |[{"id": "fc196680-3f93-4710-b508-752c9aa39f18", "address": "fa:16:3e:44:80:a9", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc196680-3f", "ovs_interfaceid": "fc196680-3f93-4710-b508-752c9aa39f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0d38f010-818d-4be8-8489-f7940fa7f65b req-f6e5dd29-e997-46c2-9a6b-9c604e76888c service nova] Acquired lock "refresh_cache-4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.network.neutron [req-0d38f010-818d-4be8-8489-f7940fa7f65b req-f6e5dd29-e997-46c2-9a6b-9c604e76888c service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Refreshing network info cache for port fc196680-3f93-4710-b508-752c9aa39f18 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Start _get_guest_xml network_info=[{"id": "fc196680-3f93-4710-b508-752c9aa39f18", "address": "fa:16:3e:44:80:a9", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc196680-3f", "ovs_interfaceid": "fc196680-3f93-4710-b508-752c9aa39f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:16:40 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Instance destroyed successfully.
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.objects.instance [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lazy-loading 'resources' on Instance uuid 17cffd89-efcd-4c35-8c12-75393c8776f8 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:16:40 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:16:40 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "address": "fa:16:3e:de:65:0c", "network": {"id": "f4277af4-8e9c-4147-9ca9-2cf286d9de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-271277689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fac4f4-96", "ovs_interfaceid": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "address": "fa:16:3e:de:65:0c", "network": {"id": "f4277af4-8e9c-4147-9ca9-2cf286d9de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-271277689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fac4f4-96", "ovs_interfaceid": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:65:0c,bridge_name='br-int',has_traffic_filtering=True,id=00fac4f4-969a-449b-a264-4d1ce345c3b6,network=Network(f4277af4-8e9c-4147-9ca9-2cf286d9de49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00fac4f4-96') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG os_vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:65:0c,bridge_name='br-int',has_traffic_filtering=True,id=00fac4f4-969a-449b-a264-4d1ce345c3b6,network=Network(f4277af4-8e9c-4147-9ca9-2cf286d9de49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00fac4f4-96') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00fac4f4-96, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-594759002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-594759002',id=19,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd03007966db45f48ae6c22ed6f84871',ramdisk_id='',reservation_id='r-e5xzkgbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-468878',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-468878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:16:37Z,user_data=None,user_id='007af37c9a914cd5863e486c041701be',uuid=4549e2e1-350f-47ce-80ef-8a2a8a6ef62e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc196680-3f93-4710-b508-752c9aa39f18", "address": "fa:16:3e:44:80:a9", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc196680-3f", "ovs_interfaceid": "fc196680-3f93-4710-b508-752c9aa39f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converting VIF {"id": "fc196680-3f93-4710-b508-752c9aa39f18", "address": "fa:16:3e:44:80:a9", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc196680-3f", "ovs_interfaceid": "fc196680-3f93-4710-b508-752c9aa39f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:80:a9,bridge_name='br-int',has_traffic_filtering=True,id=fc196680-3f93-4710-b508-752c9aa39f18,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc196680-3f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.objects.instance [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'pci_devices' on Instance uuid 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7793a018-a83f-46c6-b5a3-d40024f8233f) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:16:40 user nova-compute[75571]:   <uuid>4549e2e1-350f-47ce-80ef-8a2a8a6ef62e</uuid>
Nov 28 20:16:40 user nova-compute[75571]:   <name>instance-00000013</name>
Nov 28 20:16:40 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:16:40 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:16:40 user nova-compute[75571]:   <metadata>
Nov 28 20:16:40 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:16:40 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:16:40 user nova-compute[75571]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-594759002</nova:name>
Nov 28 20:16:40 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:16:40</nova:creationTime>
Nov 28 20:16:40 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:16:40 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:16:40 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:16:40 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:16:40 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:16:40 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:16:40 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:16:40 user nova-compute[75571]:       <nova:owner>
Nov 28 20:16:40 user nova-compute[75571]:         <nova:user uuid="007af37c9a914cd5863e486c041701be">tempest-ServerBootFromVolumeStableRescueTest-468878-project-member</nova:user>
Nov 28 20:16:40 user nova-compute[75571]:         <nova:project uuid="dd03007966db45f48ae6c22ed6f84871">tempest-ServerBootFromVolumeStableRescueTest-468878</nova:project>
Nov 28 20:16:40 user nova-compute[75571]:       </nova:owner>
Nov 28 20:16:40 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:16:40 user nova-compute[75571]:       <nova:ports>
Nov 28 20:16:40 user nova-compute[75571]:         <nova:port uuid="fc196680-3f93-4710-b508-752c9aa39f18">
Nov 28 20:16:40 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 20:16:40 user nova-compute[75571]:         </nova:port>
Nov 28 20:16:40 user nova-compute[75571]:       </nova:ports>
Nov 28 20:16:40 user nova-compute[75571]:     </nova:instance>
Nov 28 20:16:40 user nova-compute[75571]:   </metadata>
Nov 28 20:16:40 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:16:40 user nova-compute[75571]:     <system>
Nov 28 20:16:40 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:16:40 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:16:40 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:16:40 user nova-compute[75571]:       <entry name="serial">4549e2e1-350f-47ce-80ef-8a2a8a6ef62e</entry>
Nov 28 20:16:40 user nova-compute[75571]:       <entry name="uuid">4549e2e1-350f-47ce-80ef-8a2a8a6ef62e</entry>
Nov 28 20:16:40 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:16:40 user nova-compute[75571]:     </system>
Nov 28 20:16:40 user nova-compute[75571]:   </sysinfo>
Nov 28 20:16:40 user nova-compute[75571]:   <os>
Nov 28 20:16:40 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:16:40 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:16:40 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:16:40 user nova-compute[75571]:   </os>
Nov 28 20:16:40 user nova-compute[75571]:   <features>
Nov 28 20:16:40 user nova-compute[75571]:     <acpi/>
Nov 28 20:16:40 user nova-compute[75571]:     <apic/>
Nov 28 20:16:40 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:16:40 user nova-compute[75571]:   </features>
Nov 28 20:16:40 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:16:40 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:16:40 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:16:40 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:16:40 user nova-compute[75571]:   </clock>
Nov 28 20:16:40 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:16:40 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:16:40 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:16:40 user nova-compute[75571]:   </cpu>
Nov 28 20:16:40 user nova-compute[75571]:   <devices>
Nov 28 20:16:40 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:16:40 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:16:40 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk"/>
Nov 28 20:16:40 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:16:40 user nova-compute[75571]:     </disk>
Nov 28 20:16:40 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:16:40 user nova-compute[75571]:       <mac address="fa:16:3e:44:80:a9"/>
Nov 28 20:16:40 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:16:40 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:16:40 user nova-compute[75571]:       <target dev="tapfc196680-3f"/>
Nov 28 20:16:40 user nova-compute[75571]:     </interface>
Nov 28 20:16:40 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:16:40 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/console.log" append="off"/>
Nov 28 20:16:40 user nova-compute[75571]:     </serial>
Nov 28 20:16:40 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:16:40 user nova-compute[75571]:     <video>
Nov 28 20:16:40 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:16:40 user nova-compute[75571]:     </video>
Nov 28 20:16:40 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:16:40 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:16:40 user nova-compute[75571]:     </rng>
Nov 28 20:16:40 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:16:40 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:16:40 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:16:40 user nova-compute[75571]:     </memballoon>
Nov 28 20:16:40 user nova-compute[75571]:   </devices>
Nov 28 20:16:40 user nova-compute[75571]: </domain>
Nov 28 20:16:40 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-594759002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-594759002',id=19,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd03007966db45f48ae6c22ed6f84871',ramdisk_id='',reservation_id='r-e5xzkgbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-468878',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-468878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:16:37Z,user_data=None,user_id='007af37c9a914cd5863e486c041701be',uuid=4549e2e1-350f-47ce-80ef-8a2a8a6ef62e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc196680-3f93-4710-b508-752c9aa39f18", "address": "fa:16:3e:44:80:a9", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc196680-3f", "ovs_interfaceid": "fc196680-3f93-4710-b508-752c9aa39f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converting VIF {"id": "fc196680-3f93-4710-b508-752c9aa39f18", "address": "fa:16:3e:44:80:a9", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc196680-3f", "ovs_interfaceid": "fc196680-3f93-4710-b508-752c9aa39f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:80:a9,bridge_name='br-int',has_traffic_filtering=True,id=fc196680-3f93-4710-b508-752c9aa39f18,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc196680-3f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG os_vif [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:80:a9,bridge_name='br-int',has_traffic_filtering=True,id=fc196680-3f93-4710-b508-752c9aa39f18,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc196680-3f') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa168476-68a9-561d-a5bc-3702f4920f56', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:40 user nova-compute[75571]: INFO os_vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:65:0c,bridge_name='br-int',has_traffic_filtering=True,id=00fac4f4-969a-449b-a264-4d1ce345c3b6,network=Network(f4277af4-8e9c-4147-9ca9-2cf286d9de49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00fac4f4-96')
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:66,bridge_name='br-int',has_traffic_filtering=True,id=13d2eb0a-77c7-4db6-96c1-547dc7781057,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13d2eb0a-77') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG os_vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:66,bridge_name='br-int',has_traffic_filtering=True,id=13d2eb0a-77c7-4db6-96c1-547dc7781057,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13d2eb0a-77') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13d2eb0a-77, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc196680-3f, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc196680-3f, col_values=(('qos', UUID('203d781f-5e54-49c2-bbc6-cb7f6cb64ed3')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc196680-3f, col_values=(('external_ids', {'iface-id': 'fc196680-3f93-4710-b508-752c9aa39f18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:80:a9', 'vm-uuid': '4549e2e1-350f-47ce-80ef-8a2a8a6ef62e'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: INFO os_vif [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:80:a9,bridge_name='br-int',has_traffic_filtering=True,id=fc196680-3f93-4710-b508-752c9aa39f18,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc196680-3f')
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82e64086-db16-4c11-8df3-c44355c34177) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: INFO os_vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b6:66,bridge_name='br-int',has_traffic_filtering=True,id=13d2eb0a-77c7-4db6-96c1-547dc7781057,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13d2eb0a-77')
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:73:04,bridge_name='br-int',has_traffic_filtering=True,id=2eb26bff-1c84-413b-b3b4-fbc18940f912,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eb26bff-1c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG os_vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:73:04,bridge_name='br-int',has_traffic_filtering=True,id=2eb26bff-1c84-413b-b3b4-fbc18940f912,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eb26bff-1c') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eb26bff-1c, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] No VIF found with MAC fa:16:3e:44:80:a9, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd4f28ff-dda4-4035-885e-6d48cd0c7a23) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: INFO os_vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:73:04,bridge_name='br-int',has_traffic_filtering=True,id=2eb26bff-1c84-413b-b3b4-fbc18940f912,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eb26bff-1c')
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90cdd786-4498-4e1d-8eff-7407674beb52", "address": "fa:16:3e:e3:38:55", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdd786-44", "ovs_interfaceid": "90cdd786-4498-4e1d-8eff-7407674beb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "90cdd786-4498-4e1d-8eff-7407674beb52", "address": "fa:16:3e:e3:38:55", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdd786-44", "ovs_interfaceid": "90cdd786-4498-4e1d-8eff-7407674beb52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:38:55,bridge_name='br-int',has_traffic_filtering=True,id=90cdd786-4498-4e1d-8eff-7407674beb52,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cdd786-44') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG os_vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:38:55,bridge_name='br-int',has_traffic_filtering=True,id=90cdd786-4498-4e1d-8eff-7407674beb52,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cdd786-44') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90cdd786-44, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d1246c3-d19b-4783-88ae-5123a457f5b2) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-6a539c52-5acd-4b03-bd56-8c08f59c71fd req-12a202d0-6f51-4a83-ade2-45d4bd2285db service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-2eb26bff-1c84-413b-b3b4-fbc18940f912 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6a539c52-5acd-4b03-bd56-8c08f59c71fd req-12a202d0-6f51-4a83-ade2-45d4bd2285db service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6a539c52-5acd-4b03-bd56-8c08f59c71fd req-12a202d0-6f51-4a83-ade2-45d4bd2285db service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6a539c52-5acd-4b03-bd56-8c08f59c71fd req-12a202d0-6f51-4a83-ade2-45d4bd2285db service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-6a539c52-5acd-4b03-bd56-8c08f59c71fd req-12a202d0-6f51-4a83-ade2-45d4bd2285db service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-2eb26bff-1c84-413b-b3b4-fbc18940f912 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:40 user nova-compute[75571]: WARNING nova.compute.manager [req-6a539c52-5acd-4b03-bd56-8c08f59c71fd req-12a202d0-6f51-4a83-ade2-45d4bd2285db service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-2eb26bff-1c84-413b-b3b4-fbc18940f912 for instance with vm_state active and task_state deleting.
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: INFO os_vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:38:55,bridge_name='br-int',has_traffic_filtering=True,id=90cdd786-4498-4e1d-8eff-7407674beb52,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cdd786-44')
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "address": "fa:16:3e:46:26:0d", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78aeb66d-21", "ovs_interfaceid": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "address": "fa:16:3e:46:26:0d", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78aeb66d-21", "ovs_interfaceid": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:26:0d,bridge_name='br-int',has_traffic_filtering=True,id=78aeb66d-2196-43e4-80fb-ffbf4559d29f,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78aeb66d-21') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:26:0d,bridge_name='br-int',has_traffic_filtering=True,id=78aeb66d-2196-43e4-80fb-ffbf4559d29f,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78aeb66d-21') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78aeb66d-21, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5a192e5-b915-4046-a71c-0ebec6a7a460) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "fc91159a-f3ce-4674-b9e4-a548d373471b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: INFO os_vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:26:0d,bridge_name='br-int',has_traffic_filtering=True,id=78aeb66d-2196-43e4-80fb-ffbf4559d29f,network=Network(9c1ab26c-548b-4032-8215-a2e67035b811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78aeb66d-21')
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "address": "fa:16:3e:59:92:9e", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec8aa66-f6", "ovs_interfaceid": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "address": "fa:16:3e:59:92:9e", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec8aa66-f6", "ovs_interfaceid": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:92:9e,bridge_name='br-int',has_traffic_filtering=True,id=dec8aa66-f6b6-4e5a-b055-c6321063f024,network=Network(5a401ccf-f76c-407a-8684-f55009848833),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec8aa66-f6') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:92:9e,bridge_name='br-int',has_traffic_filtering=True,id=dec8aa66-f6b6-4e5a-b055-c6321063f024,network=Network(5a401ccf-f76c-407a-8684-f55009848833),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec8aa66-f6') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.network.neutron [req-0d38f010-818d-4be8-8489-f7940fa7f65b req-f6e5dd29-e997-46c2-9a6b-9c604e76888c service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Updated VIF entry in instance network info cache for port fc196680-3f93-4710-b508-752c9aa39f18. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.network.neutron [req-0d38f010-818d-4be8-8489-f7940fa7f65b req-f6e5dd29-e997-46c2-9a6b-9c604e76888c service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Updating instance_info_cache with network_info: [{"id": "fc196680-3f93-4710-b508-752c9aa39f18", "address": "fa:16:3e:44:80:a9", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc196680-3f", "ovs_interfaceid": "fc196680-3f93-4710-b508-752c9aa39f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdec8aa66-f6, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-00fac4f4-969a-449b-a264-4d1ce345c3b6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-00fac4f4-969a-449b-a264-4d1ce345c3b6 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:41 user nova-compute[75571]: WARNING nova.compute.manager [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-00fac4f4-969a-449b-a264-4d1ce345c3b6 for instance with vm_state active and task_state deleting.
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-unplugged-13d2eb0a-77c7-4db6-96c1-547dc7781057 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-unplugged-13d2eb0a-77c7-4db6-96c1-547dc7781057 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-unplugged-13d2eb0a-77c7-4db6-96c1-547dc7781057 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-13d2eb0a-77c7-4db6-96c1-547dc7781057 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-13d2eb0a-77c7-4db6-96c1-547dc7781057 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:41 user nova-compute[75571]: WARNING nova.compute.manager [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-13d2eb0a-77c7-4db6-96c1-547dc7781057 for instance with vm_state active and task_state deleting.
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-unplugged-78aeb66d-2196-43e4-80fb-ffbf4559d29f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-unplugged-78aeb66d-2196-43e4-80fb-ffbf4559d29f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-unplugged-78aeb66d-2196-43e4-80fb-ffbf4559d29f for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-78aeb66d-2196-43e4-80fb-ffbf4559d29f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-78aeb66d-2196-43e4-80fb-ffbf4559d29f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:41 user nova-compute[75571]: WARNING nova.compute.manager [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-78aeb66d-2196-43e4-80fb-ffbf4559d29f for instance with vm_state active and task_state deleting.
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0d38f010-818d-4be8-8489-f7940fa7f65b req-f6e5dd29-e997-46c2-9a6b-9c604e76888c service nova] Releasing lock "refresh_cache-4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bfd0f0be-b2f2-462f-a070-8c5c1a32aa2f) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: INFO os_vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:92:9e,bridge_name='br-int',has_traffic_filtering=True,id=dec8aa66-f6b6-4e5a-b055-c6321063f024,network=Network(5a401ccf-f76c-407a-8684-f55009848833),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec8aa66-f6')
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:14:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-669424600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-669424600',id=14,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ==',key_name='tempest-keypair-1759875013',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='573c587fe3af43a5a01c4e5db0643075',ramdisk_id='',reservation_id='r-09sh5udf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-771180377',owner_user_name='tempest-TaggedBootDevicesTest_v242-771180377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d826645c8f4f4ce7bb0cf606d9005ed2',uuid=17cffd89-efcd-4c35-8c12-75393c8776f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converting VIF {"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ea:4f,bridge_name='br-int',has_traffic_filtering=True,id=5923f2c1-af01-4178-8faf-143583adb2d9,network=Network(5a401ccf-f76c-407a-8684-f55009848833),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5923f2c1-af') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ea:4f,bridge_name='br-int',has_traffic_filtering=True,id=5923f2c1-af01-4178-8faf-143583adb2d9,network=Network(5a401ccf-f76c-407a-8684-f55009848833),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5923f2c1-af') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5923f2c1-af, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b935600c-e45d-4e39-aabf-9c2c498686b6) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:16:41 user nova-compute[75571]: INFO nova.compute.claims [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Claim successful on node user
Nov 28 20:16:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:41 user nova-compute[75571]: INFO os_vif [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ea:4f,bridge_name='br-int',has_traffic_filtering=True,id=5923f2c1-af01-4178-8faf-143583adb2d9,network=Network(5a401ccf-f76c-407a-8684-f55009848833),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5923f2c1-af')
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKOCFqBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:16:41 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5887b8dc-633b-4df5-ae69-630c432d53db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:16:41 user nova-compute[75571]: No targets found.
Nov 28 20:16:41 user nova-compute[75571]: iSNS:
Nov 28 20:16:41 user nova-compute[75571]: No targets found.
Nov 28 20:16:41 user nova-compute[75571]: STATIC:
Nov 28 20:16:41 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851
Nov 28 20:16:41 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:41 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:41 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3
Nov 28 20:16:41 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:41 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:41 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4
Nov 28 20:16:41 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:41 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:41 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a
Nov 28 20:16:41 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:41 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:41 user nova-compute[75571]: FIRMWARE:
Nov 28 20:16:41 user nova-compute[75571]: No targets found.
Nov 28 20:16:41 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:16:41 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:16:41 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b81c7a7-d6f5-4af8-aeef-9e06e6a77d13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03f8650-fe88-4d68-a83e-ac443a90a78e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:16:41 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:41 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:41 user nova-compute[75571]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:16:41 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 (non-flash)
Nov 28 20:16:41 user nova-compute[75571]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:41 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:41 user nova-compute[75571]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:16:41 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f776817f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4'): ({'sdd'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Removing single pathed devices sdd {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe63cb3e-e6a2-42ef-a1d1-6611e298c84f]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cee0ecd-e131-4fec-8c16-9951d740e510]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Flushing IO for device /dev/sdd {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e280190-fb51-4c11-95ce-2d7b50dd6997]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-unplugged-90cdd786-4498-4e1d-8eff-7407674beb52 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-unplugged-90cdd786-4498-4e1d-8eff-7407674beb52 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-unplugged-90cdd786-4498-4e1d-8eff-7407674beb52 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-90cdd786-4498-4e1d-8eff-7407674beb52 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-90cdd786-4498-4e1d-8eff-7407674beb52 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:41 user nova-compute[75571]: WARNING nova.compute.manager [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-90cdd786-4498-4e1d-8eff-7407674beb52 for instance with vm_state active and task_state deleting.
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-unplugged-dec8aa66-f6b6-4e5a-b055-c6321063f024 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-unplugged-dec8aa66-f6b6-4e5a-b055-c6321063f024 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-unplugged-dec8aa66-f6b6-4e5a-b055-c6321063f024 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-dec8aa66-f6b6-4e5a-b055-c6321063f024 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-dec8aa66-f6b6-4e5a-b055-c6321063f024 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:41 user nova-compute[75571]: WARNING nova.compute.manager [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-dec8aa66-f6b6-4e5a-b055-c6321063f024 for instance with vm_state active and task_state deleting.
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-unplugged-5923f2c1-af01-4178-8faf-143583adb2d9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-unplugged-5923f2c1-af01-4178-8faf-143583adb2d9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-unplugged-5923f2c1-af01-4178-8faf-143583adb2d9 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[56acc820-9adb-485c-8d14-7810a6839ebc]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] SCSI volumes sdd have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf2e055-5112-4207-93da-e6627638fa0f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[162bc566-c7f8-43c6-9938-efb0347c31a2]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4, portal: 172.16.0.220,3260]
Nov 28 20:16:41 user nova-compute[75571]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4, portal: 172.16.0.220,3260] successful.
Nov 28 20:16:41 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037b5b30-bff1-4d62-b6b5-21a93e3891a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1880fbba-1a40-4d40-b4bc-788072218c37]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] <== disconnect_volume: return (343ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ciPdBaCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:16:41 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b4a0ca-7a5d-4d56-97f0-bb79cb7b1a9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:16:41 user nova-compute[75571]: No targets found.
Nov 28 20:16:41 user nova-compute[75571]: iSNS:
Nov 28 20:16:41 user nova-compute[75571]: No targets found.
Nov 28 20:16:41 user nova-compute[75571]: STATIC:
Nov 28 20:16:41 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851
Nov 28 20:16:41 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:41 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:41 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3
Nov 28 20:16:41 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:41 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:41 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a
Nov 28 20:16:41 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:41 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:41 user nova-compute[75571]: FIRMWARE:
Nov 28 20:16:41 user nova-compute[75571]: No targets found.
Nov 28 20:16:41 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:16:41 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:16:41 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ecb91a-2c30-4f54-a494-8418ef49001e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[951d38b1-2059-4359-83dd-5240795e3e47]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:41 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:41 user nova-compute[75571]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:16:41 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a (non-flash)
Nov 28 20:16:41 user nova-compute[75571]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:41 user nova-compute[75571]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:16:41 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f776811edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a'): ({'sde'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Removing single pathed devices sde {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f4f7ac-3d1c-441c-8f9f-bfa05ab4955c]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[35245bf8-7fb8-4c16-872e-4aa53d885dad]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Flushing IO for device /dev/sde {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0f1df2-9d3c-43eb-90a4-9933b32db299]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.073s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[383fa3d3-4200-41fe-b0a5-c189d8434b16]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] SCSI volumes sde have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecc874c-c50c-44c6-aa6d-5b24d6d63ba2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.684s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3548c916-7f02-449f-a5fa-b240d72430a6]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a, portal: 172.16.0.220,3260]
Nov 28 20:16:41 user nova-compute[75571]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a, portal: 172.16.0.220,3260] successful.
Nov 28 20:16:41 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d17e45e-920e-43e3-a502-1047571c3c0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0f3f27-c945-43bd-9bf1-215fa8e167ee]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] <== disconnect_volume: return (363ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIzcKfPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:16:42 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:16:42 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fb93ea-0e26-486e-90b8-47c886475b60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:16:42 user nova-compute[75571]: No targets found.
Nov 28 20:16:42 user nova-compute[75571]: iSNS:
Nov 28 20:16:42 user nova-compute[75571]: No targets found.
Nov 28 20:16:42 user nova-compute[75571]: STATIC:
Nov 28 20:16:42 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851
Nov 28 20:16:42 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:42 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:42 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3
Nov 28 20:16:42 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:16:42 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:16:42 user nova-compute[75571]: FIRMWARE:
Nov 28 20:16:42 user nova-compute[75571]: No targets found.
Nov 28 20:16:42 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:16:42 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:16:42 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[27757505-04e5-468d-a41d-baf5be5f2a47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad07fd4-727f-4b1c-9791-411d255704ce]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:42 user nova-compute[75571]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:16:42 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 (non-flash)
Nov 28 20:16:42 user nova-compute[75571]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:16:42 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f776814f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3'): ({'sdf'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Removing single pathed devices sdf {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG nova.policy [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '740070b2e6434ca9a733cb932663572c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f7955f73e434cb014eeaeffa2824f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.047s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3289e109-f6ce-47f8-8e23-7c1b85422c8f]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d66d019-1660-4c33-981c-729f75a65647]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Flushing IO for device /dev/sdf {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:16:42 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Creating image(s)
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "/opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "/opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.034s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ae38ef-11f9-4a72-a433-f37475103fc1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.060s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a809f6-a46a-4dde-994e-3ab711bebc56]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] SCSI volumes sdf have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b04a6b-8107-4172-895a-602fd796431f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0bc808-9358-4214-a718-256c95801650]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3, portal: 172.16.0.220,3260]
Nov 28 20:16:42 user nova-compute[75571]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3, portal: 172.16.0.220,3260] successful.
Nov 28 20:16:42 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f35406-cae5-4853-b197-f772e12de0b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f73f67-133b-4859-9f1c-2d5f13dfa53c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.499s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] <== disconnect_volume: return (500ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:16:42 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Deleting instance files /opt/stack/data/nova/instances/17cffd89-efcd-4c35-8c12-75393c8776f8_del
Nov 28 20:16:42 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Deletion of /opt/stack/data/nova/instances/17cffd89-efcd-4c35-8c12-75393c8776f8_del complete
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.276s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:42 user nova-compute[75571]: INFO nova.compute.manager [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Took 4.74 seconds to destroy the instance on the hypervisor.
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.224s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk 1073741824" returned: 0 in 0.058s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Successfully created port: d190a550-01ac-49d5-a9dc-b62ed711fe32 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:16:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.230s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Received event network-vif-plugged-fc196680-3f93-4710-b508-752c9aa39f18 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] Acquiring lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] No waiting events found dispatching network-vif-plugged-fc196680-3f93-4710-b508-752c9aa39f18 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:43 user nova-compute[75571]: WARNING nova.compute.manager [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Received unexpected event network-vif-plugged-fc196680-3f93-4710-b508-752c9aa39f18 for instance with vm_state building and task_state spawning.
Nov 28 20:16:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Received event network-vif-plugged-fc196680-3f93-4710-b508-752c9aa39f18 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] Acquiring lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] No waiting events found dispatching network-vif-plugged-fc196680-3f93-4710-b508-752c9aa39f18 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:43 user nova-compute[75571]: WARNING nova.compute.manager [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Received unexpected event network-vif-plugged-fc196680-3f93-4710-b508-752c9aa39f18 for instance with vm_state building and task_state spawning.
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Cannot resize image /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Ensure instance console log exists: /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-8b0c1a95-dcc4-45d4-b3c4-c55599d53989 req-e163ef92-a7b5-48f0-8948-5cfb4dfe88e6 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-plugged-5923f2c1-af01-4178-8faf-143583adb2d9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8b0c1a95-dcc4-45d4-b3c4-c55599d53989 req-e163ef92-a7b5-48f0-8948-5cfb4dfe88e6 service nova] Acquiring lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8b0c1a95-dcc4-45d4-b3c4-c55599d53989 req-e163ef92-a7b5-48f0-8948-5cfb4dfe88e6 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8b0c1a95-dcc4-45d4-b3c4-c55599d53989 req-e163ef92-a7b5-48f0-8948-5cfb4dfe88e6 service nova] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-8b0c1a95-dcc4-45d4-b3c4-c55599d53989 req-e163ef92-a7b5-48f0-8948-5cfb4dfe88e6 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] No waiting events found dispatching network-vif-plugged-5923f2c1-af01-4178-8faf-143583adb2d9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:43 user nova-compute[75571]: WARNING nova.compute.manager [req-8b0c1a95-dcc4-45d4-b3c4-c55599d53989 req-e163ef92-a7b5-48f0-8948-5cfb4dfe88e6 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received unexpected event network-vif-plugged-5923f2c1-af01-4178-8faf-143583adb2d9 for instance with vm_state active and task_state deleting.
Nov 28 20:16:43 user nova-compute[75571]: DEBUG nova.network.neutron [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Successfully updated port: d190a550-01ac-49d5-a9dc-b62ed711fe32 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "refresh_cache-fc91159a-f3ce-4674-b9e4-a548d373471b" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquired lock "refresh_cache-fc91159a-f3ce-4674-b9e4-a548d373471b" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG nova.network.neutron [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:43 user nova-compute[75571]: DEBUG nova.network.neutron [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.network.neutron [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Updating instance_info_cache with network_info: [{"id": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "address": "fa:16:3e:db:bb:ee", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd190a550-01", "ovs_interfaceid": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Releasing lock "refresh_cache-fc91159a-f3ce-4674-b9e4-a548d373471b" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.compute.manager [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Instance network_info: |[{"id": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "address": "fa:16:3e:db:bb:ee", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd190a550-01", "ovs_interfaceid": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Start _get_guest_xml network_info=[{"id": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "address": "fa:16:3e:db:bb:ee", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd190a550-01", "ovs_interfaceid": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:16:44 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:16:44 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:16:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1646342622',display_name='tempest-VolumesSnapshotTestJSON-instance-1646342622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1646342622',id=20,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhZkQDdLZeWcw+DLJgWEP7/QLMXDWRzm0CPVYVn2k4jy1vGUzXjooGrXig9p8ufo5hQjxqLQZi7n2kxD83VZKSlK30YLJPXw2/ETdSXJesP9+5Qq2fcU4CsAGjcrk0PAw==',key_name='tempest-keypair-526921959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548f7955f73e434cb014eeaeffa2824f',ramdisk_id='',reservation_id='r-5si3jb4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2135983630',owner_user_name='tempest-VolumesSnapshotTestJSON-2135983630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:16:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='740070b2e6434ca9a733cb932663572c',uuid=fc91159a-f3ce-4674-b9e4-a548d373471b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "address": "fa:16:3e:db:bb:ee", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd190a550-01", "ovs_interfaceid": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Converting VIF {"id": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "address": "fa:16:3e:db:bb:ee", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd190a550-01", "ovs_interfaceid": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=d190a550-01ac-49d5-a9dc-b62ed711fe32,network=Network(80eb1442-8e05-4d31-96b5-26df5f47f887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd190a550-01') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.objects.instance [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lazy-loading 'pci_devices' on Instance uuid fc91159a-f3ce-4674-b9e4-a548d373471b {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:16:44 user nova-compute[75571]:   <uuid>fc91159a-f3ce-4674-b9e4-a548d373471b</uuid>
Nov 28 20:16:44 user nova-compute[75571]:   <name>instance-00000014</name>
Nov 28 20:16:44 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:16:44 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:16:44 user nova-compute[75571]:   <metadata>
Nov 28 20:16:44 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:16:44 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:16:44 user nova-compute[75571]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1646342622</nova:name>
Nov 28 20:16:44 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:16:44</nova:creationTime>
Nov 28 20:16:44 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:16:44 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:16:44 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:16:44 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:16:44 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:16:44 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:16:44 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:16:44 user nova-compute[75571]:       <nova:owner>
Nov 28 20:16:44 user nova-compute[75571]:         <nova:user uuid="740070b2e6434ca9a733cb932663572c">tempest-VolumesSnapshotTestJSON-2135983630-project-member</nova:user>
Nov 28 20:16:44 user nova-compute[75571]:         <nova:project uuid="548f7955f73e434cb014eeaeffa2824f">tempest-VolumesSnapshotTestJSON-2135983630</nova:project>
Nov 28 20:16:44 user nova-compute[75571]:       </nova:owner>
Nov 28 20:16:44 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:16:44 user nova-compute[75571]:       <nova:ports>
Nov 28 20:16:44 user nova-compute[75571]:         <nova:port uuid="d190a550-01ac-49d5-a9dc-b62ed711fe32">
Nov 28 20:16:44 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 20:16:44 user nova-compute[75571]:         </nova:port>
Nov 28 20:16:44 user nova-compute[75571]:       </nova:ports>
Nov 28 20:16:44 user nova-compute[75571]:     </nova:instance>
Nov 28 20:16:44 user nova-compute[75571]:   </metadata>
Nov 28 20:16:44 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:16:44 user nova-compute[75571]:     <system>
Nov 28 20:16:44 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:16:44 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:16:44 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:16:44 user nova-compute[75571]:       <entry name="serial">fc91159a-f3ce-4674-b9e4-a548d373471b</entry>
Nov 28 20:16:44 user nova-compute[75571]:       <entry name="uuid">fc91159a-f3ce-4674-b9e4-a548d373471b</entry>
Nov 28 20:16:44 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:16:44 user nova-compute[75571]:     </system>
Nov 28 20:16:44 user nova-compute[75571]:   </sysinfo>
Nov 28 20:16:44 user nova-compute[75571]:   <os>
Nov 28 20:16:44 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:16:44 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:16:44 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:16:44 user nova-compute[75571]:   </os>
Nov 28 20:16:44 user nova-compute[75571]:   <features>
Nov 28 20:16:44 user nova-compute[75571]:     <acpi/>
Nov 28 20:16:44 user nova-compute[75571]:     <apic/>
Nov 28 20:16:44 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:16:44 user nova-compute[75571]:   </features>
Nov 28 20:16:44 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:16:44 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:16:44 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:16:44 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:16:44 user nova-compute[75571]:   </clock>
Nov 28 20:16:44 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:16:44 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:16:44 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:16:44 user nova-compute[75571]:   </cpu>
Nov 28 20:16:44 user nova-compute[75571]:   <devices>
Nov 28 20:16:44 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:16:44 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:16:44 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk"/>
Nov 28 20:16:44 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:16:44 user nova-compute[75571]:     </disk>
Nov 28 20:16:44 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:16:44 user nova-compute[75571]:       <mac address="fa:16:3e:db:bb:ee"/>
Nov 28 20:16:44 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:16:44 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:16:44 user nova-compute[75571]:       <target dev="tapd190a550-01"/>
Nov 28 20:16:44 user nova-compute[75571]:     </interface>
Nov 28 20:16:44 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:16:44 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/console.log" append="off"/>
Nov 28 20:16:44 user nova-compute[75571]:     </serial>
Nov 28 20:16:44 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:16:44 user nova-compute[75571]:     <video>
Nov 28 20:16:44 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:16:44 user nova-compute[75571]:     </video>
Nov 28 20:16:44 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:16:44 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:16:44 user nova-compute[75571]:     </rng>
Nov 28 20:16:44 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:16:44 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:16:44 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:16:44 user nova-compute[75571]:     </memballoon>
Nov 28 20:16:44 user nova-compute[75571]:   </devices>
Nov 28 20:16:44 user nova-compute[75571]: </domain>
Nov 28 20:16:44 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:16:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1646342622',display_name='tempest-VolumesSnapshotTestJSON-instance-1646342622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1646342622',id=20,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhZkQDdLZeWcw+DLJgWEP7/QLMXDWRzm0CPVYVn2k4jy1vGUzXjooGrXig9p8ufo5hQjxqLQZi7n2kxD83VZKSlK30YLJPXw2/ETdSXJesP9+5Qq2fcU4CsAGjcrk0PAw==',key_name='tempest-keypair-526921959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548f7955f73e434cb014eeaeffa2824f',ramdisk_id='',reservation_id='r-5si3jb4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2135983630',owner_user_name='tempest-VolumesSnapshotTestJSON-2135983630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:16:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='740070b2e6434ca9a733cb932663572c',uuid=fc91159a-f3ce-4674-b9e4-a548d373471b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "address": "fa:16:3e:db:bb:ee", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd190a550-01", "ovs_interfaceid": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Converting VIF {"id": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "address": "fa:16:3e:db:bb:ee", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd190a550-01", "ovs_interfaceid": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=d190a550-01ac-49d5-a9dc-b62ed711fe32,network=Network(80eb1442-8e05-4d31-96b5-26df5f47f887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd190a550-01') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG os_vif [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=d190a550-01ac-49d5-a9dc-b62ed711fe32,network=Network(80eb1442-8e05-4d31-96b5-26df5f47f887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd190a550-01') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6cb6c275-db51-5fb7-b050-a4aa8b854b7e', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd190a550-01, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd190a550-01, col_values=(('qos', UUID('171168f4-4b3c-4315-871b-5340b1fe4244')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd190a550-01, col_values=(('external_ids', {'iface-id': 'd190a550-01ac-49d5-a9dc-b62ed711fe32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:bb:ee', 'vm-uuid': 'fc91159a-f3ce-4674-b9e4-a548d373471b'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:44 user nova-compute[75571]: INFO os_vif [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=d190a550-01ac-49d5-a9dc-b62ed711fe32,network=Network(80eb1442-8e05-4d31-96b5-26df5f47f887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd190a550-01')
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] No VIF found with MAC fa:16:3e:db:bb:ee, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.compute.manager [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:16:44 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Instance spawned successfully.
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.compute.manager [req-e66c6625-f7cf-4f81-a062-c5a56e915e8e req-1ea72418-130d-4bd1-9682-2b33af6b424a service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-deleted-90cdd786-4498-4e1d-8eff-7407674beb52 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:44 user nova-compute[75571]: INFO nova.compute.manager [req-e66c6625-f7cf-4f81-a062-c5a56e915e8e req-1ea72418-130d-4bd1-9682-2b33af6b424a service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Neutron deleted interface 90cdd786-4498-4e1d-8eff-7407674beb52; detaching it from the instance and deleting it from the info cache
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.network.neutron [req-e66c6625-f7cf-4f81-a062-c5a56e915e8e req-1ea72418-130d-4bd1-9682-2b33af6b424a service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating instance_info_cache with network_info: [{"id": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "address": "fa:16:3e:de:65:0c", "network": {"id": "f4277af4-8e9c-4147-9ca9-2cf286d9de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-271277689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00fac4f4-96", "ovs_interfaceid": "00fac4f4-969a-449b-a264-4d1ce345c3b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "address": "fa:16:3e:46:26:0d", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78aeb66d-21", "ovs_interfaceid": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "address": "fa:16:3e:59:92:9e", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec8aa66-f6", "ovs_interfaceid": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.compute.manager [req-e66c6625-f7cf-4f81-a062-c5a56e915e8e req-1ea72418-130d-4bd1-9682-2b33af6b424a service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Detach interface failed, port_id=90cdd786-4498-4e1d-8eff-7407674beb52, reason: Instance 17cffd89-efcd-4c35-8c12-75393c8776f8 could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:16:44 user nova-compute[75571]: INFO nova.compute.manager [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Took 7.64 seconds to spawn the instance on the hypervisor.
Nov 28 20:16:44 user nova-compute[75571]: DEBUG nova.compute.manager [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:16:45 user nova-compute[75571]: INFO nova.compute.manager [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Took 8.66 seconds to build instance.
Nov 28 20:16:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.787s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-b40fa814-5ecb-464e-900a-a2012e5bff29 req-e29b1026-72b3-4f91-9763-725505242334 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Received event network-changed-d190a550-01ac-49d5-a9dc-b62ed711fe32 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-b40fa814-5ecb-464e-900a-a2012e5bff29 req-e29b1026-72b3-4f91-9763-725505242334 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Refreshing instance network info cache due to event network-changed-d190a550-01ac-49d5-a9dc-b62ed711fe32. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:16:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b40fa814-5ecb-464e-900a-a2012e5bff29 req-e29b1026-72b3-4f91-9763-725505242334 service nova] Acquiring lock "refresh_cache-fc91159a-f3ce-4674-b9e4-a548d373471b" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:16:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b40fa814-5ecb-464e-900a-a2012e5bff29 req-e29b1026-72b3-4f91-9763-725505242334 service nova] Acquired lock "refresh_cache-fc91159a-f3ce-4674-b9e4-a548d373471b" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:16:45 user nova-compute[75571]: DEBUG nova.network.neutron [req-b40fa814-5ecb-464e-900a-a2012e5bff29 req-e29b1026-72b3-4f91-9763-725505242334 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Refreshing network info cache for port d190a550-01ac-49d5-a9dc-b62ed711fe32 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:16:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:46 user nova-compute[75571]: DEBUG nova.network.neutron [req-b40fa814-5ecb-464e-900a-a2012e5bff29 req-e29b1026-72b3-4f91-9763-725505242334 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Updated VIF entry in instance network info cache for port d190a550-01ac-49d5-a9dc-b62ed711fe32. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:16:46 user nova-compute[75571]: DEBUG nova.network.neutron [req-b40fa814-5ecb-464e-900a-a2012e5bff29 req-e29b1026-72b3-4f91-9763-725505242334 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Updating instance_info_cache with network_info: [{"id": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "address": "fa:16:3e:db:bb:ee", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd190a550-01", "ovs_interfaceid": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:16:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b40fa814-5ecb-464e-900a-a2012e5bff29 req-e29b1026-72b3-4f91-9763-725505242334 service nova] Releasing lock "refresh_cache-fc91159a-f3ce-4674-b9e4-a548d373471b" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:16:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-deleted-00fac4f4-969a-449b-a264-4d1ce345c3b6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:46 user nova-compute[75571]: INFO nova.compute.manager [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Neutron deleted interface 00fac4f4-969a-449b-a264-4d1ce345c3b6; detaching it from the instance and deleting it from the info cache
Nov 28 20:16:46 user nova-compute[75571]: DEBUG nova.network.neutron [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating instance_info_cache with network_info: [{"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "address": "fa:16:3e:46:26:0d", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78aeb66d-21", "ovs_interfaceid": "78aeb66d-2196-43e4-80fb-ffbf4559d29f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "address": "fa:16:3e:59:92:9e", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec8aa66-f6", "ovs_interfaceid": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:16:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Detach interface failed, port_id=00fac4f4-969a-449b-a264-4d1ce345c3b6, reason: Instance 17cffd89-efcd-4c35-8c12-75393c8776f8 could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:16:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-deleted-78aeb66d-2196-43e4-80fb-ffbf4559d29f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:46 user nova-compute[75571]: INFO nova.compute.manager [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Neutron deleted interface 78aeb66d-2196-43e4-80fb-ffbf4559d29f; detaching it from the instance and deleting it from the info cache
Nov 28 20:16:46 user nova-compute[75571]: DEBUG nova.network.neutron [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating instance_info_cache with network_info: [{"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "address": "fa:16:3e:59:92:9e", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec8aa66-f6", "ovs_interfaceid": "dec8aa66-f6b6-4e5a-b055-c6321063f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:16:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Detach interface failed, port_id=78aeb66d-2196-43e4-80fb-ffbf4559d29f, reason: Instance 17cffd89-efcd-4c35-8c12-75393c8776f8 could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:16:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-deleted-dec8aa66-f6b6-4e5a-b055-c6321063f024 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:47 user nova-compute[75571]: INFO nova.compute.manager [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Neutron deleted interface dec8aa66-f6b6-4e5a-b055-c6321063f024; detaching it from the instance and deleting it from the info cache
Nov 28 20:16:47 user nova-compute[75571]: DEBUG nova.network.neutron [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating instance_info_cache with network_info: [{"id": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "address": "fa:16:3e:48:b6:66", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d2eb0a-77", "ovs_interfaceid": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "address": "fa:16:3e:31:73:04", "network": {"id": "9c1ab26c-548b-4032-8215-a2e67035b811", "bridge": "br-int", "label": "tempest-device-tagging-net1-275529754", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb26bff-1c", "ovs_interfaceid": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5923f2c1-af01-4178-8faf-143583adb2d9", "address": "fa:16:3e:2b:ea:4f", "network": {"id": "5a401ccf-f76c-407a-8684-f55009848833", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819359849", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "573c587fe3af43a5a01c4e5db0643075", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5923f2c1-af", "ovs_interfaceid": "5923f2c1-af01-4178-8faf-143583adb2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:16:47 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:16:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Detach interface failed, port_id=dec8aa66-f6b6-4e5a-b055-c6321063f024, reason: Instance 17cffd89-efcd-4c35-8c12-75393c8776f8 could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:16:47 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Took 4.43 seconds to deallocate network for instance.
Nov 28 20:16:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 20:16:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] There are 0 instances to clean {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 20:16:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Received event network-vif-plugged-d190a550-01ac-49d5-a9dc-b62ed711fe32 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] Acquiring lock "fc91159a-f3ce-4674-b9e4-a548d373471b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] No waiting events found dispatching network-vif-plugged-d190a550-01ac-49d5-a9dc-b62ed711fe32 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:47 user nova-compute[75571]: WARNING nova.compute.manager [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Received unexpected event network-vif-plugged-d190a550-01ac-49d5-a9dc-b62ed711fe32 for instance with vm_state building and task_state spawning.
Nov 28 20:16:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Received event network-vif-plugged-d190a550-01ac-49d5-a9dc-b62ed711fe32 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] Acquiring lock "fc91159a-f3ce-4674-b9e4-a548d373471b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] No waiting events found dispatching network-vif-plugged-d190a550-01ac-49d5-a9dc-b62ed711fe32 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:16:47 user nova-compute[75571]: WARNING nova.compute.manager [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Received unexpected event network-vif-plugged-d190a550-01ac-49d5-a9dc-b62ed711fe32 for instance with vm_state building and task_state spawning.
Nov 28 20:16:48 user nova-compute[75571]: DEBUG nova.compute.manager [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:16:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:16:48 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Instance spawned successfully.
Nov 28 20:16:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:16:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:16:48 user nova-compute[75571]: INFO nova.compute.manager [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 28 20:16:48 user nova-compute[75571]: DEBUG nova.compute.manager [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:16:48 user nova-compute[75571]: INFO nova.compute.manager [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Took 7.55 seconds to build instance.
Nov 28 20:16:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.680s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-10bb8108-74e8-49d3-ae38-3e21eb7479d4 req-50cbd342-1151-448d-8d34-b2adfe7be922 service nova] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Received event network-vif-deleted-5923f2c1-af01-4178-8faf-143583adb2d9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:16:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:49 user nova-compute[75571]: INFO nova.compute.manager [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Took 2.65 seconds to detach 3 volumes for instance.
Nov 28 20:16:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:50 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:16:50 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:16:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:50 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Deleted allocations for instance 17cffd89-efcd-4c35-8c12-75393c8776f8
Nov 28 20:16:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "17cffd89-efcd-4c35-8c12-75393c8776f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.513s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:54 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:54 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:54 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:16:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:57 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:16:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-fe726611-331a-495f-a6bd-ced2d1a305b2" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:16:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-fe726611-331a-495f-a6bd-ced2d1a305b2" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:16:57 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:16:57 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Updating instance_info_cache with network_info: [{"id": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "address": "fa:16:3e:e6:89:ea", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccfe8e6-0f", "ovs_interfaceid": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:16:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-fe726611-331a-495f-a6bd-ced2d1a305b2" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:16:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:16:57 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:57 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:57 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75571) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 20:16:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:16:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:16:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:16:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:16:58 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:16:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:16:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:16:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:16:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:17:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:03 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:17:03 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=7462MB free_disk=25.287311553955078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance fe726611-331a-495f-a6bd-ced2d1a305b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance a8112c4a-cb42-49df-81a7-97b42f5cc87d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance b4000485-c53c-46e7-b585-cec40c114ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e05b0276-16f8-4876-b37b-711b63d65823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 40ac5386-d43f-443c-ac15-186b368728f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 785632ec-4b56-4fca-82a5-67e3d52de9cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance fc91159a-f3ce-4674-b9e4-a548d373471b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing inventories for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating ProviderTree inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing aggregate associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, aggregates: None {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing trait associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:17:03 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:17:04 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:17:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.825s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:04 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:17:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:07 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-d210b06e-cae9-4c32-993d-431fd86015ac req-a4e5937e-f5e3-49e1-aff3-69858faf0f35 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received event network-changed-cce19286-ec4f-4349-94c7-67f6ab63551c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-d210b06e-cae9-4c32-993d-431fd86015ac req-a4e5937e-f5e3-49e1-aff3-69858faf0f35 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Refreshing instance network info cache due to event network-changed-cce19286-ec4f-4349-94c7-67f6ab63551c. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d210b06e-cae9-4c32-993d-431fd86015ac req-a4e5937e-f5e3-49e1-aff3-69858faf0f35 service nova] Acquiring lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d210b06e-cae9-4c32-993d-431fd86015ac req-a4e5937e-f5e3-49e1-aff3-69858faf0f35 service nova] Acquired lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG nova.network.neutron [req-d210b06e-cae9-4c32-993d-431fd86015ac req-a4e5937e-f5e3-49e1-aff3-69858faf0f35 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Refreshing network info cache for port cce19286-ec4f-4349-94c7-67f6ab63551c {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "interface-f6e9eab9-0445-4dcd-bd67-ef73e102c909-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "interface-f6e9eab9-0445-4dcd-bd67-ef73e102c909-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG nova.objects.instance [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lazy-loading 'flavor' on Instance uuid f6e9eab9-0445-4dcd-bd67-ef73e102c909 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG nova.network.neutron [req-d210b06e-cae9-4c32-993d-431fd86015ac req-a4e5937e-f5e3-49e1-aff3-69858faf0f35 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Updated VIF entry in instance network info cache for port cce19286-ec4f-4349-94c7-67f6ab63551c. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG nova.network.neutron [req-d210b06e-cae9-4c32-993d-431fd86015ac req-a4e5937e-f5e3-49e1-aff3-69858faf0f35 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Updating instance_info_cache with network_info: [{"id": "cce19286-ec4f-4349-94c7-67f6ab63551c", "address": "fa:16:3e:99:11:08", "network": {"id": "268f60cb-1235-41c9-88d5-7b68c1de2795", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-595792232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce19286-ec", "ovs_interfaceid": "cce19286-ec4f-4349-94c7-67f6ab63551c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d210b06e-cae9-4c32-993d-431fd86015ac req-a4e5937e-f5e3-49e1-aff3-69858faf0f35 service nova] Releasing lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG nova.objects.instance [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lazy-loading 'pci_requests' on Instance uuid f6e9eab9-0445-4dcd-bd67-ef73e102c909 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG nova.objects.base [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Object Instance<f6e9eab9-0445-4dcd-bd67-ef73e102c909> lazy-loaded attributes: flavor,pci_requests {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG nova.network.neutron [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG nova.policy [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3de9c75fa13b4cfdaa348ed6e28e9d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb04f7bcf944c58f07769918fb18ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:17:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:09 user nova-compute[75571]: DEBUG nova.network.neutron [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Successfully created port: 91f1f715-9419-4a1e-a8d2-c14353edb662 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:17:10 user nova-compute[75571]: DEBUG nova.network.neutron [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Successfully updated port: 91f1f715-9419-4a1e-a8d2-c14353edb662 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:17:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:17:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquired lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:17:10 user nova-compute[75571]: DEBUG nova.network.neutron [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:17:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-a304c1cf-eb3a-43b7-816c-1caaff781c26 req-5e62b55f-e6b7-4270-91dc-4907ab3b1af7 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received event network-changed-91f1f715-9419-4a1e-a8d2-c14353edb662 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:17:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-a304c1cf-eb3a-43b7-816c-1caaff781c26 req-5e62b55f-e6b7-4270-91dc-4907ab3b1af7 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Refreshing instance network info cache due to event network-changed-91f1f715-9419-4a1e-a8d2-c14353edb662. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:17:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a304c1cf-eb3a-43b7-816c-1caaff781c26 req-5e62b55f-e6b7-4270-91dc-4907ab3b1af7 service nova] Acquiring lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.network.neutron [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Updating instance_info_cache with network_info: [{"id": "cce19286-ec4f-4349-94c7-67f6ab63551c", "address": "fa:16:3e:99:11:08", "network": {"id": "268f60cb-1235-41c9-88d5-7b68c1de2795", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-595792232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce19286-ec", "ovs_interfaceid": "cce19286-ec4f-4349-94c7-67f6ab63551c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91f1f715-9419-4a1e-a8d2-c14353edb662", "address": "fa:16:3e:47:1f:83", "network": {"id": "32177d6d-e6ed-4260-8a2e-c3fd0c3fd205", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-373773751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f1f715-94", "ovs_interfaceid": "91f1f715-9419-4a1e-a8d2-c14353edb662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Releasing lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a304c1cf-eb3a-43b7-816c-1caaff781c26 req-5e62b55f-e6b7-4270-91dc-4907ab3b1af7 service nova] Acquired lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.network.neutron [req-a304c1cf-eb3a-43b7-816c-1caaff781c26 req-5e62b55f-e6b7-4270-91dc-4907ab3b1af7 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Refreshing network info cache for port 91f1f715-9419-4a1e-a8d2-c14353edb662 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-314385621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-314385621',id=15,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJygV2sBwSu97x/mNv3tb+z8vi+uhgqoT2QUgvIa02FX6CxSOX0/P5GPCbQ7xDIoAjiVsAURNLlcT6927/eZSkKqdRK7mwgjh5qS2dEgtINUouxWTKkh2D8D/z/+oLMOWQ==',key_name='tempest-keypair-1640947232',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82eb04f7bcf944c58f07769918fb18ed',ramdisk_id='',reservation_id='r-06w0ycsv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1139944601',owner_user_name='tempest-TaggedAttachmentsTest-1139944601-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3de9c75fa13b4cfdaa348ed6e28e9d97',uuid=f6e9eab9-0445-4dcd-bd67-ef73e102c909,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91f1f715-9419-4a1e-a8d2-c14353edb662", "address": "fa:16:3e:47:1f:83", "network": {"id": "32177d6d-e6ed-4260-8a2e-c3fd0c3fd205", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-373773751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f1f715-94", "ovs_interfaceid": "91f1f715-9419-4a1e-a8d2-c14353edb662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Converting VIF {"id": "91f1f715-9419-4a1e-a8d2-c14353edb662", "address": "fa:16:3e:47:1f:83", "network": {"id": "32177d6d-e6ed-4260-8a2e-c3fd0c3fd205", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-373773751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f1f715-94", "ovs_interfaceid": "91f1f715-9419-4a1e-a8d2-c14353edb662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:83,bridge_name='br-int',has_traffic_filtering=True,id=91f1f715-9419-4a1e-a8d2-c14353edb662,network=Network(32177d6d-e6ed-4260-8a2e-c3fd0c3fd205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f1f715-94') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG os_vif [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:83,bridge_name='br-int',has_traffic_filtering=True,id=91f1f715-9419-4a1e-a8d2-c14353edb662,network=Network(32177d6d-e6ed-4260-8a2e-c3fd0c3fd205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f1f715-94') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d0759db-2463-53ef-b17c-a42a7b1a5755', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91f1f715-94, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91f1f715-94, col_values=(('qos', UUID('6d67f4de-3a66-4c7d-ad69-93a99ad2dcd6')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91f1f715-94, col_values=(('external_ids', {'iface-id': '91f1f715-9419-4a1e-a8d2-c14353edb662', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:1f:83', 'vm-uuid': 'f6e9eab9-0445-4dcd-bd67-ef73e102c909'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:11 user nova-compute[75571]: INFO os_vif [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:83,bridge_name='br-int',has_traffic_filtering=True,id=91f1f715-9419-4a1e-a8d2-c14353edb662,network=Network(32177d6d-e6ed-4260-8a2e-c3fd0c3fd205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f1f715-94')
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-314385621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-314385621',id=15,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJygV2sBwSu97x/mNv3tb+z8vi+uhgqoT2QUgvIa02FX6CxSOX0/P5GPCbQ7xDIoAjiVsAURNLlcT6927/eZSkKqdRK7mwgjh5qS2dEgtINUouxWTKkh2D8D/z/+oLMOWQ==',key_name='tempest-keypair-1640947232',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82eb04f7bcf944c58f07769918fb18ed',ramdisk_id='',reservation_id='r-06w0ycsv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1139944601',owner_user_name='tempest-TaggedAttachmentsTest-1139944601-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3de9c75fa13b4cfdaa348ed6e28e9d97',uuid=f6e9eab9-0445-4dcd-bd67-ef73e102c909,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91f1f715-9419-4a1e-a8d2-c14353edb662", "address": "fa:16:3e:47:1f:83", "network": {"id": "32177d6d-e6ed-4260-8a2e-c3fd0c3fd205", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-373773751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f1f715-94", "ovs_interfaceid": "91f1f715-9419-4a1e-a8d2-c14353edb662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Converting VIF {"id": "91f1f715-9419-4a1e-a8d2-c14353edb662", "address": "fa:16:3e:47:1f:83", "network": {"id": "32177d6d-e6ed-4260-8a2e-c3fd0c3fd205", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-373773751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f1f715-94", "ovs_interfaceid": "91f1f715-9419-4a1e-a8d2-c14353edb662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:83,bridge_name='br-int',has_traffic_filtering=True,id=91f1f715-9419-4a1e-a8d2-c14353edb662,network=Network(32177d6d-e6ed-4260-8a2e-c3fd0c3fd205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f1f715-94') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] attach device xml: <interface type="ethernet">
Nov 28 20:17:11 user nova-compute[75571]:   <mac address="fa:16:3e:47:1f:83"/>
Nov 28 20:17:11 user nova-compute[75571]:   <model type="virtio"/>
Nov 28 20:17:11 user nova-compute[75571]:   <mtu size="1442"/>
Nov 28 20:17:11 user nova-compute[75571]:   <target dev="tap91f1f715-94"/>
Nov 28 20:17:11 user nova-compute[75571]: </interface>
Nov 28 20:17:11 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "fe726611-331a-495f-a6bd-ced2d1a305b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "fe726611-331a-495f-a6bd-ced2d1a305b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:11 user nova-compute[75571]: INFO nova.compute.manager [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Terminating instance
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] No BDM found with device name hda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] No VIF found with MAC fa:16:3e:99:11:08, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:17:11 user nova-compute[75571]:   <nova:package version="0.0.0"/>
Nov 28 20:17:11 user nova-compute[75571]:   <nova:name>tempest-device-tagging-server-314385621</nova:name>
Nov 28 20:17:11 user nova-compute[75571]:   <nova:creationTime>2023-11-28 20:17:11</nova:creationTime>
Nov 28 20:17:11 user nova-compute[75571]:   <nova:flavor name="m1.tiny">
Nov 28 20:17:11 user nova-compute[75571]:     <nova:memory>512</nova:memory>
Nov 28 20:17:11 user nova-compute[75571]:     <nova:disk>1</nova:disk>
Nov 28 20:17:11 user nova-compute[75571]:     <nova:swap>0</nova:swap>
Nov 28 20:17:11 user nova-compute[75571]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:17:11 user nova-compute[75571]:     <nova:vcpus>1</nova:vcpus>
Nov 28 20:17:11 user nova-compute[75571]:   </nova:flavor>
Nov 28 20:17:11 user nova-compute[75571]:   <nova:owner>
Nov 28 20:17:11 user nova-compute[75571]:     <nova:user uuid="3de9c75fa13b4cfdaa348ed6e28e9d97">tempest-TaggedAttachmentsTest-1139944601-project-member</nova:user>
Nov 28 20:17:11 user nova-compute[75571]:     <nova:project uuid="82eb04f7bcf944c58f07769918fb18ed">tempest-TaggedAttachmentsTest-1139944601</nova:project>
Nov 28 20:17:11 user nova-compute[75571]:   </nova:owner>
Nov 28 20:17:11 user nova-compute[75571]:   <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:17:11 user nova-compute[75571]:   <nova:ports>
Nov 28 20:17:11 user nova-compute[75571]:     <nova:port uuid="cce19286-ec4f-4349-94c7-67f6ab63551c">
Nov 28 20:17:11 user nova-compute[75571]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:17:11 user nova-compute[75571]:     </nova:port>
Nov 28 20:17:11 user nova-compute[75571]:     <nova:port uuid="91f1f715-9419-4a1e-a8d2-c14353edb662">
Nov 28 20:17:11 user nova-compute[75571]:       <nova:ip type="fixed" address="10.10.10.174" ipVersion="4"/>
Nov 28 20:17:11 user nova-compute[75571]:     </nova:port>
Nov 28 20:17:11 user nova-compute[75571]:   </nova:ports>
Nov 28 20:17:11 user nova-compute[75571]: </nova:instance>
Nov 28 20:17:11 user nova-compute[75571]:  {{(pid=75571) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.network.neutron [req-a304c1cf-eb3a-43b7-816c-1caaff781c26 req-5e62b55f-e6b7-4270-91dc-4907ab3b1af7 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Updated VIF entry in instance network info cache for port 91f1f715-9419-4a1e-a8d2-c14353edb662. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG nova.network.neutron [req-a304c1cf-eb3a-43b7-816c-1caaff781c26 req-5e62b55f-e6b7-4270-91dc-4907ab3b1af7 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Updating instance_info_cache with network_info: [{"id": "cce19286-ec4f-4349-94c7-67f6ab63551c", "address": "fa:16:3e:99:11:08", "network": {"id": "268f60cb-1235-41c9-88d5-7b68c1de2795", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-595792232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce19286-ec", "ovs_interfaceid": "cce19286-ec4f-4349-94c7-67f6ab63551c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91f1f715-9419-4a1e-a8d2-c14353edb662", "address": "fa:16:3e:47:1f:83", "network": {"id": "32177d6d-e6ed-4260-8a2e-c3fd0c3fd205", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-373773751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f1f715-94", "ovs_interfaceid": "91f1f715-9419-4a1e-a8d2-c14353edb662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a304c1cf-eb3a-43b7-816c-1caaff781c26 req-5e62b55f-e6b7-4270-91dc-4907ab3b1af7 service nova] Releasing lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:17:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "interface-f6e9eab9-0445-4dcd-bd67-ef73e102c909-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.393s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:12 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Instance destroyed successfully.
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.objects.instance [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lazy-loading 'resources' on Instance uuid fe726611-331a-495f-a6bd-ced2d1a305b2 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:11:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1008982212',display_name='tempest-VolumesAdminNegativeTest-server-1008982212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1008982212',id=3,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB0OWWjuQd4dE5X2vm7yGb7xHx1upquomwhP+UabKwHK/1IkwgHLB9I3shvhWsJDuCJ6hKzLOm3A0CdQ0ZQQ0iJnqZ7fpxVqH2XiGfl3IXWC5JhikZD7HWo0MKm5CNeOQ==',key_name='tempest-keypair-1745238648',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:11:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63ff2e349b40430a91730a22fd4a0487',ramdisk_id='',reservation_id='r-1pi00vjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1106730846',owner_user_name='tempest-VolumesAdminNegativeTest-1106730846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d747c1fd611452f8d0e6ee1b423cd2c',uuid=fe726611-331a-495f-a6bd-ced2d1a305b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "address": "fa:16:3e:e6:89:ea", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccfe8e6-0f", "ovs_interfaceid": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Converting VIF {"id": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "address": "fa:16:3e:e6:89:ea", "network": {"id": "3b3bc160-310f-422a-ab1d-d8090334b344", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1113922055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ff2e349b40430a91730a22fd4a0487", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccfe8e6-0f", "ovs_interfaceid": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:89:ea,bridge_name='br-int',has_traffic_filtering=True,id=4ccfe8e6-0fe8-4546-8469-9c0634eaf74c,network=Network(3b3bc160-310f-422a-ab1d-d8090334b344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccfe8e6-0f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG os_vif [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:89:ea,bridge_name='br-int',has_traffic_filtering=True,id=4ccfe8e6-0fe8-4546-8469-9c0634eaf74c,network=Network(3b3bc160-310f-422a-ab1d-d8090334b344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccfe8e6-0f') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ccfe8e6-0f, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b36fcd25-4acb-4c6a-b47c-0cedf5dd3990) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:17:12 user nova-compute[75571]: INFO os_vif [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:89:ea,bridge_name='br-int',has_traffic_filtering=True,id=4ccfe8e6-0fe8-4546-8469-9c0634eaf74c,network=Network(3b3bc160-310f-422a-ab1d-d8090334b344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccfe8e6-0f')
Nov 28 20:17:12 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Deleting instance files /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2_del
Nov 28 20:17:12 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Deletion of /opt/stack/data/nova/instances/fe726611-331a-495f-a6bd-ced2d1a305b2_del complete
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:12 user nova-compute[75571]: INFO nova.compute.manager [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.objects.instance [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lazy-loading 'flavor' on Instance uuid f6e9eab9-0445-4dcd-bd67-ef73e102c909 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received event network-vif-plugged-91f1f715-9419-4a1e-a8d2-c14353edb662 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Acquiring lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] No waiting events found dispatching network-vif-plugged-91f1f715-9419-4a1e-a8d2-c14353edb662 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:17:12 user nova-compute[75571]: WARNING nova.compute.manager [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received unexpected event network-vif-plugged-91f1f715-9419-4a1e-a8d2-c14353edb662 for instance with vm_state active and task_state None.
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received event network-vif-plugged-91f1f715-9419-4a1e-a8d2-c14353edb662 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Acquiring lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] No waiting events found dispatching network-vif-plugged-91f1f715-9419-4a1e-a8d2-c14353edb662 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:17:12 user nova-compute[75571]: WARNING nova.compute.manager [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received unexpected event network-vif-plugged-91f1f715-9419-4a1e-a8d2-c14353edb662 for instance with vm_state active and task_state None.
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Received event network-vif-unplugged-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Acquiring lock "fe726611-331a-495f-a6bd-ced2d1a305b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] No waiting events found dispatching network-vif-unplugged-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Received event network-vif-unplugged-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:17:12 user nova-compute[75571]: WARNING nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid 3b0d4ca0-b527-4131-97ff-222cd9ced151 {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid a8112c4a-cb42-49df-81a7-97b42f5cc87d {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid f6e9eab9-0445-4dcd-bd67-ef73e102c909 {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid e05b0276-16f8-4876-b37b-711b63d65823 {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid 40ac5386-d43f-443c-ac15-186b368728f8 {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid 785632ec-4b56-4fca-82a5-67e3d52de9cb {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid fc91159a-f3ce-4674-b9e4-a548d373471b {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid fe726611-331a-495f-a6bd-ced2d1a305b2 {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid b4000485-c53c-46e7-b585-cec40c114ec9 {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "3b0d4ca0-b527-4131-97ff-222cd9ced151" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "e05b0276-16f8-4876-b37b-711b63d65823" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "e05b0276-16f8-4876-b37b-711b63d65823" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "40ac5386-d43f-443c-ac15-186b368728f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "fc91159a-f3ce-4674-b9e4-a548d373471b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "fe726611-331a-495f-a6bd-ced2d1a305b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "b4000485-c53c-46e7-b585-cec40c114ec9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "b4000485-c53c-46e7-b585-cec40c114ec9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "40ac5386-d43f-443c-ac15-186b368728f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "e05b0276-16f8-4876-b37b-711b63d65823" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.103s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:12 user nova-compute[75571]: INFO nova.compute.manager [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Attaching volume d85e3eb6-33c9-4c3f-9931-9d3884bc59ce to /dev/vdb
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "b4000485-c53c-46e7-b585-cec40c114ec9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG os_brick.utils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7edc17-a2af-4fba-9918-417a01b7b21a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db95c0f-14c2-498a-87da-52fa7ddea6f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6559f1b6-0b19-4174-848a-d7feb5b6b125]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab90c9e-b3ea-49d4-a23d-d8a303eacc47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:17:13 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42a0d39-96e9-4546-b87b-23e227734d0e]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG os_brick.utils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Updating existing volume attachment record: 3a0ba009-b633-414f-96b4-087bc84d7419 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:17:13 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Took 1.29 seconds to deallocate network for instance.
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:17:13 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:17:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:14 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Deleted allocations for instance fe726611-331a-495f-a6bd-ced2d1a305b2
Nov 28 20:17:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.920s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.313s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:14 user nova-compute[75571]: INFO nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 28 20:17:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-d37654d9-62f0-49fa-b3a0-9c4b1bb95ec2 req-bd7e29b8-2f8b-49ab-906f-f8c8789be2a3 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Received event network-vif-plugged-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:17:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d37654d9-62f0-49fa-b3a0-9c4b1bb95ec2 req-bd7e29b8-2f8b-49ab-906f-f8c8789be2a3 service nova] Acquiring lock "fe726611-331a-495f-a6bd-ced2d1a305b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d37654d9-62f0-49fa-b3a0-9c4b1bb95ec2 req-bd7e29b8-2f8b-49ab-906f-f8c8789be2a3 service nova] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d37654d9-62f0-49fa-b3a0-9c4b1bb95ec2 req-bd7e29b8-2f8b-49ab-906f-f8c8789be2a3 service nova] Lock "fe726611-331a-495f-a6bd-ced2d1a305b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-d37654d9-62f0-49fa-b3a0-9c4b1bb95ec2 req-bd7e29b8-2f8b-49ab-906f-f8c8789be2a3 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] No waiting events found dispatching network-vif-plugged-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:17:14 user nova-compute[75571]: WARNING nova.compute.manager [req-d37654d9-62f0-49fa-b3a0-9c4b1bb95ec2 req-bd7e29b8-2f8b-49ab-906f-f8c8789be2a3 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Received unexpected event network-vif-plugged-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c for instance with vm_state deleted and task_state None.
Nov 28 20:17:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-d37654d9-62f0-49fa-b3a0-9c4b1bb95ec2 req-bd7e29b8-2f8b-49ab-906f-f8c8789be2a3 service nova] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Received event network-vif-deleted-4ccfe8e6-0fe8-4546-8469-9c0634eaf74c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:17:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "e05b0276-16f8-4876-b37b-711b63d65823" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "e05b0276-16f8-4876-b37b-711b63d65823" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "e05b0276-16f8-4876-b37b-711b63d65823-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "e05b0276-16f8-4876-b37b-711b63d65823-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "e05b0276-16f8-4876-b37b-711b63d65823-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:17 user nova-compute[75571]: INFO nova.compute.manager [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Terminating instance
Nov 28 20:17:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:17:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-3ed22b19-f239-4a47-b243-3e1a60f89e47 req-d7f90ca2-e891-4c71-9110-cbfe3f787d83 service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Received event network-vif-unplugged-3f17c541-af4d-4b2a-97c2-ede6623f7609 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3ed22b19-f239-4a47-b243-3e1a60f89e47 req-d7f90ca2-e891-4c71-9110-cbfe3f787d83 service nova] Acquiring lock "e05b0276-16f8-4876-b37b-711b63d65823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3ed22b19-f239-4a47-b243-3e1a60f89e47 req-d7f90ca2-e891-4c71-9110-cbfe3f787d83 service nova] Lock "e05b0276-16f8-4876-b37b-711b63d65823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3ed22b19-f239-4a47-b243-3e1a60f89e47 req-d7f90ca2-e891-4c71-9110-cbfe3f787d83 service nova] Lock "e05b0276-16f8-4876-b37b-711b63d65823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-3ed22b19-f239-4a47-b243-3e1a60f89e47 req-d7f90ca2-e891-4c71-9110-cbfe3f787d83 service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] No waiting events found dispatching network-vif-unplugged-3f17c541-af4d-4b2a-97c2-ede6623f7609 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-3ed22b19-f239-4a47-b243-3e1a60f89e47 req-d7f90ca2-e891-4c71-9110-cbfe3f787d83 service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Received event network-vif-unplugged-3f17c541-af4d-4b2a-97c2-ede6623f7609 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:17:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Instance destroyed successfully.
Nov 28 20:17:18 user nova-compute[75571]: DEBUG nova.objects.instance [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lazy-loading 'resources' on Instance uuid e05b0276-16f8-4876-b37b-711b63d65823 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:15:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-489468757',display_name='tempest-VolumesActionsTest-instance-489468757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-489468757',id=16,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bed5b9f19e584ca5bd8bf2d75b5ee765',ramdisk_id='',reservation_id='r-zjcbaw0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1803837223',owner_user_name='tempest-VolumesActionsTest-1803837223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:15:36Z,user_data=None,user_id='854e01c9d8d644299bbf6b9a18e00fcd',uuid=e05b0276-16f8-4876-b37b-711b63d65823,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "address": "fa:16:3e:17:b7:60", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f17c541-af", "ovs_interfaceid": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Converting VIF {"id": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "address": "fa:16:3e:17:b7:60", "network": {"id": "00de1a40-1743-4c1d-a032-0ae863c7e009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1270954250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed5b9f19e584ca5bd8bf2d75b5ee765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f17c541-af", "ovs_interfaceid": "3f17c541-af4d-4b2a-97c2-ede6623f7609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:b7:60,bridge_name='br-int',has_traffic_filtering=True,id=3f17c541-af4d-4b2a-97c2-ede6623f7609,network=Network(00de1a40-1743-4c1d-a032-0ae863c7e009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f17c541-af') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG os_vif [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:b7:60,bridge_name='br-int',has_traffic_filtering=True,id=3f17c541-af4d-4b2a-97c2-ede6623f7609,network=Network(00de1a40-1743-4c1d-a032-0ae863c7e009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f17c541-af') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f17c541-af, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90cb8fa7-4dbf-4e47-ab6a-772689eb409d) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:18 user nova-compute[75571]: INFO os_vif [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:b7:60,bridge_name='br-int',has_traffic_filtering=True,id=3f17c541-af4d-4b2a-97c2-ede6623f7609,network=Network(00de1a40-1743-4c1d-a032-0ae863c7e009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f17c541-af')
Nov 28 20:17:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Deleting instance files /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823_del
Nov 28 20:17:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Deletion of /opt/stack/data/nova/instances/e05b0276-16f8-4876-b37b-711b63d65823_del complete
Nov 28 20:17:18 user nova-compute[75571]: INFO nova.compute.manager [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 20:17:18 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: e05b0276-16f8-4876-b37b-711b63d65823] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:17:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:19 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:17:19 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Took 0.48 seconds to deallocate network for instance.
Nov 28 20:17:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-9fa1825a-18f8-4242-b4c7-10ef25ceb2f2 req-07abcfe2-ba75-49ce-aaca-0acf9d20e729 service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Received event network-vif-deleted-3f17c541-af4d-4b2a-97c2-ede6623f7609 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:17:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:19 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:17:19 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:17:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:19 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Deleted allocations for instance e05b0276-16f8-4876-b37b-711b63d65823
Nov 28 20:17:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "e05b0276-16f8-4876-b37b-711b63d65823" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.843s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-9bdcc25e-6531-4cd2-967e-9014f8619868 req-5b595356-0201-4d20-b656-4da10de304bf service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Received event network-vif-plugged-3f17c541-af4d-4b2a-97c2-ede6623f7609 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9bdcc25e-6531-4cd2-967e-9014f8619868 req-5b595356-0201-4d20-b656-4da10de304bf service nova] Acquiring lock "e05b0276-16f8-4876-b37b-711b63d65823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9bdcc25e-6531-4cd2-967e-9014f8619868 req-5b595356-0201-4d20-b656-4da10de304bf service nova] Lock "e05b0276-16f8-4876-b37b-711b63d65823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9bdcc25e-6531-4cd2-967e-9014f8619868 req-5b595356-0201-4d20-b656-4da10de304bf service nova] Lock "e05b0276-16f8-4876-b37b-711b63d65823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-9bdcc25e-6531-4cd2-967e-9014f8619868 req-5b595356-0201-4d20-b656-4da10de304bf service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] No waiting events found dispatching network-vif-plugged-3f17c541-af4d-4b2a-97c2-ede6623f7609 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:17:20 user nova-compute[75571]: WARNING nova.compute.manager [req-9bdcc25e-6531-4cd2-967e-9014f8619868 req-5b595356-0201-4d20-b656-4da10de304bf service nova] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Received unexpected event network-vif-plugged-3f17c541-af4d-4b2a-97c2-ede6623f7609 for instance with vm_state deleted and task_state None.
Nov 28 20:17:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyIDZown', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:17:20 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:17:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:17:20 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:17:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:17:20 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:17:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39f8032-e8ad-44ac-be75-24f104a2cd75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:17:20 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[816506e9-7ba0-48a2-b90f-4a1dbc1e6f2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce] added
Nov 28 20:17:20 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:17:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d922e615-eb0f-4fdd-af03-49a2882bafa5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[099c66bd-335c-48bf-aa69-3952030480fd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SyIDZown {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SyIDZown" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bc1150-60fc-46c9-bd76-eb1d7780c455]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SyIDZown'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2737512-a51d-4fcf-bd0e-581ac44e5a9d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70766ac-6698-4500-b5af-ec63ab48b4b0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6741a012-ff17-4f7d-a29a-8cfb71d1079e (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:17:21 user nova-compute[75571]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6741a012-ff17-4f7d-a29a-8cfb71d1079e (non-flash)
Nov 28 20:17:21 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:17:21 user nova-compute[75571]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6741a012-ff17-4f7d-a29a-8cfb71d1079e (non-flash)
Nov 28 20:17:21 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a0630c-b304-49b1-b463-c21a051ed733]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce, portal: 172.16.0.220,3260]
Nov 28 20:17:21 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce, portal: 172.16.0.220,3260] successful.
Nov 28 20:17:21 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae7e85c-ead5-45b8-847d-7ed5e4ebdb6b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c868aa-5ca1-4145-817d-309c6fea95f6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6741a012-ff17-4f7d-a29a-8cfb71d1079e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:17:21 user nova-compute[75571]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6741a012-ff17-4f7d-a29a-8cfb71d1079e (non-flash)
Nov 28 20:17:21 user nova-compute[75571]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce (non-flash)
Nov 28 20:17:21 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:17:21 user nova-compute[75571]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6741a012-ff17-4f7d-a29a-8cfb71d1079e (non-flash)
Nov 28 20:17:21 user nova-compute[75571]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce (non-flash)
Nov 28 20:17:21 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0798ef-4e9d-4aa1-9deb-e432fe19f144]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:17:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyIDZown', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:17:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:17:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23964376435633331', 'path': '/dev/sdd'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:17:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964376435633331', 'path': '/dev/sdd'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:17:22 user nova-compute[75571]: DEBUG nova.objects.instance [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lazy-loading 'flavor' on Instance uuid f6e9eab9-0445-4dcd-bd67-ef73e102c909 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:17:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:17:22 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:17:22 user nova-compute[75571]:   <source dev="/dev/sdd"/>
Nov 28 20:17:22 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:17:22 user nova-compute[75571]:   <serial>d85e3eb6-33c9-4c3f-9931-9d3884bc59ce</serial>
Nov 28 20:17:22 user nova-compute[75571]: </disk>
Nov 28 20:17:22 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:17:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:17:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] No BDM found with device name hda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:17:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] No VIF found with MAC fa:16:3e:99:11:08, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:17:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.882s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-e9fe5eee-d10b-4eec-8e1e-2b235ec6b262 req-b9493e8e-1515-4e61-a6d9-31caefd02a68 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-changed-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:17:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-e9fe5eee-d10b-4eec-8e1e-2b235ec6b262 req-b9493e8e-1515-4e61-a6d9-31caefd02a68 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Refreshing instance network info cache due to event network-changed-38a389ab-f2f2-413a-85e1-b40415fc156c. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:17:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e9fe5eee-d10b-4eec-8e1e-2b235ec6b262 req-b9493e8e-1515-4e61-a6d9-31caefd02a68 service nova] Acquiring lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:17:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e9fe5eee-d10b-4eec-8e1e-2b235ec6b262 req-b9493e8e-1515-4e61-a6d9-31caefd02a68 service nova] Acquired lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:17:23 user nova-compute[75571]: DEBUG nova.network.neutron [req-e9fe5eee-d10b-4eec-8e1e-2b235ec6b262 req-b9493e8e-1515-4e61-a6d9-31caefd02a68 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Refreshing network info cache for port 38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:17:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:24 user nova-compute[75571]: DEBUG nova.network.neutron [req-e9fe5eee-d10b-4eec-8e1e-2b235ec6b262 req-b9493e8e-1515-4e61-a6d9-31caefd02a68 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updated VIF entry in instance network info cache for port 38a389ab-f2f2-413a-85e1-b40415fc156c. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:17:24 user nova-compute[75571]: DEBUG nova.network.neutron [req-e9fe5eee-d10b-4eec-8e1e-2b235ec6b262 req-b9493e8e-1515-4e61-a6d9-31caefd02a68 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating instance_info_cache with network_info: [{"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:17:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e9fe5eee-d10b-4eec-8e1e-2b235ec6b262 req-b9493e8e-1515-4e61-a6d9-31caefd02a68 service nova] Releasing lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:17:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:24 user nova-compute[75571]: INFO nova.compute.manager [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Detaching volume d85e3eb6-33c9-4c3f-9931-9d3884bc59ce
Nov 28 20:17:24 user nova-compute[75571]: INFO nova.virt.block_device [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Attempting to driver detach volume d85e3eb6-33c9-4c3f-9931-9d3884bc59ce from mountpoint /dev/vdb
Nov 28 20:17:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Attempting to detach device vdb from instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:17:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:17:24 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:17:24 user nova-compute[75571]:   <source dev="/dev/sdd"/>
Nov 28 20:17:24 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:17:24 user nova-compute[75571]:   <serial>d85e3eb6-33c9-4c3f-9931-9d3884bc59ce</serial>
Nov 28 20:17:24 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 20:17:24 user nova-compute[75571]: </disk>
Nov 28 20:17:24 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:17:24 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Successfully detached device vdb from instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 from the persistent domain config.
Nov 28 20:17:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:17:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:17:24 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:17:24 user nova-compute[75571]:   <source dev="/dev/sdd"/>
Nov 28 20:17:24 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:17:24 user nova-compute[75571]:   <serial>d85e3eb6-33c9-4c3f-9931-9d3884bc59ce</serial>
Nov 28 20:17:24 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 20:17:24 user nova-compute[75571]: </disk>
Nov 28 20:17:24 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:17:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:17:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:44 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 is timed out.
Nov 28 20:17:44 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Successfully detached device vdb from instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 from the live domain config.
Nov 28 20:17:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:17:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyIDZown', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:17:44 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:17:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:17:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:17:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[131fe9a2-6a66-4689-8e81-52dc2f6e42a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:17:44 user nova-compute[75571]: No targets found.
Nov 28 20:17:44 user nova-compute[75571]: iSNS:
Nov 28 20:17:44 user nova-compute[75571]: No targets found.
Nov 28 20:17:44 user nova-compute[75571]: STATIC:
Nov 28 20:17:44 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce
Nov 28 20:17:44 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:17:44 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:17:44 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851
Nov 28 20:17:44 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:17:44 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:17:44 user nova-compute[75571]: FIRMWARE:
Nov 28 20:17:44 user nova-compute[75571]: No targets found.
Nov 28 20:17:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:17:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:17:44 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:17:44 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:17:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:17:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eb2eb8-a50c-4a9e-83d6-561ba9f145ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2afdcaa-8ab8-46df-8d8b-d4455ddd0f8f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:17:45 user nova-compute[75571]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce (non-flash)
Nov 28 20:17:45 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:17:45 user nova-compute[75571]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce (non-flash)
Nov 28 20:17:45 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77682f7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce'): ({'sdd'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Removing single pathed devices sdd {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[09530e8f-1671-498b-a617-1b50b753adc1]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde4ff24-31bd-4c43-a307-f8e29f296dc0]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Flushing IO for device /dev/sdd {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[636d9800-0145-488c-81d9-45737db56109]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3734fbf3-0e58-4f43-a0d7-7cef45c445b0]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] SCSI volumes sdd have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68d5b8e-7ac0-4e80-b4f1-1b237a2343d4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c81d97-f535-4bd6-8924-631a63c2db66]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce, portal: 172.16.0.220,3260]
Nov 28 20:17:45 user nova-compute[75571]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce, portal: 172.16.0.220,3260] successful.
Nov 28 20:17:45 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85e3eb6-33c9-4c3f-9931-9d3884bc59ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9ec75c-b5f8-4c08-a50e-38e5c4bca669]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] <== disconnect_volume: return (284ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:17:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:17:46 user nova-compute[75571]: DEBUG nova.objects.instance [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lazy-loading 'flavor' on Instance uuid f6e9eab9-0445-4dcd-bd67-ef73e102c909 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:17:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.745s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "interface-f6e9eab9-0445-4dcd-bd67-ef73e102c909-91f1f715-9419-4a1e-a8d2-c14353edb662" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "interface-f6e9eab9-0445-4dcd-bd67-ef73e102c909-91f1f715-9419-4a1e-a8d2-c14353edb662" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG nova.objects.instance [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lazy-loading 'flavor' on Instance uuid f6e9eab9-0445-4dcd-bd67-ef73e102c909 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-314385621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-314385621',id=15,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJygV2sBwSu97x/mNv3tb+z8vi+uhgqoT2QUgvIa02FX6CxSOX0/P5GPCbQ7xDIoAjiVsAURNLlcT6927/eZSkKqdRK7mwgjh5qS2dEgtINUouxWTKkh2D8D/z/+oLMOWQ==',key_name='tempest-keypair-1640947232',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82eb04f7bcf944c58f07769918fb18ed',ramdisk_id='',reservation_id='r-06w0ycsv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1139944601',owner_user_name='tempest-TaggedAttachmentsTest-1139944601-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3de9c75fa13b4cfdaa348ed6e28e9d97',uuid=f6e9eab9-0445-4dcd-bd67-ef73e102c909,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91f1f715-9419-4a1e-a8d2-c14353edb662", "address": "fa:16:3e:47:1f:83", "network": {"id": "32177d6d-e6ed-4260-8a2e-c3fd0c3fd205", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-373773751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f1f715-94", "ovs_interfaceid": "91f1f715-9419-4a1e-a8d2-c14353edb662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Converting VIF {"id": "91f1f715-9419-4a1e-a8d2-c14353edb662", "address": "fa:16:3e:47:1f:83", "network": {"id": "32177d6d-e6ed-4260-8a2e-c3fd0c3fd205", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-373773751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f1f715-94", "ovs_interfaceid": "91f1f715-9419-4a1e-a8d2-c14353edb662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:83,bridge_name='br-int',has_traffic_filtering=True,id=91f1f715-9419-4a1e-a8d2-c14353edb662,network=Network(32177d6d-e6ed-4260-8a2e-c3fd0c3fd205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f1f715-94') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:1f:83"/><model type="virtio"/><mtu size="1442"/><target dev="tap91f1f715-94"/></interface> {{(pid=75571) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:1f:83"/><model type="virtio"/><mtu size="1442"/><target dev="tap91f1f715-94"/></interface> {{(pid=75571) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Attempting to detach device tap91f1f715-94 from instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] detach device xml: <interface type="ethernet">
Nov 28 20:17:47 user nova-compute[75571]:   <mac address="fa:16:3e:47:1f:83"/>
Nov 28 20:17:47 user nova-compute[75571]:   <model type="virtio"/>
Nov 28 20:17:47 user nova-compute[75571]:   <mtu size="1442"/>
Nov 28 20:17:47 user nova-compute[75571]:   <target dev="tap91f1f715-94"/>
Nov 28 20:17:47 user nova-compute[75571]: </interface>
Nov 28 20:17:47 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:1f:83"/><model type="virtio"/><mtu size="1442"/><target dev="tap91f1f715-94"/></interface> {{(pid=75571) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:47:1f:83"/><model type="virtio"/><mtu size="1442"/><target dev="tap91f1f715-94"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 28 20:17:47 user nova-compute[75571]:   <name>instance-0000000f</name>
Nov 28 20:17:47 user nova-compute[75571]:   <uuid>f6e9eab9-0445-4dcd-bd67-ef73e102c909</uuid>
Nov 28 20:17:47 user nova-compute[75571]:   <metadata>
Nov 28 20:17:47 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:17:47 user nova-compute[75571]:   <nova:package version="0.0.0"/>
Nov 28 20:17:47 user nova-compute[75571]:   <nova:name>tempest-device-tagging-server-314385621</nova:name>
Nov 28 20:17:47 user nova-compute[75571]:   <nova:creationTime>2023-11-28 20:17:11</nova:creationTime>
Nov 28 20:17:47 user nova-compute[75571]:   <nova:flavor name="m1.tiny">
Nov 28 20:17:47 user nova-compute[75571]:     <nova:memory>512</nova:memory>
Nov 28 20:17:47 user nova-compute[75571]:     <nova:disk>1</nova:disk>
Nov 28 20:17:47 user nova-compute[75571]:     <nova:swap>0</nova:swap>
Nov 28 20:17:47 user nova-compute[75571]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:17:47 user nova-compute[75571]:     <nova:vcpus>1</nova:vcpus>
Nov 28 20:17:47 user nova-compute[75571]:   </nova:flavor>
Nov 28 20:17:47 user nova-compute[75571]:   <nova:owner>
Nov 28 20:17:47 user nova-compute[75571]:     <nova:user uuid="3de9c75fa13b4cfdaa348ed6e28e9d97">tempest-TaggedAttachmentsTest-1139944601-project-member</nova:user>
Nov 28 20:17:47 user nova-compute[75571]:     <nova:project uuid="82eb04f7bcf944c58f07769918fb18ed">tempest-TaggedAttachmentsTest-1139944601</nova:project>
Nov 28 20:17:47 user nova-compute[75571]:   </nova:owner>
Nov 28 20:17:47 user nova-compute[75571]:   <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:17:47 user nova-compute[75571]:   <nova:ports>
Nov 28 20:17:47 user nova-compute[75571]:     <nova:port uuid="cce19286-ec4f-4349-94c7-67f6ab63551c">
Nov 28 20:17:47 user nova-compute[75571]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:17:47 user nova-compute[75571]:     </nova:port>
Nov 28 20:17:47 user nova-compute[75571]:     <nova:port uuid="91f1f715-9419-4a1e-a8d2-c14353edb662">
Nov 28 20:17:47 user nova-compute[75571]:       <nova:ip type="fixed" address="10.10.10.174" ipVersion="4"/>
Nov 28 20:17:47 user nova-compute[75571]:     </nova:port>
Nov 28 20:17:47 user nova-compute[75571]:   </nova:ports>
Nov 28 20:17:47 user nova-compute[75571]: </nova:instance>
Nov 28 20:17:47 user nova-compute[75571]:   </metadata>
Nov 28 20:17:47 user nova-compute[75571]:   <memory unit='KiB'>524288</memory>
Nov 28 20:17:47 user nova-compute[75571]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 20:17:47 user nova-compute[75571]:   <vcpu placement='static'>1</vcpu>
Nov 28 20:17:47 user nova-compute[75571]:   <resource>
Nov 28 20:17:47 user nova-compute[75571]:     <partition>/machine</partition>
Nov 28 20:17:47 user nova-compute[75571]:   </resource>
Nov 28 20:17:47 user nova-compute[75571]:   <sysinfo type='smbios'>
Nov 28 20:17:47 user nova-compute[75571]:     <system>
Nov 28 20:17:47 user nova-compute[75571]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 20:17:47 user nova-compute[75571]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 20:17:47 user nova-compute[75571]:       <entry name='version'>0.0.0</entry>
Nov 28 20:17:47 user nova-compute[75571]:       <entry name='serial'>f6e9eab9-0445-4dcd-bd67-ef73e102c909</entry>
Nov 28 20:17:47 user nova-compute[75571]:       <entry name='uuid'>f6e9eab9-0445-4dcd-bd67-ef73e102c909</entry>
Nov 28 20:17:47 user nova-compute[75571]:       <entry name='family'>Virtual Machine</entry>
Nov 28 20:17:47 user nova-compute[75571]:     </system>
Nov 28 20:17:47 user nova-compute[75571]:   </sysinfo>
Nov 28 20:17:47 user nova-compute[75571]:   <os>
Nov 28 20:17:47 user nova-compute[75571]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 20:17:47 user nova-compute[75571]:     <boot dev='hd'/>
Nov 28 20:17:47 user nova-compute[75571]:     <smbios mode='sysinfo'/>
Nov 28 20:17:47 user nova-compute[75571]:   </os>
Nov 28 20:17:47 user nova-compute[75571]:   <features>
Nov 28 20:17:47 user nova-compute[75571]:     <acpi/>
Nov 28 20:17:47 user nova-compute[75571]:     <apic/>
Nov 28 20:17:47 user nova-compute[75571]:     <vmcoreinfo state='on'/>
Nov 28 20:17:47 user nova-compute[75571]:   </features>
Nov 28 20:17:47 user nova-compute[75571]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 20:17:47 user nova-compute[75571]:     <model fallback='forbid'>Nehalem</model>
Nov 28 20:17:47 user nova-compute[75571]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 20:17:47 user nova-compute[75571]:     <feature policy='require' name='vme'/>
Nov 28 20:17:47 user nova-compute[75571]:     <feature policy='require' name='x2apic'/>
Nov 28 20:17:47 user nova-compute[75571]:     <feature policy='require' name='hypervisor'/>
Nov 28 20:17:47 user nova-compute[75571]:   </cpu>
Nov 28 20:17:47 user nova-compute[75571]:   <clock offset='utc'>
Nov 28 20:17:47 user nova-compute[75571]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 20:17:47 user nova-compute[75571]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 20:17:47 user nova-compute[75571]:     <timer name='hpet' present='no'/>
Nov 28 20:17:47 user nova-compute[75571]:   </clock>
Nov 28 20:17:47 user nova-compute[75571]:   <on_poweroff>destroy</on_poweroff>
Nov 28 20:17:47 user nova-compute[75571]:   <on_reboot>restart</on_reboot>
Nov 28 20:17:47 user nova-compute[75571]:   <on_crash>destroy</on_crash>
Nov 28 20:17:47 user nova-compute[75571]:   <devices>
Nov 28 20:17:47 user nova-compute[75571]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 20:17:47 user nova-compute[75571]:     <disk type='file' device='disk'>
Nov 28 20:17:47 user nova-compute[75571]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 20:17:47 user nova-compute[75571]:       <source file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk' index='2'/>
Nov 28 20:17:47 user nova-compute[75571]:       <backingStore type='file' index='3'>
Nov 28 20:17:47 user nova-compute[75571]:         <format type='raw'/>
Nov 28 20:17:47 user nova-compute[75571]:         <source file='/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b'/>
Nov 28 20:17:47 user nova-compute[75571]:         <backingStore/>
Nov 28 20:17:47 user nova-compute[75571]:       </backingStore>
Nov 28 20:17:47 user nova-compute[75571]:       <target dev='vda' bus='virtio'/>
Nov 28 20:17:47 user nova-compute[75571]:       <alias name='virtio-disk0'/>
Nov 28 20:17:47 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 20:17:47 user nova-compute[75571]:     </disk>
Nov 28 20:17:47 user nova-compute[75571]:     <disk type='file' device='cdrom'>
Nov 28 20:17:47 user nova-compute[75571]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 20:17:47 user nova-compute[75571]:       <source file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk.config' index='1'/>
Nov 28 20:17:47 user nova-compute[75571]:       <backingStore/>
Nov 28 20:17:47 user nova-compute[75571]:       <target dev='hda' bus='ide'/>
Nov 28 20:17:47 user nova-compute[75571]:       <readonly/>
Nov 28 20:17:47 user nova-compute[75571]:       <alias name='ide0-0-0'/>
Nov 28 20:17:47 user nova-compute[75571]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 20:17:47 user nova-compute[75571]:     </disk>
Nov 28 20:17:47 user nova-compute[75571]:     <controller type='usb' index='0' model='none'>
Nov 28 20:17:47 user nova-compute[75571]:       <alias name='usb'/>
Nov 28 20:17:47 user nova-compute[75571]:     </controller>
Nov 28 20:17:47 user nova-compute[75571]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 20:17:47 user nova-compute[75571]:       <alias name='pci.0'/>
Nov 28 20:17:47 user nova-compute[75571]:     </controller>
Nov 28 20:17:47 user nova-compute[75571]:     <controller type='ide' index='0'>
Nov 28 20:17:47 user nova-compute[75571]:       <alias name='ide'/>
Nov 28 20:17:47 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 20:17:47 user nova-compute[75571]:     </controller>
Nov 28 20:17:47 user nova-compute[75571]:     <interface type='ethernet'>
Nov 28 20:17:47 user nova-compute[75571]:       <mac address='fa:16:3e:99:11:08'/>
Nov 28 20:17:47 user nova-compute[75571]:       <target dev='tapcce19286-ec'/>
Nov 28 20:17:47 user nova-compute[75571]:       <model type='virtio'/>
Nov 28 20:17:47 user nova-compute[75571]:       <mtu size='1442'/>
Nov 28 20:17:47 user nova-compute[75571]:       <alias name='net0'/>
Nov 28 20:17:47 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 20:17:47 user nova-compute[75571]:     </interface>
Nov 28 20:17:47 user nova-compute[75571]:     <interface type='ethernet'>
Nov 28 20:17:47 user nova-compute[75571]:       <mac address='fa:16:3e:47:1f:83'/>
Nov 28 20:17:47 user nova-compute[75571]:       <target dev='tap91f1f715-94'/>
Nov 28 20:17:47 user nova-compute[75571]:       <model type='virtio'/>
Nov 28 20:17:47 user nova-compute[75571]:       <mtu size='1442'/>
Nov 28 20:17:47 user nova-compute[75571]:       <alias name='net1'/>
Nov 28 20:17:47 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 28 20:17:47 user nova-compute[75571]:     </interface>
Nov 28 20:17:47 user nova-compute[75571]:     <serial type='pty'>
Nov 28 20:17:47 user nova-compute[75571]:       <source path='/dev/pts/5'/>
Nov 28 20:17:47 user nova-compute[75571]:       <log file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/console.log' append='off'/>
Nov 28 20:17:47 user nova-compute[75571]:       <target type='isa-serial' port='0'>
Nov 28 20:17:47 user nova-compute[75571]:         <model name='isa-serial'/>
Nov 28 20:17:47 user nova-compute[75571]:       </target>
Nov 28 20:17:47 user nova-compute[75571]:       <alias name='serial0'/>
Nov 28 20:17:47 user nova-compute[75571]:     </serial>
Nov 28 20:17:47 user nova-compute[75571]:     <console type='pty' tty='/dev/pts/5'>
Nov 28 20:17:47 user nova-compute[75571]:       <source path='/dev/pts/5'/>
Nov 28 20:17:47 user nova-compute[75571]:       <log file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/console.log' append='off'/>
Nov 28 20:17:47 user nova-compute[75571]:       <target type='serial' port='0'/>
Nov 28 20:17:47 user nova-compute[75571]:       <alias name='serial0'/>
Nov 28 20:17:47 user nova-compute[75571]:     </console>
Nov 28 20:17:47 user nova-compute[75571]:     <input type='mouse' bus='ps2'>
Nov 28 20:17:47 user nova-compute[75571]:       <alias name='input0'/>
Nov 28 20:17:47 user nova-compute[75571]:     </input>
Nov 28 20:17:47 user nova-compute[75571]:     <input type='keyboard' bus='ps2'>
Nov 28 20:17:47 user nova-compute[75571]:       <alias name='input1'/>
Nov 28 20:17:47 user nova-compute[75571]:     </input>
Nov 28 20:17:47 user nova-compute[75571]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 28 20:17:47 user nova-compute[75571]:       <listen type='address' address='0.0.0.0'/>
Nov 28 20:17:47 user nova-compute[75571]:     </graphics>
Nov 28 20:17:47 user nova-compute[75571]:     <audio id='1' type='none'/>
Nov 28 20:17:47 user nova-compute[75571]:     <video>
Nov 28 20:17:47 user nova-compute[75571]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 20:17:47 user nova-compute[75571]:       <alias name='video0'/>
Nov 28 20:17:47 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 20:17:47 user nova-compute[75571]:     </video>
Nov 28 20:17:47 user nova-compute[75571]:     <memballoon model='virtio'>
Nov 28 20:17:47 user nova-compute[75571]:       <stats period='10'/>
Nov 28 20:17:47 user nova-compute[75571]:       <alias name='balloon0'/>
Nov 28 20:17:47 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 20:17:47 user nova-compute[75571]:     </memballoon>
Nov 28 20:17:47 user nova-compute[75571]:     <rng model='virtio'>
Nov 28 20:17:47 user nova-compute[75571]:       <backend model='random'>/dev/urandom</backend>
Nov 28 20:17:47 user nova-compute[75571]:       <alias name='rng0'/>
Nov 28 20:17:47 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 20:17:47 user nova-compute[75571]:     </rng>
Nov 28 20:17:47 user nova-compute[75571]:   </devices>
Nov 28 20:17:47 user nova-compute[75571]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 20:17:47 user nova-compute[75571]:     <label>libvirt-f6e9eab9-0445-4dcd-bd67-ef73e102c909</label>
Nov 28 20:17:47 user nova-compute[75571]:     <imagelabel>libvirt-f6e9eab9-0445-4dcd-bd67-ef73e102c909</imagelabel>
Nov 28 20:17:47 user nova-compute[75571]:   </seclabel>
Nov 28 20:17:47 user nova-compute[75571]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 20:17:47 user nova-compute[75571]:     <label>+64055:+108</label>
Nov 28 20:17:47 user nova-compute[75571]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 20:17:47 user nova-compute[75571]:   </seclabel>
Nov 28 20:17:47 user nova-compute[75571]: </domain>
Nov 28 20:17:47 user nova-compute[75571]:  {{(pid=75571) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 20:17:47 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Successfully detached device tap91f1f715-94 from instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 from the persistent domain config.
Nov 28 20:17:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] (1/8): Attempting to detach device tap91f1f715-94 with device alias net1 from instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] detach device xml: <interface type="ethernet">
Nov 28 20:17:47 user nova-compute[75571]:   <mac address="fa:16:3e:47:1f:83"/>
Nov 28 20:17:47 user nova-compute[75571]:   <model type="virtio"/>
Nov 28 20:17:47 user nova-compute[75571]:   <mtu size="1442"/>
Nov 28 20:17:47 user nova-compute[75571]:   <target dev="tap91f1f715-94"/>
Nov 28 20:17:47 user nova-compute[75571]: </interface>
Nov 28 20:17:47 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Start waiting for the detach event from libvirt for device tap91f1f715-94 with device alias net1 for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-f74f3c95-68b7-4e2a-b2d4-da5f0d958f70 req-7d67dff4-fda5-481f-94aa-c040982d048c service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received event network-vif-unplugged-91f1f715-9419-4a1e-a8d2-c14353edb662 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f74f3c95-68b7-4e2a-b2d4-da5f0d958f70 req-7d67dff4-fda5-481f-94aa-c040982d048c service nova] Acquiring lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f74f3c95-68b7-4e2a-b2d4-da5f0d958f70 req-7d67dff4-fda5-481f-94aa-c040982d048c service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f74f3c95-68b7-4e2a-b2d4-da5f0d958f70 req-7d67dff4-fda5-481f-94aa-c040982d048c service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-f74f3c95-68b7-4e2a-b2d4-da5f0d958f70 req-7d67dff4-fda5-481f-94aa-c040982d048c service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] No waiting events found dispatching network-vif-unplugged-91f1f715-9419-4a1e-a8d2-c14353edb662 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:17:47 user nova-compute[75571]: WARNING nova.compute.manager [req-f74f3c95-68b7-4e2a-b2d4-da5f0d958f70 req-7d67dff4-fda5-481f-94aa-c040982d048c service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received unexpected event network-vif-unplugged-91f1f715-9419-4a1e-a8d2-c14353edb662 for instance with vm_state active and task_state None.
Nov 28 20:17:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-df6b63d1-47b1-4c48-aee7-ae87695267b3 req-7ed216c6-6e61-4ea1-8eb3-31aa02924285 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received event network-vif-plugged-91f1f715-9419-4a1e-a8d2-c14353edb662 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:17:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-df6b63d1-47b1-4c48-aee7-ae87695267b3 req-7ed216c6-6e61-4ea1-8eb3-31aa02924285 service nova] Acquiring lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-df6b63d1-47b1-4c48-aee7-ae87695267b3 req-7ed216c6-6e61-4ea1-8eb3-31aa02924285 service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-df6b63d1-47b1-4c48-aee7-ae87695267b3 req-7ed216c6-6e61-4ea1-8eb3-31aa02924285 service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-df6b63d1-47b1-4c48-aee7-ae87695267b3 req-7ed216c6-6e61-4ea1-8eb3-31aa02924285 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] No waiting events found dispatching network-vif-plugged-91f1f715-9419-4a1e-a8d2-c14353edb662 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:17:49 user nova-compute[75571]: WARNING nova.compute.manager [req-df6b63d1-47b1-4c48-aee7-ae87695267b3 req-7ed216c6-6e61-4ea1-8eb3-31aa02924285 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received unexpected event network-vif-plugged-91f1f715-9419-4a1e-a8d2-c14353edb662 for instance with vm_state active and task_state None.
Nov 28 20:17:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:54 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:17:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:17:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:17:56 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:17:57 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:17:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:17:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-a8112c4a-cb42-49df-81a7-97b42f5cc87d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:17:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-a8112c4a-cb42-49df-81a7-97b42f5cc87d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:17:57 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:17:57 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Updating instance_info_cache with network_info: [{"id": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "address": "fa:16:3e:f7:a3:4b", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11217ca7-1c", "ovs_interfaceid": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:17:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-a8112c4a-cb42-49df-81a7-97b42f5cc87d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:17:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:17:57 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:17:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:17:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:17:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:17:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:17:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:17:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:17:59 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:17:59 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:17:59 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:17:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:17:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:17:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:17:59 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:17:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:17:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:17:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:18:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-e03f32d1-3606-4142-bf69-c1d4ffee096b req-007e2cd6-358f-49b3-b333-935e8ea8aa06 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received event network-changed-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-e03f32d1-3606-4142-bf69-c1d4ffee096b req-007e2cd6-358f-49b3-b333-935e8ea8aa06 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Refreshing instance network info cache due to event network-changed-68b6901f-6f94-4e02-af4c-d45b8f67fbea. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e03f32d1-3606-4142-bf69-c1d4ffee096b req-007e2cd6-358f-49b3-b333-935e8ea8aa06 service nova] Acquiring lock "refresh_cache-785632ec-4b56-4fca-82a5-67e3d52de9cb" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e03f32d1-3606-4142-bf69-c1d4ffee096b req-007e2cd6-358f-49b3-b333-935e8ea8aa06 service nova] Acquired lock "refresh_cache-785632ec-4b56-4fca-82a5-67e3d52de9cb" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.network.neutron [req-e03f32d1-3606-4142-bf69-c1d4ffee096b req-007e2cd6-358f-49b3-b333-935e8ea8aa06 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Refreshing network info cache for port 68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:18:03 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:18:03 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=7718MB free_disk=25.273624420166016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance a8112c4a-cb42-49df-81a7-97b42f5cc87d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance b4000485-c53c-46e7-b585-cec40c114ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 40ac5386-d43f-443c-ac15-186b368728f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 785632ec-4b56-4fca-82a5-67e3d52de9cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance fc91159a-f3ce-4674-b9e4-a548d373471b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG nova.network.neutron [req-e03f32d1-3606-4142-bf69-c1d4ffee096b req-007e2cd6-358f-49b3-b333-935e8ea8aa06 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Updated VIF entry in instance network info cache for port 68b6901f-6f94-4e02-af4c-d45b8f67fbea. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG nova.network.neutron [req-e03f32d1-3606-4142-bf69-c1d4ffee096b req-007e2cd6-358f-49b3-b333-935e8ea8aa06 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Updating instance_info_cache with network_info: [{"id": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "address": "fa:16:3e:42:74:e1", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b6901f-6f", "ovs_interfaceid": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e03f32d1-3606-4142-bf69-c1d4ffee096b req-007e2cd6-358f-49b3-b333-935e8ea8aa06 service nova] Releasing lock "refresh_cache-785632ec-4b56-4fca-82a5-67e3d52de9cb" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG nova.objects.instance [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lazy-loading 'flavor' on Instance uuid 785632ec-4b56-4fca-82a5-67e3d52de9cb {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:04 user nova-compute[75571]: INFO nova.compute.manager [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Attaching volume b945a610-a97e-4a4d-8631-3100a3a3101b to /dev/vdb
Nov 28 20:18:04 user nova-compute[75571]: DEBUG os_brick.utils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f6f6d2-55a6-4508-bc81-be52d1190ddc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fd69d8-d9c2-4315-accb-b78f626347f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f737f33b-7a38-4c20-bfe4-ef011d356ff8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[747a111e-3a22-4a69-8e7d-4a41daf54a34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:18:04 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:18:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f3fe04-83d8-4a52-91bb-c673988a2420]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG os_brick.utils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:18:04 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Updating existing volume attachment record: d9dd308b-e60c-47ba-abc1-8660ea6213b1 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:18:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:06 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:18:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:18:06 user nova-compute[75571]: INFO nova.compute.claims [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Claim successful on node user
Nov 28 20:18:07 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:18:07 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Waiting for libvirt event about the detach of device tap91f1f715-94 with device alias net1 from instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 is timed out.
Nov 28 20:18:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:1f:83"/><model type="virtio"/><mtu size="1442"/><target dev="tap91f1f715-94"/></interface> {{(pid=75571) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG nova.network.neutron [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:47:1f:83"/><model type="virtio"/><mtu size="1442"/><target dev="tap91f1f715-94"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 28 20:18:07 user nova-compute[75571]:   <name>instance-0000000f</name>
Nov 28 20:18:07 user nova-compute[75571]:   <uuid>f6e9eab9-0445-4dcd-bd67-ef73e102c909</uuid>
Nov 28 20:18:07 user nova-compute[75571]:   <metadata>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:18:07 user nova-compute[75571]:   <nova:package version="0.0.0"/>
Nov 28 20:18:07 user nova-compute[75571]:   <nova:name>tempest-device-tagging-server-314385621</nova:name>
Nov 28 20:18:07 user nova-compute[75571]:   <nova:creationTime>2023-11-28 20:17:11</nova:creationTime>
Nov 28 20:18:07 user nova-compute[75571]:   <nova:flavor name="m1.tiny">
Nov 28 20:18:07 user nova-compute[75571]:     <nova:memory>512</nova:memory>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:disk>1</nova:disk>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:swap>0</nova:swap>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:vcpus>1</nova:vcpus>
Nov 28 20:18:07 user nova-compute[75571]:   </nova:flavor>
Nov 28 20:18:07 user nova-compute[75571]:   <nova:owner>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:user uuid="3de9c75fa13b4cfdaa348ed6e28e9d97">tempest-TaggedAttachmentsTest-1139944601-project-member</nova:user>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:project uuid="82eb04f7bcf944c58f07769918fb18ed">tempest-TaggedAttachmentsTest-1139944601</nova:project>
Nov 28 20:18:07 user nova-compute[75571]:   </nova:owner>
Nov 28 20:18:07 user nova-compute[75571]:   <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:18:07 user nova-compute[75571]:   <nova:ports>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:port uuid="cce19286-ec4f-4349-94c7-67f6ab63551c">
Nov 28 20:18:07 user nova-compute[75571]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:18:07 user nova-compute[75571]:     </nova:port>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:port uuid="91f1f715-9419-4a1e-a8d2-c14353edb662">
Nov 28 20:18:07 user nova-compute[75571]:       <nova:ip type="fixed" address="10.10.10.174" ipVersion="4"/>
Nov 28 20:18:07 user nova-compute[75571]:     </nova:port>
Nov 28 20:18:07 user nova-compute[75571]:   </nova:ports>
Nov 28 20:18:07 user nova-compute[75571]: </nova:instance>
Nov 28 20:18:07 user nova-compute[75571]:   </metadata>
Nov 28 20:18:07 user nova-compute[75571]:   <memory unit='KiB'>524288</memory>
Nov 28 20:18:07 user nova-compute[75571]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 20:18:07 user nova-compute[75571]:   <vcpu placement='static'>1</vcpu>
Nov 28 20:18:07 user nova-compute[75571]:   <resource>
Nov 28 20:18:07 user nova-compute[75571]:     <partition>/machine</partition>
Nov 28 20:18:07 user nova-compute[75571]:   </resource>
Nov 28 20:18:07 user nova-compute[75571]:   <sysinfo type='smbios'>
Nov 28 20:18:07 user nova-compute[75571]:     <system>
Nov 28 20:18:07 user nova-compute[75571]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 20:18:07 user nova-compute[75571]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 20:18:07 user nova-compute[75571]:       <entry name='version'>0.0.0</entry>
Nov 28 20:18:07 user nova-compute[75571]:       <entry name='serial'>f6e9eab9-0445-4dcd-bd67-ef73e102c909</entry>
Nov 28 20:18:07 user nova-compute[75571]:       <entry name='uuid'>f6e9eab9-0445-4dcd-bd67-ef73e102c909</entry>
Nov 28 20:18:07 user nova-compute[75571]:       <entry name='family'>Virtual Machine</entry>
Nov 28 20:18:07 user nova-compute[75571]:     </system>
Nov 28 20:18:07 user nova-compute[75571]:   </sysinfo>
Nov 28 20:18:07 user nova-compute[75571]:   <os>
Nov 28 20:18:07 user nova-compute[75571]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 20:18:07 user nova-compute[75571]:     <boot dev='hd'/>
Nov 28 20:18:07 user nova-compute[75571]:     <smbios mode='sysinfo'/>
Nov 28 20:18:07 user nova-compute[75571]:   </os>
Nov 28 20:18:07 user nova-compute[75571]:   <features>
Nov 28 20:18:07 user nova-compute[75571]:     <acpi/>
Nov 28 20:18:07 user nova-compute[75571]:     <apic/>
Nov 28 20:18:07 user nova-compute[75571]:     <vmcoreinfo state='on'/>
Nov 28 20:18:07 user nova-compute[75571]:   </features>
Nov 28 20:18:07 user nova-compute[75571]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 20:18:07 user nova-compute[75571]:     <model fallback='forbid'>Nehalem</model>
Nov 28 20:18:07 user nova-compute[75571]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 20:18:07 user nova-compute[75571]:     <feature policy='require' name='vme'/>
Nov 28 20:18:07 user nova-compute[75571]:     <feature policy='require' name='x2apic'/>
Nov 28 20:18:07 user nova-compute[75571]:     <feature policy='require' name='hypervisor'/>
Nov 28 20:18:07 user nova-compute[75571]:   </cpu>
Nov 28 20:18:07 user nova-compute[75571]:   <clock offset='utc'>
Nov 28 20:18:07 user nova-compute[75571]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 20:18:07 user nova-compute[75571]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 20:18:07 user nova-compute[75571]:     <timer name='hpet' present='no'/>
Nov 28 20:18:07 user nova-compute[75571]:   </clock>
Nov 28 20:18:07 user nova-compute[75571]:   <on_poweroff>destroy</on_poweroff>
Nov 28 20:18:07 user nova-compute[75571]:   <on_reboot>restart</on_reboot>
Nov 28 20:18:07 user nova-compute[75571]:   <on_crash>destroy</on_crash>
Nov 28 20:18:07 user nova-compute[75571]:   <devices>
Nov 28 20:18:07 user nova-compute[75571]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 20:18:07 user nova-compute[75571]:     <disk type='file' device='disk'>
Nov 28 20:18:07 user nova-compute[75571]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 20:18:07 user nova-compute[75571]:       <source file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk' index='2'/>
Nov 28 20:18:07 user nova-compute[75571]:       <backingStore type='file' index='3'>
Nov 28 20:18:07 user nova-compute[75571]:         <format type='raw'/>
Nov 28 20:18:07 user nova-compute[75571]:         <source file='/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b'/>
Nov 28 20:18:07 user nova-compute[75571]:         <backingStore/>
Nov 28 20:18:07 user nova-compute[75571]:       </backingStore>
Nov 28 20:18:07 user nova-compute[75571]:       <target dev='vda' bus='virtio'/>
Nov 28 20:18:07 user nova-compute[75571]:       <alias name='virtio-disk0'/>
Nov 28 20:18:07 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 20:18:07 user nova-compute[75571]:     </disk>
Nov 28 20:18:07 user nova-compute[75571]:     <disk type='file' device='cdrom'>
Nov 28 20:18:07 user nova-compute[75571]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 20:18:07 user nova-compute[75571]:       <source file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk.config' index='1'/>
Nov 28 20:18:07 user nova-compute[75571]:       <backingStore/>
Nov 28 20:18:07 user nova-compute[75571]:       <target dev='hda' bus='ide'/>
Nov 28 20:18:07 user nova-compute[75571]:       <readonly/>
Nov 28 20:18:07 user nova-compute[75571]:       <alias name='ide0-0-0'/>
Nov 28 20:18:07 user nova-compute[75571]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 20:18:07 user nova-compute[75571]:     </disk>
Nov 28 20:18:07 user nova-compute[75571]:     <controller type='usb' index='0' model='none'>
Nov 28 20:18:07 user nova-compute[75571]:       <alias name='usb'/>
Nov 28 20:18:07 user nova-compute[75571]:     </controller>
Nov 28 20:18:07 user nova-compute[75571]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 20:18:07 user nova-compute[75571]:       <alias name='pci.0'/>
Nov 28 20:18:07 user nova-compute[75571]:     </controller>
Nov 28 20:18:07 user nova-compute[75571]:     <controller type='ide' index='0'>
Nov 28 20:18:07 user nova-compute[75571]:       <alias name='ide'/>
Nov 28 20:18:07 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 20:18:07 user nova-compute[75571]:     </controller>
Nov 28 20:18:07 user nova-compute[75571]:     <interface type='ethernet'>
Nov 28 20:18:07 user nova-compute[75571]:       <mac address='fa:16:3e:99:11:08'/>
Nov 28 20:18:07 user nova-compute[75571]:       <target dev='tapcce19286-ec'/>
Nov 28 20:18:07 user nova-compute[75571]:       <model type='virtio'/>
Nov 28 20:18:07 user nova-compute[75571]:       <mtu size='1442'/>
Nov 28 20:18:07 user nova-compute[75571]:       <alias name='net0'/>
Nov 28 20:18:07 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 20:18:07 user nova-compute[75571]:     </interface>
Nov 28 20:18:07 user nova-compute[75571]:     <serial type='pty'>
Nov 28 20:18:07 user nova-compute[75571]:       <source path='/dev/pts/5'/>
Nov 28 20:18:07 user nova-compute[75571]:       <log file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/console.log' append='off'/>
Nov 28 20:18:07 user nova-compute[75571]:       <target type='isa-serial' port='0'>
Nov 28 20:18:07 user nova-compute[75571]:         <model name='isa-serial'/>
Nov 28 20:18:07 user nova-compute[75571]:       </target>
Nov 28 20:18:07 user nova-compute[75571]:       <alias name='serial0'/>
Nov 28 20:18:07 user nova-compute[75571]:     </serial>
Nov 28 20:18:07 user nova-compute[75571]:     <console type='pty' tty='/dev/pts/5'>
Nov 28 20:18:07 user nova-compute[75571]:       <source path='/dev/pts/5'/>
Nov 28 20:18:07 user nova-compute[75571]:       <log file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/console.log' append='off'/>
Nov 28 20:18:07 user nova-compute[75571]:       <target type='serial' port='0'/>
Nov 28 20:18:07 user nova-compute[75571]:       <alias name='serial0'/>
Nov 28 20:18:07 user nova-compute[75571]:     </console>
Nov 28 20:18:07 user nova-compute[75571]:     <input type='mouse' bus='ps2'>
Nov 28 20:18:07 user nova-compute[75571]:       <alias name='input0'/>
Nov 28 20:18:07 user nova-compute[75571]:     </input>
Nov 28 20:18:07 user nova-compute[75571]:     <input type='keyboard' bus='ps2'>
Nov 28 20:18:07 user nova-compute[75571]:       <alias name='input1'/>
Nov 28 20:18:07 user nova-compute[75571]:     </input>
Nov 28 20:18:07 user nova-compute[75571]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 28 20:18:07 user nova-compute[75571]:       <listen type='address' address='0.0.0.0'/>
Nov 28 20:18:07 user nova-compute[75571]:     </graphics>
Nov 28 20:18:07 user nova-compute[75571]:     <audio id='1' type='none'/>
Nov 28 20:18:07 user nova-compute[75571]:     <video>
Nov 28 20:18:07 user nova-compute[75571]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 20:18:07 user nova-compute[75571]:       <alias name='video0'/>
Nov 28 20:18:07 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 20:18:07 user nova-compute[75571]:     </video>
Nov 28 20:18:07 user nova-compute[75571]:     <memballoon model='virtio'>
Nov 28 20:18:07 user nova-compute[75571]:       <stats period='10'/>
Nov 28 20:18:07 user nova-compute[75571]:       <alias name='balloon0'/>
Nov 28 20:18:07 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 20:18:07 user nova-compute[75571]:     </memballoon>
Nov 28 20:18:07 user nova-compute[75571]:     <rng model='virtio'>
Nov 28 20:18:07 user nova-compute[75571]:       <backend model='random'>/dev/urandom</backend>
Nov 28 20:18:07 user nova-compute[75571]:       <alias name='rng0'/>
Nov 28 20:18:07 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 20:18:07 user nova-compute[75571]:     </rng>
Nov 28 20:18:07 user nova-compute[75571]:   </devices>
Nov 28 20:18:07 user nova-compute[75571]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 20:18:07 user nova-compute[75571]:     <label>libvirt-f6e9eab9-0445-4dcd-bd67-ef73e102c909</label>
Nov 28 20:18:07 user nova-compute[75571]:     <imagelabel>libvirt-f6e9eab9-0445-4dcd-bd67-ef73e102c909</imagelabel>
Nov 28 20:18:07 user nova-compute[75571]:   </seclabel>
Nov 28 20:18:07 user nova-compute[75571]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 20:18:07 user nova-compute[75571]:     <label>+64055:+108</label>
Nov 28 20:18:07 user nova-compute[75571]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 20:18:07 user nova-compute[75571]:   </seclabel>
Nov 28 20:18:07 user nova-compute[75571]: </domain>
Nov 28 20:18:07 user nova-compute[75571]:  {{(pid=75571) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 20:18:07 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Successfully detached device tap91f1f715-94 from instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 from the live domain config.
Nov 28 20:18:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-314385621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-314385621',id=15,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJygV2sBwSu97x/mNv3tb+z8vi+uhgqoT2QUgvIa02FX6CxSOX0/P5GPCbQ7xDIoAjiVsAURNLlcT6927/eZSkKqdRK7mwgjh5qS2dEgtINUouxWTKkh2D8D/z/+oLMOWQ==',key_name='tempest-keypair-1640947232',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82eb04f7bcf944c58f07769918fb18ed',ramdisk_id='',reservation_id='r-06w0ycsv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1139944601',owner_user_name='tempest-TaggedAttachmentsTest-1139944601-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3de9c75fa13b4cfdaa348ed6e28e9d97',uuid=f6e9eab9-0445-4dcd-bd67-ef73e102c909,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91f1f715-9419-4a1e-a8d2-c14353edb662", "address": "fa:16:3e:47:1f:83", "network": {"id": "32177d6d-e6ed-4260-8a2e-c3fd0c3fd205", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-373773751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f1f715-94", "ovs_interfaceid": "91f1f715-9419-4a1e-a8d2-c14353edb662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Converting VIF {"id": "91f1f715-9419-4a1e-a8d2-c14353edb662", "address": "fa:16:3e:47:1f:83", "network": {"id": "32177d6d-e6ed-4260-8a2e-c3fd0c3fd205", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-373773751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f1f715-94", "ovs_interfaceid": "91f1f715-9419-4a1e-a8d2-c14353edb662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:83,bridge_name='br-int',has_traffic_filtering=True,id=91f1f715-9419-4a1e-a8d2-c14353edb662,network=Network(32177d6d-e6ed-4260-8a2e-c3fd0c3fd205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f1f715-94') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG os_vif [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:83,bridge_name='br-int',has_traffic_filtering=True,id=91f1f715-9419-4a1e-a8d2-c14353edb662,network=Network(32177d6d-e6ed-4260-8a2e-c3fd0c3fd205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f1f715-94') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:18:07 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:18:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91f1f715-94, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d67f4de-3a66-4c7d-ad69-93a99ad2dcd6) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:18:07 user nova-compute[75571]: INFO os_vif [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:83,bridge_name='br-int',has_traffic_filtering=True,id=91f1f715-9419-4a1e-a8d2-c14353edb662,network=Network(32177d6d-e6ed-4260-8a2e-c3fd0c3fd205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f1f715-94')
Nov 28 20:18:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:18:07 user nova-compute[75571]:   <nova:package version="0.0.0"/>
Nov 28 20:18:07 user nova-compute[75571]:   <nova:name>tempest-device-tagging-server-314385621</nova:name>
Nov 28 20:18:07 user nova-compute[75571]:   <nova:creationTime>2023-11-28 20:18:07</nova:creationTime>
Nov 28 20:18:07 user nova-compute[75571]:   <nova:flavor name="m1.tiny">
Nov 28 20:18:07 user nova-compute[75571]:     <nova:memory>512</nova:memory>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:disk>1</nova:disk>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:swap>0</nova:swap>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:vcpus>1</nova:vcpus>
Nov 28 20:18:07 user nova-compute[75571]:   </nova:flavor>
Nov 28 20:18:07 user nova-compute[75571]:   <nova:owner>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:user uuid="3de9c75fa13b4cfdaa348ed6e28e9d97">tempest-TaggedAttachmentsTest-1139944601-project-member</nova:user>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:project uuid="82eb04f7bcf944c58f07769918fb18ed">tempest-TaggedAttachmentsTest-1139944601</nova:project>
Nov 28 20:18:07 user nova-compute[75571]:   </nova:owner>
Nov 28 20:18:07 user nova-compute[75571]:   <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:18:07 user nova-compute[75571]:   <nova:ports>
Nov 28 20:18:07 user nova-compute[75571]:     <nova:port uuid="cce19286-ec4f-4349-94c7-67f6ab63551c">
Nov 28 20:18:07 user nova-compute[75571]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:18:07 user nova-compute[75571]:     </nova:port>
Nov 28 20:18:07 user nova-compute[75571]:   </nova:ports>
Nov 28 20:18:07 user nova-compute[75571]: </nova:instance>
Nov 28 20:18:07 user nova-compute[75571]:  {{(pid=75571) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG nova.policy [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4045806241134f5580140b5049e33228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7077abda0e884a0883f39e48e56af27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:18:07 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Creating image(s)
Nov 28 20:18:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "/opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "/opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "/opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.213s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk 1073741824" returned: 0 in 0.055s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.network.neutron [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Successfully created port: 1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.230s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received event network-vif-deleted-91f1f715-9419-4a1e-a8d2-c14353edb662 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:18:08 user nova-compute[75571]: INFO nova.compute.manager [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Neutron deleted interface 91f1f715-9419-4a1e-a8d2-c14353edb662; detaching it from the instance and deleting it from the info cache
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.network.neutron [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Updating instance_info_cache with network_info: [{"id": "cce19286-ec4f-4349-94c7-67f6ab63551c", "address": "fa:16:3e:99:11:08", "network": {"id": "268f60cb-1235-41c9-88d5-7b68c1de2795", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-595792232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce19286-ec", "ovs_interfaceid": "cce19286-ec4f-4349-94c7-67f6ab63551c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquired lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.network.neutron [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.objects.instance [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] Lazy-loading 'system_metadata' on Instance uuid f6e9eab9-0445-4dcd-bd67-ef73e102c909 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.objects.instance [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] Lazy-loading 'flavor' on Instance uuid f6e9eab9-0445-4dcd-bd67-ef73e102c909 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Cannot resize image /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Ensure instance console log exists: /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.objects.base [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] Object Instance<f6e9eab9-0445-4dcd-bd67-ef73e102c909> lazy-loaded attributes: system_metadata,flavor {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-314385621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-314385621',id=15,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJygV2sBwSu97x/mNv3tb+z8vi+uhgqoT2QUgvIa02FX6CxSOX0/P5GPCbQ7xDIoAjiVsAURNLlcT6927/eZSkKqdRK7mwgjh5qS2dEgtINUouxWTKkh2D8D/z/+oLMOWQ==',key_name='tempest-keypair-1640947232',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82eb04f7bcf944c58f07769918fb18ed',ramdisk_id='',reservation_id='r-06w0ycsv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1139944601',owner_user_name='tempest-TaggedAttachmentsTest-1139944601-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3de9c75fa13b4cfdaa348ed6e28e9d97',uuid=f6e9eab9-0445-4dcd-bd67-ef73e102c909,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91f1f715-9419-4a1e-a8d2-c14353edb662", "address": "fa:16:3e:47:1f:83", "network": {"id": "32177d6d-e6ed-4260-8a2e-c3fd0c3fd205", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-373773751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f1f715-94", "ovs_interfaceid": "91f1f715-9419-4a1e-a8d2-c14353edb662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.network.os_vif_util [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] Converting VIF {"id": "91f1f715-9419-4a1e-a8d2-c14353edb662", "address": "fa:16:3e:47:1f:83", "network": {"id": "32177d6d-e6ed-4260-8a2e-c3fd0c3fd205", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-373773751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f1f715-94", "ovs_interfaceid": "91f1f715-9419-4a1e-a8d2-c14353edb662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.network.os_vif_util [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:83,bridge_name='br-int',has_traffic_filtering=True,id=91f1f715-9419-4a1e-a8d2-c14353edb662,network=Network(32177d6d-e6ed-4260-8a2e-c3fd0c3fd205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f1f715-94') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:1f:83"/><model type="virtio"/><mtu size="1442"/><target dev="tap91f1f715-94"/></interface> {{(pid=75571) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:47:1f:83"/><model type="virtio"/><mtu size="1442"/><target dev="tap91f1f715-94"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 28 20:18:08 user nova-compute[75571]:   <name>instance-0000000f</name>
Nov 28 20:18:08 user nova-compute[75571]:   <uuid>f6e9eab9-0445-4dcd-bd67-ef73e102c909</uuid>
Nov 28 20:18:08 user nova-compute[75571]:   <metadata>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:18:08 user nova-compute[75571]:   <nova:package version="0.0.0"/>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:name>tempest-device-tagging-server-314385621</nova:name>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:creationTime>2023-11-28 20:18:07</nova:creationTime>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:flavor name="m1.tiny">
Nov 28 20:18:08 user nova-compute[75571]:     <nova:memory>512</nova:memory>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:disk>1</nova:disk>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:swap>0</nova:swap>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:vcpus>1</nova:vcpus>
Nov 28 20:18:08 user nova-compute[75571]:   </nova:flavor>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:owner>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:user uuid="3de9c75fa13b4cfdaa348ed6e28e9d97">tempest-TaggedAttachmentsTest-1139944601-project-member</nova:user>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:project uuid="82eb04f7bcf944c58f07769918fb18ed">tempest-TaggedAttachmentsTest-1139944601</nova:project>
Nov 28 20:18:08 user nova-compute[75571]:   </nova:owner>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:ports>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:port uuid="cce19286-ec4f-4349-94c7-67f6ab63551c">
Nov 28 20:18:08 user nova-compute[75571]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:18:08 user nova-compute[75571]:     </nova:port>
Nov 28 20:18:08 user nova-compute[75571]:   </nova:ports>
Nov 28 20:18:08 user nova-compute[75571]: </nova:instance>
Nov 28 20:18:08 user nova-compute[75571]:   </metadata>
Nov 28 20:18:08 user nova-compute[75571]:   <memory unit='KiB'>524288</memory>
Nov 28 20:18:08 user nova-compute[75571]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 20:18:08 user nova-compute[75571]:   <vcpu placement='static'>1</vcpu>
Nov 28 20:18:08 user nova-compute[75571]:   <resource>
Nov 28 20:18:08 user nova-compute[75571]:     <partition>/machine</partition>
Nov 28 20:18:08 user nova-compute[75571]:   </resource>
Nov 28 20:18:08 user nova-compute[75571]:   <sysinfo type='smbios'>
Nov 28 20:18:08 user nova-compute[75571]:     <system>
Nov 28 20:18:08 user nova-compute[75571]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 20:18:08 user nova-compute[75571]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 20:18:08 user nova-compute[75571]:       <entry name='version'>0.0.0</entry>
Nov 28 20:18:08 user nova-compute[75571]:       <entry name='serial'>f6e9eab9-0445-4dcd-bd67-ef73e102c909</entry>
Nov 28 20:18:08 user nova-compute[75571]:       <entry name='uuid'>f6e9eab9-0445-4dcd-bd67-ef73e102c909</entry>
Nov 28 20:18:08 user nova-compute[75571]:       <entry name='family'>Virtual Machine</entry>
Nov 28 20:18:08 user nova-compute[75571]:     </system>
Nov 28 20:18:08 user nova-compute[75571]:   </sysinfo>
Nov 28 20:18:08 user nova-compute[75571]:   <os>
Nov 28 20:18:08 user nova-compute[75571]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 20:18:08 user nova-compute[75571]:     <boot dev='hd'/>
Nov 28 20:18:08 user nova-compute[75571]:     <smbios mode='sysinfo'/>
Nov 28 20:18:08 user nova-compute[75571]:   </os>
Nov 28 20:18:08 user nova-compute[75571]:   <features>
Nov 28 20:18:08 user nova-compute[75571]:     <acpi/>
Nov 28 20:18:08 user nova-compute[75571]:     <apic/>
Nov 28 20:18:08 user nova-compute[75571]:     <vmcoreinfo state='on'/>
Nov 28 20:18:08 user nova-compute[75571]:   </features>
Nov 28 20:18:08 user nova-compute[75571]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 20:18:08 user nova-compute[75571]:     <model fallback='forbid'>Nehalem</model>
Nov 28 20:18:08 user nova-compute[75571]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 20:18:08 user nova-compute[75571]:     <feature policy='require' name='vme'/>
Nov 28 20:18:08 user nova-compute[75571]:     <feature policy='require' name='x2apic'/>
Nov 28 20:18:08 user nova-compute[75571]:     <feature policy='require' name='hypervisor'/>
Nov 28 20:18:08 user nova-compute[75571]:   </cpu>
Nov 28 20:18:08 user nova-compute[75571]:   <clock offset='utc'>
Nov 28 20:18:08 user nova-compute[75571]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 20:18:08 user nova-compute[75571]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 20:18:08 user nova-compute[75571]:     <timer name='hpet' present='no'/>
Nov 28 20:18:08 user nova-compute[75571]:   </clock>
Nov 28 20:18:08 user nova-compute[75571]:   <on_poweroff>destroy</on_poweroff>
Nov 28 20:18:08 user nova-compute[75571]:   <on_reboot>restart</on_reboot>
Nov 28 20:18:08 user nova-compute[75571]:   <on_crash>destroy</on_crash>
Nov 28 20:18:08 user nova-compute[75571]:   <devices>
Nov 28 20:18:08 user nova-compute[75571]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 20:18:08 user nova-compute[75571]:     <disk type='file' device='disk'>
Nov 28 20:18:08 user nova-compute[75571]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 20:18:08 user nova-compute[75571]:       <source file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk' index='2'/>
Nov 28 20:18:08 user nova-compute[75571]:       <backingStore type='file' index='3'>
Nov 28 20:18:08 user nova-compute[75571]:         <format type='raw'/>
Nov 28 20:18:08 user nova-compute[75571]:         <source file='/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b'/>
Nov 28 20:18:08 user nova-compute[75571]:         <backingStore/>
Nov 28 20:18:08 user nova-compute[75571]:       </backingStore>
Nov 28 20:18:08 user nova-compute[75571]:       <target dev='vda' bus='virtio'/>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='virtio-disk0'/>
Nov 28 20:18:08 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </disk>
Nov 28 20:18:08 user nova-compute[75571]:     <disk type='file' device='cdrom'>
Nov 28 20:18:08 user nova-compute[75571]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 20:18:08 user nova-compute[75571]:       <source file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk.config' index='1'/>
Nov 28 20:18:08 user nova-compute[75571]:       <backingStore/>
Nov 28 20:18:08 user nova-compute[75571]:       <target dev='hda' bus='ide'/>
Nov 28 20:18:08 user nova-compute[75571]:       <readonly/>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='ide0-0-0'/>
Nov 28 20:18:08 user nova-compute[75571]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </disk>
Nov 28 20:18:08 user nova-compute[75571]:     <controller type='usb' index='0' model='none'>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='usb'/>
Nov 28 20:18:08 user nova-compute[75571]:     </controller>
Nov 28 20:18:08 user nova-compute[75571]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='pci.0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </controller>
Nov 28 20:18:08 user nova-compute[75571]:     <controller type='ide' index='0'>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='ide'/>
Nov 28 20:18:08 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 20:18:08 user nova-compute[75571]:     </controller>
Nov 28 20:18:08 user nova-compute[75571]:     <interface type='ethernet'>
Nov 28 20:18:08 user nova-compute[75571]:       <mac address='fa:16:3e:99:11:08'/>
Nov 28 20:18:08 user nova-compute[75571]:       <target dev='tapcce19286-ec'/>
Nov 28 20:18:08 user nova-compute[75571]:       <model type='virtio'/>
Nov 28 20:18:08 user nova-compute[75571]:       <mtu size='1442'/>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='net0'/>
Nov 28 20:18:08 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </interface>
Nov 28 20:18:08 user nova-compute[75571]:     <serial type='pty'>
Nov 28 20:18:08 user nova-compute[75571]:       <source path='/dev/pts/5'/>
Nov 28 20:18:08 user nova-compute[75571]:       <log file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/console.log' append='off'/>
Nov 28 20:18:08 user nova-compute[75571]:       <target type='isa-serial' port='0'>
Nov 28 20:18:08 user nova-compute[75571]:         <model name='isa-serial'/>
Nov 28 20:18:08 user nova-compute[75571]:       </target>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='serial0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </serial>
Nov 28 20:18:08 user nova-compute[75571]:     <console type='pty' tty='/dev/pts/5'>
Nov 28 20:18:08 user nova-compute[75571]:       <source path='/dev/pts/5'/>
Nov 28 20:18:08 user nova-compute[75571]:       <log file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/console.log' append='off'/>
Nov 28 20:18:08 user nova-compute[75571]:       <target type='serial' port='0'/>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='serial0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </console>
Nov 28 20:18:08 user nova-compute[75571]:     <input type='mouse' bus='ps2'>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='input0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </input>
Nov 28 20:18:08 user nova-compute[75571]:     <input type='keyboard' bus='ps2'>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='input1'/>
Nov 28 20:18:08 user nova-compute[75571]:     </input>
Nov 28 20:18:08 user nova-compute[75571]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 28 20:18:08 user nova-compute[75571]:       <listen type='address' address='0.0.0.0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </graphics>
Nov 28 20:18:08 user nova-compute[75571]:     <audio id='1' type='none'/>
Nov 28 20:18:08 user nova-compute[75571]:     <video>
Nov 28 20:18:08 user nova-compute[75571]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='video0'/>
Nov 28 20:18:08 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </video>
Nov 28 20:18:08 user nova-compute[75571]:     <memballoon model='virtio'>
Nov 28 20:18:08 user nova-compute[75571]:       <stats period='10'/>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='balloon0'/>
Nov 28 20:18:08 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </memballoon>
Nov 28 20:18:08 user nova-compute[75571]:     <rng model='virtio'>
Nov 28 20:18:08 user nova-compute[75571]:       <backend model='random'>/dev/urandom</backend>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='rng0'/>
Nov 28 20:18:08 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </rng>
Nov 28 20:18:08 user nova-compute[75571]:   </devices>
Nov 28 20:18:08 user nova-compute[75571]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 20:18:08 user nova-compute[75571]:     <label>libvirt-f6e9eab9-0445-4dcd-bd67-ef73e102c909</label>
Nov 28 20:18:08 user nova-compute[75571]:     <imagelabel>libvirt-f6e9eab9-0445-4dcd-bd67-ef73e102c909</imagelabel>
Nov 28 20:18:08 user nova-compute[75571]:   </seclabel>
Nov 28 20:18:08 user nova-compute[75571]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 20:18:08 user nova-compute[75571]:     <label>+64055:+108</label>
Nov 28 20:18:08 user nova-compute[75571]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 20:18:08 user nova-compute[75571]:   </seclabel>
Nov 28 20:18:08 user nova-compute[75571]: </domain>
Nov 28 20:18:08 user nova-compute[75571]:  {{(pid=75571) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:1f:83"/><model type="virtio"/><mtu size="1442"/><target dev="tap91f1f715-94"/></interface> {{(pid=75571) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:47:1f:83"/><model type="virtio"/><mtu size="1442"/><target dev="tap91f1f715-94"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 28 20:18:08 user nova-compute[75571]:   <name>instance-0000000f</name>
Nov 28 20:18:08 user nova-compute[75571]:   <uuid>f6e9eab9-0445-4dcd-bd67-ef73e102c909</uuid>
Nov 28 20:18:08 user nova-compute[75571]:   <metadata>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:18:08 user nova-compute[75571]:   <nova:package version="0.0.0"/>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:name>tempest-device-tagging-server-314385621</nova:name>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:creationTime>2023-11-28 20:18:07</nova:creationTime>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:flavor name="m1.tiny">
Nov 28 20:18:08 user nova-compute[75571]:     <nova:memory>512</nova:memory>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:disk>1</nova:disk>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:swap>0</nova:swap>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:vcpus>1</nova:vcpus>
Nov 28 20:18:08 user nova-compute[75571]:   </nova:flavor>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:owner>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:user uuid="3de9c75fa13b4cfdaa348ed6e28e9d97">tempest-TaggedAttachmentsTest-1139944601-project-member</nova:user>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:project uuid="82eb04f7bcf944c58f07769918fb18ed">tempest-TaggedAttachmentsTest-1139944601</nova:project>
Nov 28 20:18:08 user nova-compute[75571]:   </nova:owner>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:ports>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:port uuid="cce19286-ec4f-4349-94c7-67f6ab63551c">
Nov 28 20:18:08 user nova-compute[75571]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:18:08 user nova-compute[75571]:     </nova:port>
Nov 28 20:18:08 user nova-compute[75571]:   </nova:ports>
Nov 28 20:18:08 user nova-compute[75571]: </nova:instance>
Nov 28 20:18:08 user nova-compute[75571]:   </metadata>
Nov 28 20:18:08 user nova-compute[75571]:   <memory unit='KiB'>524288</memory>
Nov 28 20:18:08 user nova-compute[75571]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 20:18:08 user nova-compute[75571]:   <vcpu placement='static'>1</vcpu>
Nov 28 20:18:08 user nova-compute[75571]:   <resource>
Nov 28 20:18:08 user nova-compute[75571]:     <partition>/machine</partition>
Nov 28 20:18:08 user nova-compute[75571]:   </resource>
Nov 28 20:18:08 user nova-compute[75571]:   <sysinfo type='smbios'>
Nov 28 20:18:08 user nova-compute[75571]:     <system>
Nov 28 20:18:08 user nova-compute[75571]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 20:18:08 user nova-compute[75571]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 20:18:08 user nova-compute[75571]:       <entry name='version'>0.0.0</entry>
Nov 28 20:18:08 user nova-compute[75571]:       <entry name='serial'>f6e9eab9-0445-4dcd-bd67-ef73e102c909</entry>
Nov 28 20:18:08 user nova-compute[75571]:       <entry name='uuid'>f6e9eab9-0445-4dcd-bd67-ef73e102c909</entry>
Nov 28 20:18:08 user nova-compute[75571]:       <entry name='family'>Virtual Machine</entry>
Nov 28 20:18:08 user nova-compute[75571]:     </system>
Nov 28 20:18:08 user nova-compute[75571]:   </sysinfo>
Nov 28 20:18:08 user nova-compute[75571]:   <os>
Nov 28 20:18:08 user nova-compute[75571]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 20:18:08 user nova-compute[75571]:     <boot dev='hd'/>
Nov 28 20:18:08 user nova-compute[75571]:     <smbios mode='sysinfo'/>
Nov 28 20:18:08 user nova-compute[75571]:   </os>
Nov 28 20:18:08 user nova-compute[75571]:   <features>
Nov 28 20:18:08 user nova-compute[75571]:     <acpi/>
Nov 28 20:18:08 user nova-compute[75571]:     <apic/>
Nov 28 20:18:08 user nova-compute[75571]:     <vmcoreinfo state='on'/>
Nov 28 20:18:08 user nova-compute[75571]:   </features>
Nov 28 20:18:08 user nova-compute[75571]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 20:18:08 user nova-compute[75571]:     <model fallback='forbid'>Nehalem</model>
Nov 28 20:18:08 user nova-compute[75571]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 20:18:08 user nova-compute[75571]:     <feature policy='require' name='vme'/>
Nov 28 20:18:08 user nova-compute[75571]:     <feature policy='require' name='x2apic'/>
Nov 28 20:18:08 user nova-compute[75571]:     <feature policy='require' name='hypervisor'/>
Nov 28 20:18:08 user nova-compute[75571]:   </cpu>
Nov 28 20:18:08 user nova-compute[75571]:   <clock offset='utc'>
Nov 28 20:18:08 user nova-compute[75571]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 20:18:08 user nova-compute[75571]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 20:18:08 user nova-compute[75571]:     <timer name='hpet' present='no'/>
Nov 28 20:18:08 user nova-compute[75571]:   </clock>
Nov 28 20:18:08 user nova-compute[75571]:   <on_poweroff>destroy</on_poweroff>
Nov 28 20:18:08 user nova-compute[75571]:   <on_reboot>restart</on_reboot>
Nov 28 20:18:08 user nova-compute[75571]:   <on_crash>destroy</on_crash>
Nov 28 20:18:08 user nova-compute[75571]:   <devices>
Nov 28 20:18:08 user nova-compute[75571]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 20:18:08 user nova-compute[75571]:     <disk type='file' device='disk'>
Nov 28 20:18:08 user nova-compute[75571]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 20:18:08 user nova-compute[75571]:       <source file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk' index='2'/>
Nov 28 20:18:08 user nova-compute[75571]:       <backingStore type='file' index='3'>
Nov 28 20:18:08 user nova-compute[75571]:         <format type='raw'/>
Nov 28 20:18:08 user nova-compute[75571]:         <source file='/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b'/>
Nov 28 20:18:08 user nova-compute[75571]:         <backingStore/>
Nov 28 20:18:08 user nova-compute[75571]:       </backingStore>
Nov 28 20:18:08 user nova-compute[75571]:       <target dev='vda' bus='virtio'/>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='virtio-disk0'/>
Nov 28 20:18:08 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </disk>
Nov 28 20:18:08 user nova-compute[75571]:     <disk type='file' device='cdrom'>
Nov 28 20:18:08 user nova-compute[75571]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 20:18:08 user nova-compute[75571]:       <source file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/disk.config' index='1'/>
Nov 28 20:18:08 user nova-compute[75571]:       <backingStore/>
Nov 28 20:18:08 user nova-compute[75571]:       <target dev='hda' bus='ide'/>
Nov 28 20:18:08 user nova-compute[75571]:       <readonly/>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='ide0-0-0'/>
Nov 28 20:18:08 user nova-compute[75571]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </disk>
Nov 28 20:18:08 user nova-compute[75571]:     <controller type='usb' index='0' model='none'>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='usb'/>
Nov 28 20:18:08 user nova-compute[75571]:     </controller>
Nov 28 20:18:08 user nova-compute[75571]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='pci.0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </controller>
Nov 28 20:18:08 user nova-compute[75571]:     <controller type='ide' index='0'>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='ide'/>
Nov 28 20:18:08 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 20:18:08 user nova-compute[75571]:     </controller>
Nov 28 20:18:08 user nova-compute[75571]:     <interface type='ethernet'>
Nov 28 20:18:08 user nova-compute[75571]:       <mac address='fa:16:3e:99:11:08'/>
Nov 28 20:18:08 user nova-compute[75571]:       <target dev='tapcce19286-ec'/>
Nov 28 20:18:08 user nova-compute[75571]:       <model type='virtio'/>
Nov 28 20:18:08 user nova-compute[75571]:       <mtu size='1442'/>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='net0'/>
Nov 28 20:18:08 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </interface>
Nov 28 20:18:08 user nova-compute[75571]:     <serial type='pty'>
Nov 28 20:18:08 user nova-compute[75571]:       <source path='/dev/pts/5'/>
Nov 28 20:18:08 user nova-compute[75571]:       <log file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/console.log' append='off'/>
Nov 28 20:18:08 user nova-compute[75571]:       <target type='isa-serial' port='0'>
Nov 28 20:18:08 user nova-compute[75571]:         <model name='isa-serial'/>
Nov 28 20:18:08 user nova-compute[75571]:       </target>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='serial0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </serial>
Nov 28 20:18:08 user nova-compute[75571]:     <console type='pty' tty='/dev/pts/5'>
Nov 28 20:18:08 user nova-compute[75571]:       <source path='/dev/pts/5'/>
Nov 28 20:18:08 user nova-compute[75571]:       <log file='/opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909/console.log' append='off'/>
Nov 28 20:18:08 user nova-compute[75571]:       <target type='serial' port='0'/>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='serial0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </console>
Nov 28 20:18:08 user nova-compute[75571]:     <input type='mouse' bus='ps2'>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='input0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </input>
Nov 28 20:18:08 user nova-compute[75571]:     <input type='keyboard' bus='ps2'>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='input1'/>
Nov 28 20:18:08 user nova-compute[75571]:     </input>
Nov 28 20:18:08 user nova-compute[75571]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 28 20:18:08 user nova-compute[75571]:       <listen type='address' address='0.0.0.0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </graphics>
Nov 28 20:18:08 user nova-compute[75571]:     <audio id='1' type='none'/>
Nov 28 20:18:08 user nova-compute[75571]:     <video>
Nov 28 20:18:08 user nova-compute[75571]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='video0'/>
Nov 28 20:18:08 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </video>
Nov 28 20:18:08 user nova-compute[75571]:     <memballoon model='virtio'>
Nov 28 20:18:08 user nova-compute[75571]:       <stats period='10'/>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='balloon0'/>
Nov 28 20:18:08 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </memballoon>
Nov 28 20:18:08 user nova-compute[75571]:     <rng model='virtio'>
Nov 28 20:18:08 user nova-compute[75571]:       <backend model='random'>/dev/urandom</backend>
Nov 28 20:18:08 user nova-compute[75571]:       <alias name='rng0'/>
Nov 28 20:18:08 user nova-compute[75571]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 20:18:08 user nova-compute[75571]:     </rng>
Nov 28 20:18:08 user nova-compute[75571]:   </devices>
Nov 28 20:18:08 user nova-compute[75571]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 20:18:08 user nova-compute[75571]:     <label>libvirt-f6e9eab9-0445-4dcd-bd67-ef73e102c909</label>
Nov 28 20:18:08 user nova-compute[75571]:     <imagelabel>libvirt-f6e9eab9-0445-4dcd-bd67-ef73e102c909</imagelabel>
Nov 28 20:18:08 user nova-compute[75571]:   </seclabel>
Nov 28 20:18:08 user nova-compute[75571]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 20:18:08 user nova-compute[75571]:     <label>+64055:+108</label>
Nov 28 20:18:08 user nova-compute[75571]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 20:18:08 user nova-compute[75571]:   </seclabel>
Nov 28 20:18:08 user nova-compute[75571]: </domain>
Nov 28 20:18:08 user nova-compute[75571]:  {{(pid=75571) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 20:18:08 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Detaching interface fa:16:3e:47:1f:83 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap91f1f715-94' not found.
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-314385621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-314385621',id=15,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJygV2sBwSu97x/mNv3tb+z8vi+uhgqoT2QUgvIa02FX6CxSOX0/P5GPCbQ7xDIoAjiVsAURNLlcT6927/eZSkKqdRK7mwgjh5qS2dEgtINUouxWTKkh2D8D/z/+oLMOWQ==',key_name='tempest-keypair-1640947232',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82eb04f7bcf944c58f07769918fb18ed',ramdisk_id='',reservation_id='r-06w0ycsv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1139944601',owner_user_name='tempest-TaggedAttachmentsTest-1139944601-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3de9c75fa13b4cfdaa348ed6e28e9d97',uuid=f6e9eab9-0445-4dcd-bd67-ef73e102c909,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91f1f715-9419-4a1e-a8d2-c14353edb662", "address": "fa:16:3e:47:1f:83", "network": {"id": "32177d6d-e6ed-4260-8a2e-c3fd0c3fd205", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-373773751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f1f715-94", "ovs_interfaceid": "91f1f715-9419-4a1e-a8d2-c14353edb662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.network.os_vif_util [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] Converting VIF {"id": "91f1f715-9419-4a1e-a8d2-c14353edb662", "address": "fa:16:3e:47:1f:83", "network": {"id": "32177d6d-e6ed-4260-8a2e-c3fd0c3fd205", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-373773751", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f1f715-94", "ovs_interfaceid": "91f1f715-9419-4a1e-a8d2-c14353edb662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.network.os_vif_util [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:83,bridge_name='br-int',has_traffic_filtering=True,id=91f1f715-9419-4a1e-a8d2-c14353edb662,network=Network(32177d6d-e6ed-4260-8a2e-c3fd0c3fd205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f1f715-94') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG os_vif [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:83,bridge_name='br-int',has_traffic_filtering=True,id=91f1f715-9419-4a1e-a8d2-c14353edb662,network=Network(32177d6d-e6ed-4260-8a2e-c3fd0c3fd205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f1f715-94') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91f1f715-94, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:18:08 user nova-compute[75571]: INFO os_vif [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:1f:83,bridge_name='br-int',has_traffic_filtering=True,id=91f1f715-9419-4a1e-a8d2-c14353edb662,network=Network(32177d6d-e6ed-4260-8a2e-c3fd0c3fd205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f1f715-94')
Nov 28 20:18:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:18:08 user nova-compute[75571]:   <nova:package version="0.0.0"/>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:name>tempest-device-tagging-server-314385621</nova:name>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:creationTime>2023-11-28 20:18:08</nova:creationTime>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:flavor name="m1.tiny">
Nov 28 20:18:08 user nova-compute[75571]:     <nova:memory>512</nova:memory>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:disk>1</nova:disk>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:swap>0</nova:swap>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:vcpus>1</nova:vcpus>
Nov 28 20:18:08 user nova-compute[75571]:   </nova:flavor>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:owner>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:user uuid="3de9c75fa13b4cfdaa348ed6e28e9d97">tempest-TaggedAttachmentsTest-1139944601-project-member</nova:user>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:project uuid="82eb04f7bcf944c58f07769918fb18ed">tempest-TaggedAttachmentsTest-1139944601</nova:project>
Nov 28 20:18:08 user nova-compute[75571]:   </nova:owner>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:18:08 user nova-compute[75571]:   <nova:ports>
Nov 28 20:18:08 user nova-compute[75571]:     <nova:port uuid="cce19286-ec4f-4349-94c7-67f6ab63551c">
Nov 28 20:18:08 user nova-compute[75571]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:18:08 user nova-compute[75571]:     </nova:port>
Nov 28 20:18:08 user nova-compute[75571]:   </nova:ports>
Nov 28 20:18:08 user nova-compute[75571]: </nova:instance>
Nov 28 20:18:08 user nova-compute[75571]:  {{(pid=75571) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 20:18:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.network.neutron [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Successfully updated port: 1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquired lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.network.neutron [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-7ef7aa8e-9382-4f3b-bbc1-9231be861d7b req-79d1498b-1665-427c-9604-7285e7178e3e service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-changed-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-7ef7aa8e-9382-4f3b-bbc1-9231be861d7b req-79d1498b-1665-427c-9604-7285e7178e3e service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Refreshing instance network info cache due to event network-changed-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7ef7aa8e-9382-4f3b-bbc1-9231be861d7b req-79d1498b-1665-427c-9604-7285e7178e3e service nova] Acquiring lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.network.neutron [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.network.neutron [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updating instance_info_cache with network_info: [{"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Releasing lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Instance network_info: |[{"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7ef7aa8e-9382-4f3b-bbc1-9231be861d7b req-79d1498b-1665-427c-9604-7285e7178e3e service nova] Acquired lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.network.neutron [req-7ef7aa8e-9382-4f3b-bbc1-9231be861d7b req-79d1498b-1665-427c-9604-7285e7178e3e service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Refreshing network info cache for port 1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Start _get_guest_xml network_info=[{"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:18:09 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:18:09 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1017855203',display_name='tempest-ServerStableDeviceRescueTest-server-1017855203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1017855203',id=21,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYTiwvlcWoEsangDB2AZ9sHLwb27V6zeNEeQyWpqOj3c4cWFR+pVY0iquLeDfKp7vix8Thyhov7xyHfY/9+bwp0ql4HQc4hqo4O1gIedyQ6vayMqqQvIV8W2owXgQYlrg==',key_name='tempest-keypair-794763884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7077abda0e884a0883f39e48e56af27e',ramdisk_id='',reservation_id='r-t8ozj8s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-45095974',owner_user_name='tempest-ServerStableDeviceRescueTest-45095974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4045806241134f5580140b5049e33228',uuid=1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Converting VIF {"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:63:7a,bridge_name='br-int',has_traffic_filtering=True,id=1fbed4dc-8f66-4490-88f7-a0c4ae19fde9,network=Network(afa47bc5-6f66-41d1-9a82-74060d2f10c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fbed4dc-8f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.objects.instance [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lazy-loading 'pci_devices' on Instance uuid 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:18:09 user nova-compute[75571]:   <uuid>1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc</uuid>
Nov 28 20:18:09 user nova-compute[75571]:   <name>instance-00000015</name>
Nov 28 20:18:09 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:18:09 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:18:09 user nova-compute[75571]:   <metadata>
Nov 28 20:18:09 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:18:09 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:18:09 user nova-compute[75571]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1017855203</nova:name>
Nov 28 20:18:09 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:18:09</nova:creationTime>
Nov 28 20:18:09 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:18:09 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:18:09 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:18:09 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:18:09 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:18:09 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:18:09 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:18:09 user nova-compute[75571]:       <nova:owner>
Nov 28 20:18:09 user nova-compute[75571]:         <nova:user uuid="4045806241134f5580140b5049e33228">tempest-ServerStableDeviceRescueTest-45095974-project-member</nova:user>
Nov 28 20:18:09 user nova-compute[75571]:         <nova:project uuid="7077abda0e884a0883f39e48e56af27e">tempest-ServerStableDeviceRescueTest-45095974</nova:project>
Nov 28 20:18:09 user nova-compute[75571]:       </nova:owner>
Nov 28 20:18:09 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:18:09 user nova-compute[75571]:       <nova:ports>
Nov 28 20:18:09 user nova-compute[75571]:         <nova:port uuid="1fbed4dc-8f66-4490-88f7-a0c4ae19fde9">
Nov 28 20:18:09 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 20:18:09 user nova-compute[75571]:         </nova:port>
Nov 28 20:18:09 user nova-compute[75571]:       </nova:ports>
Nov 28 20:18:09 user nova-compute[75571]:     </nova:instance>
Nov 28 20:18:09 user nova-compute[75571]:   </metadata>
Nov 28 20:18:09 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:18:09 user nova-compute[75571]:     <system>
Nov 28 20:18:09 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:18:09 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:18:09 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:18:09 user nova-compute[75571]:       <entry name="serial">1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc</entry>
Nov 28 20:18:09 user nova-compute[75571]:       <entry name="uuid">1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc</entry>
Nov 28 20:18:09 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:18:09 user nova-compute[75571]:     </system>
Nov 28 20:18:09 user nova-compute[75571]:   </sysinfo>
Nov 28 20:18:09 user nova-compute[75571]:   <os>
Nov 28 20:18:09 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:18:09 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:18:09 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:18:09 user nova-compute[75571]:   </os>
Nov 28 20:18:09 user nova-compute[75571]:   <features>
Nov 28 20:18:09 user nova-compute[75571]:     <acpi/>
Nov 28 20:18:09 user nova-compute[75571]:     <apic/>
Nov 28 20:18:09 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:18:09 user nova-compute[75571]:   </features>
Nov 28 20:18:09 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:18:09 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:18:09 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:18:09 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:18:09 user nova-compute[75571]:   </clock>
Nov 28 20:18:09 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:18:09 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:18:09 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:18:09 user nova-compute[75571]:   </cpu>
Nov 28 20:18:09 user nova-compute[75571]:   <devices>
Nov 28 20:18:09 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:18:09 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:18:09 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk"/>
Nov 28 20:18:09 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:18:09 user nova-compute[75571]:     </disk>
Nov 28 20:18:09 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:18:09 user nova-compute[75571]:       <mac address="fa:16:3e:fc:63:7a"/>
Nov 28 20:18:09 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:18:09 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:18:09 user nova-compute[75571]:       <target dev="tap1fbed4dc-8f"/>
Nov 28 20:18:09 user nova-compute[75571]:     </interface>
Nov 28 20:18:09 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:18:09 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/console.log" append="off"/>
Nov 28 20:18:09 user nova-compute[75571]:     </serial>
Nov 28 20:18:09 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:18:09 user nova-compute[75571]:     <video>
Nov 28 20:18:09 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:18:09 user nova-compute[75571]:     </video>
Nov 28 20:18:09 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:18:09 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:18:09 user nova-compute[75571]:     </rng>
Nov 28 20:18:09 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:18:09 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:18:09 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:18:09 user nova-compute[75571]:     </memballoon>
Nov 28 20:18:09 user nova-compute[75571]:   </devices>
Nov 28 20:18:09 user nova-compute[75571]: </domain>
Nov 28 20:18:09 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1017855203',display_name='tempest-ServerStableDeviceRescueTest-server-1017855203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1017855203',id=21,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYTiwvlcWoEsangDB2AZ9sHLwb27V6zeNEeQyWpqOj3c4cWFR+pVY0iquLeDfKp7vix8Thyhov7xyHfY/9+bwp0ql4HQc4hqo4O1gIedyQ6vayMqqQvIV8W2owXgQYlrg==',key_name='tempest-keypair-794763884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7077abda0e884a0883f39e48e56af27e',ramdisk_id='',reservation_id='r-t8ozj8s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-45095974',owner_user_name='tempest-ServerStableDeviceRescueTest-45095974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4045806241134f5580140b5049e33228',uuid=1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Converting VIF {"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:63:7a,bridge_name='br-int',has_traffic_filtering=True,id=1fbed4dc-8f66-4490-88f7-a0c4ae19fde9,network=Network(afa47bc5-6f66-41d1-9a82-74060d2f10c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fbed4dc-8f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG os_vif [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:63:7a,bridge_name='br-int',has_traffic_filtering=True,id=1fbed4dc-8f66-4490-88f7-a0c4ae19fde9,network=Network(afa47bc5-6f66-41d1-9a82-74060d2f10c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fbed4dc-8f') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5cf00b1-8a9d-5905-acb5-7d2e1daf183a', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fbed4dc-8f, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1fbed4dc-8f, col_values=(('qos', UUID('11275943-eb4c-45f6-b2a4-8a6aac939b08')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1fbed4dc-8f, col_values=(('external_ids', {'iface-id': '1fbed4dc-8f66-4490-88f7-a0c4ae19fde9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:63:7a', 'vm-uuid': '1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.network.neutron [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Updating instance_info_cache with network_info: [{"id": "cce19286-ec4f-4349-94c7-67f6ab63551c", "address": "fa:16:3e:99:11:08", "network": {"id": "268f60cb-1235-41c9-88d5-7b68c1de2795", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-595792232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce19286-ec", "ovs_interfaceid": "cce19286-ec4f-4349-94c7-67f6ab63551c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:09 user nova-compute[75571]: INFO os_vif [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:63:7a,bridge_name='br-int',has_traffic_filtering=True,id=1fbed4dc-8f66-4490-88f7-a0c4ae19fde9,network=Network(afa47bc5-6f66-41d1-9a82-74060d2f10c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fbed4dc-8f')
Nov 28 20:18:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Releasing lock "refresh_cache-f6e9eab9-0445-4dcd-bd67-ef73e102c909" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "interface-f6e9eab9-0445-4dcd-bd67-ef73e102c909-91f1f715-9419-4a1e-a8d2-c14353edb662" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.675s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:18:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] No VIF found with MAC fa:16:3e:fc:63:7a, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:18:10 user nova-compute[75571]: DEBUG nova.network.neutron [req-7ef7aa8e-9382-4f3b-bbc1-9231be861d7b req-79d1498b-1665-427c-9604-7285e7178e3e service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updated VIF entry in instance network info cache for port 1fbed4dc-8f66-4490-88f7-a0c4ae19fde9. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:18:10 user nova-compute[75571]: DEBUG nova.network.neutron [req-7ef7aa8e-9382-4f3b-bbc1-9231be861d7b req-79d1498b-1665-427c-9604-7285e7178e3e service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updating instance_info_cache with network_info: [{"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:18:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7ef7aa8e-9382-4f3b-bbc1-9231be861d7b req-79d1498b-1665-427c-9604-7285e7178e3e service nova] Releasing lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:18:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:11 user nova-compute[75571]: DEBUG nova.compute.manager [req-5ed7ac10-bfb3-448c-9361-f8423c572a15 req-bfbf2536-1e37-47ed-a54d-868e3e30015f service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:18:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5ed7ac10-bfb3-448c-9361-f8423c572a15 req-bfbf2536-1e37-47ed-a54d-868e3e30015f service nova] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5ed7ac10-bfb3-448c-9361-f8423c572a15 req-bfbf2536-1e37-47ed-a54d-868e3e30015f service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5ed7ac10-bfb3-448c-9361-f8423c572a15 req-bfbf2536-1e37-47ed-a54d-868e3e30015f service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:11 user nova-compute[75571]: DEBUG nova.compute.manager [req-5ed7ac10-bfb3-448c-9361-f8423c572a15 req-bfbf2536-1e37-47ed-a54d-868e3e30015f service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] No waiting events found dispatching network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:18:11 user nova-compute[75571]: WARNING nova.compute.manager [req-5ed7ac10-bfb3-448c-9361-f8423c572a15 req-bfbf2536-1e37-47ed-a54d-868e3e30015f service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received unexpected event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance with vm_state building and task_state spawning.
Nov 28 20:18:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'quoEWYZp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:18:12 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:18:12 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:18:12 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[696d04e6-e9e3-4144-a051-37869077800d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:18:12 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8652c297-19fe-438e-bd4f-161a46207a38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b] added
Nov 28 20:18:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b76aff-66f0-483a-9cf0-400bd0dfc2cd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e97b00e-739e-45c5-a267-838e040db219]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v quoEWYZp {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v quoEWYZp" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeafae3-1741-4e8f-9455-838d452e9623]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'quoEWYZp'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[136ac85c-5a4f-42df-bfff-f797097d9352]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee10aa6-4bc3-46ae-8875-f9b4622d768f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:18:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:18:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bbae74-c1e1-46ad-a913-66a15fb93b2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b, portal: 172.16.0.220,3260]
Nov 28 20:18:12 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b, portal: 172.16.0.220,3260] successful.
Nov 28 20:18:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf8b3ba-cb0e-4670-b811-8644f3b0d2a4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[649c99c2-93ca-4a2d-84ce-9ec71a1e10b2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:18:12 user nova-compute[75571]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b (non-flash)
Nov 28 20:18:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:18:12 user nova-compute[75571]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b (non-flash)
Nov 28 20:18:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e2fdad-c878-48f6-bfef-9dbe7fe9a6dc]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'quoEWYZp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:18:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:18:13 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Instance spawned successfully.
Nov 28 20:18:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23234336334643465', 'path': '/dev/sdc'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234336334643465', 'path': '/dev/sdc'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG nova.objects.instance [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lazy-loading 'flavor' on Instance uuid 785632ec-4b56-4fca-82a5-67e3d52de9cb {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:18:13 user nova-compute[75571]: INFO nova.compute.manager [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 28 20:18:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:18:13 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:18:13 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:18:13 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:18:13 user nova-compute[75571]:   <serial>b945a610-a97e-4a4d-8631-3100a3a3101b</serial>
Nov 28 20:18:13 user nova-compute[75571]: </disk>
Nov 28 20:18:13 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:18:13 user nova-compute[75571]: INFO nova.compute.manager [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Took 6.94 seconds to build instance.
Nov 28 20:18:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.076s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG nova.compute.manager [req-e46491e2-0c15-412d-b570-b45095babed2 req-6bffa3eb-9721-4b19-bb53-51a79f535f1f service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e46491e2-0c15-412d-b570-b45095babed2 req-6bffa3eb-9721-4b19-bb53-51a79f535f1f service nova] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e46491e2-0c15-412d-b570-b45095babed2 req-6bffa3eb-9721-4b19-bb53-51a79f535f1f service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e46491e2-0c15-412d-b570-b45095babed2 req-6bffa3eb-9721-4b19-bb53-51a79f535f1f service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:13 user nova-compute[75571]: DEBUG nova.compute.manager [req-e46491e2-0c15-412d-b570-b45095babed2 req-6bffa3eb-9721-4b19-bb53-51a79f535f1f service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] No waiting events found dispatching network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:18:13 user nova-compute[75571]: WARNING nova.compute.manager [req-e46491e2-0c15-412d-b570-b45095babed2 req-6bffa3eb-9721-4b19-bb53-51a79f535f1f service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received unexpected event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance with vm_state active and task_state None.
Nov 28 20:18:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:18:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:18:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] No VIF found with MAC fa:16:3e:42:74:e1, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:18:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.718s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:16 user nova-compute[75571]: INFO nova.compute.manager [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Detaching volume b945a610-a97e-4a4d-8631-3100a3a3101b
Nov 28 20:18:17 user nova-compute[75571]: INFO nova.virt.block_device [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Attempting to driver detach volume b945a610-a97e-4a4d-8631-3100a3a3101b from mountpoint /dev/vdb
Nov 28 20:18:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Attempting to detach device vdb from instance 785632ec-4b56-4fca-82a5-67e3d52de9cb from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:18:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:18:17 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:18:17 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:18:17 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:18:17 user nova-compute[75571]:   <serial>b945a610-a97e-4a4d-8631-3100a3a3101b</serial>
Nov 28 20:18:17 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:18:17 user nova-compute[75571]: </disk>
Nov 28 20:18:17 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:18:17 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Successfully detached device vdb from instance 785632ec-4b56-4fca-82a5-67e3d52de9cb from the persistent domain config.
Nov 28 20:18:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 785632ec-4b56-4fca-82a5-67e3d52de9cb from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:18:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:18:17 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:18:17 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:18:17 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:18:17 user nova-compute[75571]:   <serial>b945a610-a97e-4a4d-8631-3100a3a3101b</serial>
Nov 28 20:18:17 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:18:17 user nova-compute[75571]: </disk>
Nov 28 20:18:17 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:18:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 785632ec-4b56-4fca-82a5-67e3d52de9cb {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:18:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:18:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:18:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:18:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:18:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:27 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:18:27 user nova-compute[75571]: INFO nova.compute.manager [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] instance snapshotting
Nov 28 20:18:27 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Beginning live snapshot process
Nov 28 20:18:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json -f qcow2 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json -f qcow2" returned: 0 in 0.284s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json -f qcow2 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json -f qcow2" returned: 0 in 0.250s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.196s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgk400xgb/938d930a8e274d7fbcb34e3cf45c3871.delta 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgk400xgb/938d930a8e274d7fbcb34e3cf45c3871.delta 1073741824" returned: 0 in 0.076s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:30 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 20:18:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:31 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:18:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] COPY block job progress, current cursor: 20185088 final cursor: 75497472 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:18:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:18:32 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 20:18:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-200cd471-88cd-4643-ac88-8f53ab1ea156 req-d80ea81c-7267-46b7-8b12-256fc96cce29 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Received event network-changed-d190a550-01ac-49d5-a9dc-b62ed711fe32 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:18:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-200cd471-88cd-4643-ac88-8f53ab1ea156 req-d80ea81c-7267-46b7-8b12-256fc96cce29 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Refreshing instance network info cache due to event network-changed-d190a550-01ac-49d5-a9dc-b62ed711fe32. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:18:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-200cd471-88cd-4643-ac88-8f53ab1ea156 req-d80ea81c-7267-46b7-8b12-256fc96cce29 service nova] Acquiring lock "refresh_cache-fc91159a-f3ce-4674-b9e4-a548d373471b" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:18:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-200cd471-88cd-4643-ac88-8f53ab1ea156 req-d80ea81c-7267-46b7-8b12-256fc96cce29 service nova] Acquired lock "refresh_cache-fc91159a-f3ce-4674-b9e4-a548d373471b" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:18:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-200cd471-88cd-4643-ac88-8f53ab1ea156 req-d80ea81c-7267-46b7-8b12-256fc96cce29 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Refreshing network info cache for port d190a550-01ac-49d5-a9dc-b62ed711fe32 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:18:33 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:18:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgk400xgb/938d930a8e274d7fbcb34e3cf45c3871.delta /opt/stack/data/nova/instances/snapshots/tmpgk400xgb/938d930a8e274d7fbcb34e3cf45c3871 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "fc91159a-f3ce-4674-b9e4-a548d373471b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:33 user nova-compute[75571]: DEBUG nova.objects.instance [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lazy-loading 'flavor' on Instance uuid fc91159a-f3ce-4674-b9e4-a548d373471b {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:18:33 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Ignoring supplied device name: /dev/vdb
Nov 28 20:18:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.330s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "fc91159a-f3ce-4674-b9e4-a548d373471b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:34 user nova-compute[75571]: INFO nova.compute.manager [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Attaching volume 3ff37446-5abc-43b6-899c-41739cf0e669 to /dev/vdb
Nov 28 20:18:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgk400xgb/938d930a8e274d7fbcb34e3cf45c3871.delta /opt/stack/data/nova/instances/snapshots/tmpgk400xgb/938d930a8e274d7fbcb34e3cf45c3871" returned: 0 in 0.957s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:34 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Snapshot extracted, beginning image upload
Nov 28 20:18:34 user nova-compute[75571]: DEBUG nova.network.neutron [req-200cd471-88cd-4643-ac88-8f53ab1ea156 req-d80ea81c-7267-46b7-8b12-256fc96cce29 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Updated VIF entry in instance network info cache for port d190a550-01ac-49d5-a9dc-b62ed711fe32. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG nova.network.neutron [req-200cd471-88cd-4643-ac88-8f53ab1ea156 req-d80ea81c-7267-46b7-8b12-256fc96cce29 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Updating instance_info_cache with network_info: [{"id": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "address": "fa:16:3e:db:bb:ee", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd190a550-01", "ovs_interfaceid": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG os_brick.utils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cb6c75-6e5e-4786-932c-f3498417a5d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-200cd471-88cd-4643-ac88-8f53ab1ea156 req-d80ea81c-7267-46b7-8b12-256fc96cce29 service nova] Releasing lock "refresh_cache-fc91159a-f3ce-4674-b9e4-a548d373471b" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a11df80-3692-4679-8f61-568944a48f0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ca7d20-6250-41b1-8d6b-8049f40f06c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[04323b71-f69b-43d2-8d99-66e548df5440]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:18:34 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:18:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4417a4-d393-4252-8367-227ce74c8af4]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG os_brick.utils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Updating existing volume attachment record: 8c373350-1f25-4e7f-a7de-08ba774ace5f {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:18:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:37 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 785632ec-4b56-4fca-82a5-67e3d52de9cb is timed out.
Nov 28 20:18:37 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Successfully detached device vdb from instance 785632ec-4b56-4fca-82a5-67e3d52de9cb from the live domain config.
Nov 28 20:18:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'quoEWYZp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:18:37 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.055s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bbe238-fb47-4ad8-8577-feaf6b51276d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0788a037-44a1-4fdc-a5b7-84b7f5a16dc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:18:37 user nova-compute[75571]: No targets found.
Nov 28 20:18:37 user nova-compute[75571]: iSNS:
Nov 28 20:18:37 user nova-compute[75571]: No targets found.
Nov 28 20:18:37 user nova-compute[75571]: STATIC:
Nov 28 20:18:37 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851
Nov 28 20:18:37 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:18:37 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:18:37 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b
Nov 28 20:18:37 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:18:37 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:18:37 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:0788a037-44a1-4fdc-a5b7-84b7f5a16dc6
Nov 28 20:18:37 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:18:37 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:18:37 user nova-compute[75571]: FIRMWARE:
Nov 28 20:18:37 user nova-compute[75571]: No targets found.
Nov 28 20:18:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:18:37 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:18:37 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cfcbfc-57f1-4a0e-b86e-c6eeff327156]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0788a037-44a1-4fdc-a5b7-84b7f5a16dc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8bcebf-1d8a-4965-9644-7e5af4b0f753]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0788a037-44a1-4fdc-a5b7-84b7f5a16dc6 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:18:37 user nova-compute[75571]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b (non-flash)
Nov 28 20:18:37 user nova-compute[75571]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0788a037-44a1-4fdc-a5b7-84b7f5a16dc6 (non-flash)
Nov 28 20:18:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:18:37 user nova-compute[75571]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b (non-flash)
Nov 28 20:18:37 user nova-compute[75571]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0788a037-44a1-4fdc-a5b7-84b7f5a16dc6 (non-flash)
Nov 28 20:18:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7748737010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b'): ({'sdc'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Removing single pathed devices sdc {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.052s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3aafee0-ab38-4fd5-836d-5d9c4961fdfc]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[323a7ab0-7607-4af0-af67-08ccb26a6d02]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Flushing IO for device /dev/sdc {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f31e9a0-c61d-4d3f-b2fa-38c8489e29af]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b22bac7-2488-4f0a-aa7b-dab384ecde04]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6a70c4-e5de-4f51-bad6-93dc6f01d7e6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:38 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Snapshot image upload complete
Nov 28 20:18:38 user nova-compute[75571]: INFO nova.compute.manager [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Took 10.47 seconds to snapshot the instance on the hypervisor.
Nov 28 20:18:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --logout" returned: 0 in 0.195s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:38 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[195c3f8e-aab9-49ae-bd87-599b698f4980]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b, portal: 172.16.0.220,3260]
Nov 28 20:18:38 user nova-compute[75571]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b, portal: 172.16.0.220,3260] successful.
Nov 28 20:18:38 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945a610-a97e-4a4d-8631-3100a3a3101b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:38 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbfb157-8ab2-4e78-a2c2-c98f0cd0018b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.635s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:18:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] <== disconnect_volume: return (639ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:18:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:18:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:38 user nova-compute[75571]: INFO nova.compute.manager [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Terminating instance
Nov 28 20:18:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:18:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:39 user nova-compute[75571]: DEBUG nova.objects.instance [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lazy-loading 'flavor' on Instance uuid 785632ec-4b56-4fca-82a5-67e3d52de9cb {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:18:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-a7a54322-8df5-4c96-8acb-72c4be1d94ab req-7e3dfafa-9b3c-409c-b041-4dd17586864e service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received event network-vif-unplugged-cce19286-ec4f-4349-94c7-67f6ab63551c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:18:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a7a54322-8df5-4c96-8acb-72c4be1d94ab req-7e3dfafa-9b3c-409c-b041-4dd17586864e service nova] Acquiring lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a7a54322-8df5-4c96-8acb-72c4be1d94ab req-7e3dfafa-9b3c-409c-b041-4dd17586864e service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a7a54322-8df5-4c96-8acb-72c4be1d94ab req-7e3dfafa-9b3c-409c-b041-4dd17586864e service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-a7a54322-8df5-4c96-8acb-72c4be1d94ab req-7e3dfafa-9b3c-409c-b041-4dd17586864e service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] No waiting events found dispatching network-vif-unplugged-cce19286-ec4f-4349-94c7-67f6ab63551c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:18:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-a7a54322-8df5-4c96-8acb-72c4be1d94ab req-7e3dfafa-9b3c-409c-b041-4dd17586864e service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received event network-vif-unplugged-cce19286-ec4f-4349-94c7-67f6ab63551c for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:18:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.086s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:40 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Instance destroyed successfully.
Nov 28 20:18:40 user nova-compute[75571]: DEBUG nova.objects.instance [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lazy-loading 'resources' on Instance uuid f6e9eab9-0445-4dcd-bd67-ef73e102c909 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:18:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T20:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-314385621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-314385621',id=15,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJygV2sBwSu97x/mNv3tb+z8vi+uhgqoT2QUgvIa02FX6CxSOX0/P5GPCbQ7xDIoAjiVsAURNLlcT6927/eZSkKqdRK7mwgjh5qS2dEgtINUouxWTKkh2D8D/z/+oLMOWQ==',key_name='tempest-keypair-1640947232',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82eb04f7bcf944c58f07769918fb18ed',ramdisk_id='',reservation_id='r-06w0ycsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1139944601',owner_user_name='tempest-TaggedAttachmentsTest-1139944601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3de9c75fa13b4cfdaa348ed6e28e9d97',uuid=f6e9eab9-0445-4dcd-bd67-ef73e102c909,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cce19286-ec4f-4349-94c7-67f6ab63551c", "address": "fa:16:3e:99:11:08", "network": {"id": "268f60cb-1235-41c9-88d5-7b68c1de2795", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-595792232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce19286-ec", "ovs_interfaceid": "cce19286-ec4f-4349-94c7-67f6ab63551c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:18:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Converting VIF {"id": "cce19286-ec4f-4349-94c7-67f6ab63551c", "address": "fa:16:3e:99:11:08", "network": {"id": "268f60cb-1235-41c9-88d5-7b68c1de2795", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-595792232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82eb04f7bcf944c58f07769918fb18ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce19286-ec", "ovs_interfaceid": "cce19286-ec4f-4349-94c7-67f6ab63551c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:18:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:11:08,bridge_name='br-int',has_traffic_filtering=True,id=cce19286-ec4f-4349-94c7-67f6ab63551c,network=Network(268f60cb-1235-41c9-88d5-7b68c1de2795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce19286-ec') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:18:40 user nova-compute[75571]: DEBUG os_vif [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:11:08,bridge_name='br-int',has_traffic_filtering=True,id=cce19286-ec4f-4349-94c7-67f6ab63551c,network=Network(268f60cb-1235-41c9-88d5-7b68c1de2795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce19286-ec') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:18:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcce19286-ec, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:18:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:18:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=719aa465-28d0-4062-ad8d-32f1e2f12369) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:18:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:18:40 user nova-compute[75571]: INFO os_vif [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:11:08,bridge_name='br-int',has_traffic_filtering=True,id=cce19286-ec4f-4349-94c7-67f6ab63551c,network=Network(268f60cb-1235-41c9-88d5-7b68c1de2795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce19286-ec')
Nov 28 20:18:40 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Deleting instance files /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909_del
Nov 28 20:18:40 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Deletion of /opt/stack/data/nova/instances/f6e9eab9-0445-4dcd-bd67-ef73e102c909_del complete
Nov 28 20:18:40 user nova-compute[75571]: INFO nova.compute.manager [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Took 2.04 seconds to destroy the instance on the hypervisor.
Nov 28 20:18:40 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:18:40 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:18:40 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:18:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-45e9ffe9-05c1-4fd3-98a4-a6e2c31b6879 req-53066024-6424-4b0f-b681-abb983b7ab73 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received event network-vif-plugged-cce19286-ec4f-4349-94c7-67f6ab63551c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:18:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-45e9ffe9-05c1-4fd3-98a4-a6e2c31b6879 req-53066024-6424-4b0f-b681-abb983b7ab73 service nova] Acquiring lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-45e9ffe9-05c1-4fd3-98a4-a6e2c31b6879 req-53066024-6424-4b0f-b681-abb983b7ab73 service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-45e9ffe9-05c1-4fd3-98a4-a6e2c31b6879 req-53066024-6424-4b0f-b681-abb983b7ab73 service nova] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-45e9ffe9-05c1-4fd3-98a4-a6e2c31b6879 req-53066024-6424-4b0f-b681-abb983b7ab73 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] No waiting events found dispatching network-vif-plugged-cce19286-ec4f-4349-94c7-67f6ab63551c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:18:41 user nova-compute[75571]: WARNING nova.compute.manager [req-45e9ffe9-05c1-4fd3-98a4-a6e2c31b6879 req-53066024-6424-4b0f-b681-abb983b7ab73 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received unexpected event network-vif-plugged-cce19286-ec4f-4349-94c7-67f6ab63551c for instance with vm_state active and task_state deleting.
Nov 28 20:18:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcNAGRJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:18:42 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:18:42 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:18:42 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6366dc3f-4775-4b6c-8bf8-436d982561ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:18:42 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c87aa55-e3dd-44da-b81c-3556161a6878]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669] added
Nov 28 20:18:42 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:42 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Took 1.73 seconds to deallocate network for instance.
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcaf413-1520-4059-b347-5fc146861855]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-f5681f04-2e3e-4978-910a-2bc3752988bd req-5dea14ad-5bdb-4802-9799-83a6ff45f707 service nova] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Received event network-vif-deleted-cce19286-ec4f-4349-94c7-67f6ab63551c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdca2f1a-ecc3-434f-a7fd-12cfb83e5348]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XcNAGRJO {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XcNAGRJO" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10c6e77-8d52-49d3-acaf-9e4bd3a723cb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XcNAGRJO'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3feeb1-d1f7-4fd9-8606-aa040eaaa547]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[16812777-2d8d-46a8-b822-437748454242]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:18:42 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:18:42 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56b708d-3669-4a76-adce-793b281ec508]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669, portal: 172.16.0.220,3260]
Nov 28 20:18:42 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669, portal: 172.16.0.220,3260] successful.
Nov 28 20:18:42 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3265cd-4a26-49b3-aecc-e003e19761fd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3649259d-d544-4648-b812-36388822a7bc]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:18:42 user nova-compute[75571]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 (non-flash)
Nov 28 20:18:42 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:18:42 user nova-compute[75571]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 (non-flash)
Nov 28 20:18:42 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[127d6025-979b-4dee-8654-329781329731]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcNAGRJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:18:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:42 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Deleted allocations for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909
Nov 28 20:18:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "f6e9eab9-0445-4dcd-bd67-ef73e102c909" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.412s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:18:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23034633465343838', 'path': '/dev/sdc'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:18:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034633465343838', 'path': '/dev/sdc'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:18:43 user nova-compute[75571]: DEBUG nova.objects.instance [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lazy-loading 'flavor' on Instance uuid fc91159a-f3ce-4674-b9e4-a548d373471b {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:18:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:18:43 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:18:43 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:18:43 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:18:43 user nova-compute[75571]:   <serial>3ff37446-5abc-43b6-899c-41739cf0e669</serial>
Nov 28 20:18:43 user nova-compute[75571]: </disk>
Nov 28 20:18:43 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:18:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:18:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:18:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] No VIF found with MAC fa:16:3e:db:bb:ee, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:18:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.279s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:48 user nova-compute[75571]: DEBUG nova.compute.manager [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:18:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:18:48 user nova-compute[75571]: INFO nova.compute.claims [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Claim successful on node user
Nov 28 20:18:48 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:18:48 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:18:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:48 user nova-compute[75571]: DEBUG nova.compute.manager [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG nova.network.neutron [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:18:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:18:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG nova.policy [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dcac1e80fd41480b9250746018d93e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b00222407b41f99d3b983afaeb6c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:18:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Creating image(s)
Nov 28 20:18:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "/opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "/opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "/opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.273s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.200s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk 1073741824" returned: 0 in 0.055s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:18:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG nova.network.neutron [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Successfully created port: d90f48df-d39d-4f9e-b484-7cafb58c032d {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Cannot resize image /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Ensure instance console log exists: /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG nova.network.neutron [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Successfully updated port: d90f48df-d39d-4f9e-b484-7cafb58c032d {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "refresh_cache-0061bf04-e594-4e9c-aeb1-5a29bb299749" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquired lock "refresh_cache-0061bf04-e594-4e9c-aeb1-5a29bb299749" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG nova.network.neutron [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG nova.compute.manager [req-5cf2d01a-0c21-4fa2-a295-d647e5b3b8f5 req-b12b91cb-ced8-4c81-a506-8e2422d34cfb service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Received event network-changed-d90f48df-d39d-4f9e-b484-7cafb58c032d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG nova.compute.manager [req-5cf2d01a-0c21-4fa2-a295-d647e5b3b8f5 req-b12b91cb-ced8-4c81-a506-8e2422d34cfb service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Refreshing instance network info cache due to event network-changed-d90f48df-d39d-4f9e-b484-7cafb58c032d. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:18:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5cf2d01a-0c21-4fa2-a295-d647e5b3b8f5 req-b12b91cb-ced8-4c81-a506-8e2422d34cfb service nova] Acquiring lock "refresh_cache-0061bf04-e594-4e9c-aeb1-5a29bb299749" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.network.neutron [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.network.neutron [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Updating instance_info_cache with network_info: [{"id": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "address": "fa:16:3e:08:e7:cd", "network": {"id": "0ea81c46-dc4e-497a-98de-313521fac370", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1733688335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b00222407b41f99d3b983afaeb6c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f48df-d3", "ovs_interfaceid": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Releasing lock "refresh_cache-0061bf04-e594-4e9c-aeb1-5a29bb299749" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Instance network_info: |[{"id": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "address": "fa:16:3e:08:e7:cd", "network": {"id": "0ea81c46-dc4e-497a-98de-313521fac370", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1733688335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b00222407b41f99d3b983afaeb6c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f48df-d3", "ovs_interfaceid": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5cf2d01a-0c21-4fa2-a295-d647e5b3b8f5 req-b12b91cb-ced8-4c81-a506-8e2422d34cfb service nova] Acquired lock "refresh_cache-0061bf04-e594-4e9c-aeb1-5a29bb299749" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.network.neutron [req-5cf2d01a-0c21-4fa2-a295-d647e5b3b8f5 req-b12b91cb-ced8-4c81-a506-8e2422d34cfb service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Refreshing network info cache for port d90f48df-d39d-4f9e-b484-7cafb58c032d {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Start _get_guest_xml network_info=[{"id": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "address": "fa:16:3e:08:e7:cd", "network": {"id": "0ea81c46-dc4e-497a-98de-313521fac370", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1733688335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b00222407b41f99d3b983afaeb6c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f48df-d3", "ovs_interfaceid": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:18:51 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:18:51 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-980991755',display_name='tempest-TestServerVolumeAttachmentScenario-server-980991755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-980991755',id=22,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJ6RJZRcy13eAf7NmGsUkRNJRh5VIZeh8ZBoDKubWzN8NQek5ymgNNtZ9BZ6I9MPo0LHKuylDgwk+TEMe1LEwks8Mm7vn/i95Rvj5pF5RMn2DpzEwA71rc1zhpzQCbWGw==',key_name='tempest-keypair-1886893260',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0b00222407b41f99d3b983afaeb6c5a',ramdisk_id='',reservation_id='r-qiy7tr83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-182534234',owner_user_name='tempest-TestServerVolumeAttachmentScenario-182534234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcac1e80fd41480b9250746018d93e2c',uuid=0061bf04-e594-4e9c-aeb1-5a29bb299749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "address": "fa:16:3e:08:e7:cd", "network": {"id": "0ea81c46-dc4e-497a-98de-313521fac370", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1733688335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b00222407b41f99d3b983afaeb6c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f48df-d3", "ovs_interfaceid": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Converting VIF {"id": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "address": "fa:16:3e:08:e7:cd", "network": {"id": "0ea81c46-dc4e-497a-98de-313521fac370", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1733688335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b00222407b41f99d3b983afaeb6c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f48df-d3", "ovs_interfaceid": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:e7:cd,bridge_name='br-int',has_traffic_filtering=True,id=d90f48df-d39d-4f9e-b484-7cafb58c032d,network=Network(0ea81c46-dc4e-497a-98de-313521fac370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90f48df-d3') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.objects.instance [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lazy-loading 'pci_devices' on Instance uuid 0061bf04-e594-4e9c-aeb1-5a29bb299749 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:18:51 user nova-compute[75571]:   <uuid>0061bf04-e594-4e9c-aeb1-5a29bb299749</uuid>
Nov 28 20:18:51 user nova-compute[75571]:   <name>instance-00000016</name>
Nov 28 20:18:51 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:18:51 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:18:51 user nova-compute[75571]:   <metadata>
Nov 28 20:18:51 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:18:51 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:18:51 user nova-compute[75571]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-980991755</nova:name>
Nov 28 20:18:51 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:18:51</nova:creationTime>
Nov 28 20:18:51 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:18:51 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:18:51 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:18:51 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:18:51 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:18:51 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:18:51 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:18:51 user nova-compute[75571]:       <nova:owner>
Nov 28 20:18:51 user nova-compute[75571]:         <nova:user uuid="dcac1e80fd41480b9250746018d93e2c">tempest-TestServerVolumeAttachmentScenario-182534234-project-member</nova:user>
Nov 28 20:18:51 user nova-compute[75571]:         <nova:project uuid="f0b00222407b41f99d3b983afaeb6c5a">tempest-TestServerVolumeAttachmentScenario-182534234</nova:project>
Nov 28 20:18:51 user nova-compute[75571]:       </nova:owner>
Nov 28 20:18:51 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:18:51 user nova-compute[75571]:       <nova:ports>
Nov 28 20:18:51 user nova-compute[75571]:         <nova:port uuid="d90f48df-d39d-4f9e-b484-7cafb58c032d">
Nov 28 20:18:51 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 20:18:51 user nova-compute[75571]:         </nova:port>
Nov 28 20:18:51 user nova-compute[75571]:       </nova:ports>
Nov 28 20:18:51 user nova-compute[75571]:     </nova:instance>
Nov 28 20:18:51 user nova-compute[75571]:   </metadata>
Nov 28 20:18:51 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:18:51 user nova-compute[75571]:     <system>
Nov 28 20:18:51 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:18:51 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:18:51 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:18:51 user nova-compute[75571]:       <entry name="serial">0061bf04-e594-4e9c-aeb1-5a29bb299749</entry>
Nov 28 20:18:51 user nova-compute[75571]:       <entry name="uuid">0061bf04-e594-4e9c-aeb1-5a29bb299749</entry>
Nov 28 20:18:51 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:18:51 user nova-compute[75571]:     </system>
Nov 28 20:18:51 user nova-compute[75571]:   </sysinfo>
Nov 28 20:18:51 user nova-compute[75571]:   <os>
Nov 28 20:18:51 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:18:51 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:18:51 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:18:51 user nova-compute[75571]:   </os>
Nov 28 20:18:51 user nova-compute[75571]:   <features>
Nov 28 20:18:51 user nova-compute[75571]:     <acpi/>
Nov 28 20:18:51 user nova-compute[75571]:     <apic/>
Nov 28 20:18:51 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:18:51 user nova-compute[75571]:   </features>
Nov 28 20:18:51 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:18:51 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:18:51 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:18:51 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:18:51 user nova-compute[75571]:   </clock>
Nov 28 20:18:51 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:18:51 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:18:51 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:18:51 user nova-compute[75571]:   </cpu>
Nov 28 20:18:51 user nova-compute[75571]:   <devices>
Nov 28 20:18:51 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:18:51 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:18:51 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk"/>
Nov 28 20:18:51 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:18:51 user nova-compute[75571]:     </disk>
Nov 28 20:18:51 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:18:51 user nova-compute[75571]:       <mac address="fa:16:3e:08:e7:cd"/>
Nov 28 20:18:51 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:18:51 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:18:51 user nova-compute[75571]:       <target dev="tapd90f48df-d3"/>
Nov 28 20:18:51 user nova-compute[75571]:     </interface>
Nov 28 20:18:51 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:18:51 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/console.log" append="off"/>
Nov 28 20:18:51 user nova-compute[75571]:     </serial>
Nov 28 20:18:51 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:18:51 user nova-compute[75571]:     <video>
Nov 28 20:18:51 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:18:51 user nova-compute[75571]:     </video>
Nov 28 20:18:51 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:18:51 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:18:51 user nova-compute[75571]:     </rng>
Nov 28 20:18:51 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:18:51 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:18:51 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:18:51 user nova-compute[75571]:     </memballoon>
Nov 28 20:18:51 user nova-compute[75571]:   </devices>
Nov 28 20:18:51 user nova-compute[75571]: </domain>
Nov 28 20:18:51 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-980991755',display_name='tempest-TestServerVolumeAttachmentScenario-server-980991755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-980991755',id=22,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJ6RJZRcy13eAf7NmGsUkRNJRh5VIZeh8ZBoDKubWzN8NQek5ymgNNtZ9BZ6I9MPo0LHKuylDgwk+TEMe1LEwks8Mm7vn/i95Rvj5pF5RMn2DpzEwA71rc1zhpzQCbWGw==',key_name='tempest-keypair-1886893260',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0b00222407b41f99d3b983afaeb6c5a',ramdisk_id='',reservation_id='r-qiy7tr83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-182534234',owner_user_name='tempest-TestServerVolumeAttachmentScenario-182534234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcac1e80fd41480b9250746018d93e2c',uuid=0061bf04-e594-4e9c-aeb1-5a29bb299749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "address": "fa:16:3e:08:e7:cd", "network": {"id": "0ea81c46-dc4e-497a-98de-313521fac370", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1733688335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b00222407b41f99d3b983afaeb6c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f48df-d3", "ovs_interfaceid": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Converting VIF {"id": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "address": "fa:16:3e:08:e7:cd", "network": {"id": "0ea81c46-dc4e-497a-98de-313521fac370", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1733688335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b00222407b41f99d3b983afaeb6c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f48df-d3", "ovs_interfaceid": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:e7:cd,bridge_name='br-int',has_traffic_filtering=True,id=d90f48df-d39d-4f9e-b484-7cafb58c032d,network=Network(0ea81c46-dc4e-497a-98de-313521fac370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90f48df-d3') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG os_vif [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:e7:cd,bridge_name='br-int',has_traffic_filtering=True,id=d90f48df-d39d-4f9e-b484-7cafb58c032d,network=Network(0ea81c46-dc4e-497a-98de-313521fac370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90f48df-d3') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1ca622d-3061-56be-9793-490fa0402d9e', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd90f48df-d3, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd90f48df-d3, col_values=(('qos', UUID('22122f9c-8876-47b8-8a5a-beaa6570fc86')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd90f48df-d3, col_values=(('external_ids', {'iface-id': 'd90f48df-d39d-4f9e-b484-7cafb58c032d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:e7:cd', 'vm-uuid': '0061bf04-e594-4e9c-aeb1-5a29bb299749'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:51 user nova-compute[75571]: INFO os_vif [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:e7:cd,bridge_name='br-int',has_traffic_filtering=True,id=d90f48df-d39d-4f9e-b484-7cafb58c032d,network=Network(0ea81c46-dc4e-497a-98de-313521fac370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90f48df-d3')
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] No VIF found with MAC fa:16:3e:08:e7:cd, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.network.neutron [req-5cf2d01a-0c21-4fa2-a295-d647e5b3b8f5 req-b12b91cb-ced8-4c81-a506-8e2422d34cfb service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Updated VIF entry in instance network info cache for port d90f48df-d39d-4f9e-b484-7cafb58c032d. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG nova.network.neutron [req-5cf2d01a-0c21-4fa2-a295-d647e5b3b8f5 req-b12b91cb-ced8-4c81-a506-8e2422d34cfb service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Updating instance_info_cache with network_info: [{"id": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "address": "fa:16:3e:08:e7:cd", "network": {"id": "0ea81c46-dc4e-497a-98de-313521fac370", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1733688335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b00222407b41f99d3b983afaeb6c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f48df-d3", "ovs_interfaceid": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:18:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5cf2d01a-0c21-4fa2-a295-d647e5b3b8f5 req-b12b91cb-ced8-4c81-a506-8e2422d34cfb service nova] Releasing lock "refresh_cache-0061bf04-e594-4e9c-aeb1-5a29bb299749" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:18:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:53 user nova-compute[75571]: DEBUG nova.compute.manager [req-6ee9c2b8-81c1-4b15-b61a-35ce20c2d539 req-7f324deb-fb2c-4c9f-b76a-92e8477f193b service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Received event network-vif-plugged-d90f48df-d39d-4f9e-b484-7cafb58c032d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:18:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6ee9c2b8-81c1-4b15-b61a-35ce20c2d539 req-7f324deb-fb2c-4c9f-b76a-92e8477f193b service nova] Acquiring lock "0061bf04-e594-4e9c-aeb1-5a29bb299749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6ee9c2b8-81c1-4b15-b61a-35ce20c2d539 req-7f324deb-fb2c-4c9f-b76a-92e8477f193b service nova] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6ee9c2b8-81c1-4b15-b61a-35ce20c2d539 req-7f324deb-fb2c-4c9f-b76a-92e8477f193b service nova] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:53 user nova-compute[75571]: DEBUG nova.compute.manager [req-6ee9c2b8-81c1-4b15-b61a-35ce20c2d539 req-7f324deb-fb2c-4c9f-b76a-92e8477f193b service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] No waiting events found dispatching network-vif-plugged-d90f48df-d39d-4f9e-b484-7cafb58c032d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:18:53 user nova-compute[75571]: WARNING nova.compute.manager [req-6ee9c2b8-81c1-4b15-b61a-35ce20c2d539 req-7f324deb-fb2c-4c9f-b76a-92e8477f193b service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Received unexpected event network-vif-plugged-d90f48df-d39d-4f9e-b484-7cafb58c032d for instance with vm_state building and task_state spawning.
Nov 28 20:18:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-872ce432-3fba-4a3e-b4d6-448ea97b1232 req-3d19c7cf-398e-431f-86aa-e007224936df service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Received event network-vif-plugged-d90f48df-d39d-4f9e-b484-7cafb58c032d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:18:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-872ce432-3fba-4a3e-b4d6-448ea97b1232 req-3d19c7cf-398e-431f-86aa-e007224936df service nova] Acquiring lock "0061bf04-e594-4e9c-aeb1-5a29bb299749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-872ce432-3fba-4a3e-b4d6-448ea97b1232 req-3d19c7cf-398e-431f-86aa-e007224936df service nova] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-872ce432-3fba-4a3e-b4d6-448ea97b1232 req-3d19c7cf-398e-431f-86aa-e007224936df service nova] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-872ce432-3fba-4a3e-b4d6-448ea97b1232 req-3d19c7cf-398e-431f-86aa-e007224936df service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] No waiting events found dispatching network-vif-plugged-d90f48df-d39d-4f9e-b484-7cafb58c032d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:18:55 user nova-compute[75571]: WARNING nova.compute.manager [req-872ce432-3fba-4a3e-b4d6-448ea97b1232 req-3d19c7cf-398e-431f-86aa-e007224936df service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Received unexpected event network-vif-plugged-d90f48df-d39d-4f9e-b484-7cafb58c032d for instance with vm_state building and task_state spawning.
Nov 28 20:18:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:18:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:18:55 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Instance spawned successfully.
Nov 28 20:18:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:18:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:18:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:18:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:18:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:18:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:18:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:18:55 user nova-compute[75571]: INFO nova.compute.manager [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Took 6.29 seconds to spawn the instance on the hypervisor.
Nov 28 20:18:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:18:55 user nova-compute[75571]: INFO nova.compute.manager [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Took 7.16 seconds to build instance.
Nov 28 20:18:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.269s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:18:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "b4000485-c53c-46e7-b585-cec40c114ec9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:18:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "b4000485-c53c-46e7-b585-cec40c114ec9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:18:58 user nova-compute[75571]: INFO nova.compute.manager [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Detaching volume be8885e7-c3ff-4344-ba63-87e0e83cf851
Nov 28 20:18:58 user nova-compute[75571]: INFO nova.virt.block_device [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Attempting to driver detach volume be8885e7-c3ff-4344-ba63-87e0e83cf851 from mountpoint /dev/vdb
Nov 28 20:18:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Attempting to detach device vdb from instance b4000485-c53c-46e7-b585-cec40c114ec9 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:18:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:18:58 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:18:58 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:18:58 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:18:58 user nova-compute[75571]:   <serial>be8885e7-c3ff-4344-ba63-87e0e83cf851</serial>
Nov 28 20:18:58 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 20:18:58 user nova-compute[75571]: </disk>
Nov 28 20:18:58 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:18:58 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Successfully detached device vdb from instance b4000485-c53c-46e7-b585-cec40c114ec9 from the persistent domain config.
Nov 28 20:18:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b4000485-c53c-46e7-b585-cec40c114ec9 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:18:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:18:58 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:18:58 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:18:58 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:18:58 user nova-compute[75571]:   <serial>be8885e7-c3ff-4344-ba63-87e0e83cf851</serial>
Nov 28 20:18:58 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 20:18:58 user nova-compute[75571]: </disk>
Nov 28 20:18:58 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:18:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:18:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b4000485-c53c-46e7-b585-cec40c114ec9 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:19:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:00 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:19:00 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:19:00 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:19:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-b4000485-c53c-46e7-b585-cec40c114ec9" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:19:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-b4000485-c53c-46e7-b585-cec40c114ec9" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:19:00 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Updating instance_info_cache with network_info: [{"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-b4000485-c53c-46e7-b585-cec40c114ec9" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:19:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:05 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:19:05 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:19:05 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=7738MB free_disk=25.200031280517578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:19:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance a8112c4a-cb42-49df-81a7-97b42f5cc87d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance b4000485-c53c-46e7-b585-cec40c114ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 40ac5386-d43f-443c-ac15-186b368728f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 785632ec-4b56-4fca-82a5-67e3d52de9cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance fc91159a-f3ce-4674-b9e4-a548d373471b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "fc91159a-f3ce-4674-b9e4-a548d373471b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:06 user nova-compute[75571]: INFO nova.compute.manager [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Detaching volume 3ff37446-5abc-43b6-899c-41739cf0e669
Nov 28 20:19:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:06 user nova-compute[75571]: INFO nova.virt.block_device [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Attempting to driver detach volume 3ff37446-5abc-43b6-899c-41739cf0e669 from mountpoint /dev/vdb
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Attempting to detach device vdb from instance fc91159a-f3ce-4674-b9e4-a548d373471b from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:19:06 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:19:06 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:19:06 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:19:06 user nova-compute[75571]:   <serial>3ff37446-5abc-43b6-899c-41739cf0e669</serial>
Nov 28 20:19:06 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:19:06 user nova-compute[75571]: </disk>
Nov 28 20:19:06 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:19:06 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Successfully detached device vdb from instance fc91159a-f3ce-4674-b9e4-a548d373471b from the persistent domain config.
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc91159a-f3ce-4674-b9e4-a548d373471b from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:19:06 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:19:06 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:19:06 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:19:06 user nova-compute[75571]:   <serial>3ff37446-5abc-43b6-899c-41739cf0e669</serial>
Nov 28 20:19:06 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:19:06 user nova-compute[75571]: </disk>
Nov 28 20:19:06 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "fc91159a-f3ce-4674-b9e4-a548d373471b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc91159a-f3ce-4674-b9e4-a548d373471b {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-40f05e36-2c55-4b21-bed0-00c08dd7e85c req-c830906c-e3ca-4a77-87d8-9faf3b09f1af service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received event network-changed-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-40f05e36-2c55-4b21-bed0-00c08dd7e85c req-c830906c-e3ca-4a77-87d8-9faf3b09f1af service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Refreshing instance network info cache due to event network-changed-68b6901f-6f94-4e02-af4c-d45b8f67fbea. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-40f05e36-2c55-4b21-bed0-00c08dd7e85c req-c830906c-e3ca-4a77-87d8-9faf3b09f1af service nova] Acquiring lock "refresh_cache-785632ec-4b56-4fca-82a5-67e3d52de9cb" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-40f05e36-2c55-4b21-bed0-00c08dd7e85c req-c830906c-e3ca-4a77-87d8-9faf3b09f1af service nova] Acquired lock "refresh_cache-785632ec-4b56-4fca-82a5-67e3d52de9cb" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG nova.network.neutron [req-40f05e36-2c55-4b21-bed0-00c08dd7e85c req-c830906c-e3ca-4a77-87d8-9faf3b09f1af service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Refreshing network info cache for port 68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:08 user nova-compute[75571]: INFO nova.compute.manager [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Terminating instance
Nov 28 20:19:08 user nova-compute[75571]: DEBUG nova.compute.manager [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG nova.network.neutron [req-40f05e36-2c55-4b21-bed0-00c08dd7e85c req-c830906c-e3ca-4a77-87d8-9faf3b09f1af service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Updated VIF entry in instance network info cache for port 68b6901f-6f94-4e02-af4c-d45b8f67fbea. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG nova.network.neutron [req-40f05e36-2c55-4b21-bed0-00c08dd7e85c req-c830906c-e3ca-4a77-87d8-9faf3b09f1af service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Updating instance_info_cache with network_info: [{"id": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "address": "fa:16:3e:42:74:e1", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b6901f-6f", "ovs_interfaceid": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-40f05e36-2c55-4b21-bed0-00c08dd7e85c req-c830906c-e3ca-4a77-87d8-9faf3b09f1af service nova] Releasing lock "refresh_cache-785632ec-4b56-4fca-82a5-67e3d52de9cb" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:08 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Instance destroyed successfully.
Nov 28 20:19:08 user nova-compute[75571]: DEBUG nova.objects.instance [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lazy-loading 'resources' on Instance uuid 785632ec-4b56-4fca-82a5-67e3d52de9cb {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-246226610',display_name='tempest-TestStampPattern-server-246226610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-246226610',id=18,image_ref='7a729520-30cc-462f-9b0b-638e92e6c4b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKHSIcqSS6r5Xbk8DWkPtgQAYtxPI66k2MpIys7luJ+eXKJCwl3YX7s+WE2XtlqbyhCHYbp1Jbg6h1ZtUXzTkBXgQiD1zygrVkmZ1u0tehRUXvexgqD4sXlJ9Q5zsLuRw==',key_name='tempest-TestStampPattern-550063434',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:16:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='742419219fb94804bef60efd10716a41',ramdisk_id='',reservation_id='r-wp92nl87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a8112c4a-cb42-49df-81a7-97b42f5cc87d',image_min_disk='1',image_min_ram='0',image_owner_id='742419219fb94804bef60efd10716a41',image_owner_project_name='tempest-TestStampPattern-152273837',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-152273837-project-member',image_user_id='29664fb367db470abbd15cfbf39dd38a',owner_project_name='tempest-TestStampPattern-152273837',owner_user_name='tempest-TestStampPattern-152273837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:16:22Z,user_data=None,user_id='29664fb367db470abbd15cfbf39dd38a',uuid=785632ec-4b56-4fca-82a5-67e3d52de9cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "address": "fa:16:3e:42:74:e1", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b6901f-6f", "ovs_interfaceid": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:19:08 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Converting VIF {"id": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "address": "fa:16:3e:42:74:e1", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b6901f-6f", "ovs_interfaceid": "68b6901f-6f94-4e02-af4c-d45b8f67fbea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:74:e1,bridge_name='br-int',has_traffic_filtering=True,id=68b6901f-6f94-4e02-af4c-d45b8f67fbea,network=Network(3f7305f6-e668-4fc6-82bd-f6f519c2bd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b6901f-6f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG os_vif [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:74:e1,bridge_name='br-int',has_traffic_filtering=True,id=68b6901f-6f94-4e02-af4c-d45b8f67fbea,network=Network(3f7305f6-e668-4fc6-82bd-f6f519c2bd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b6901f-6f') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68b6901f-6f, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96d991ec-b9d9-4af6-acb4-bedcd8e08b15) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:19:09 user nova-compute[75571]: INFO os_vif [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:74:e1,bridge_name='br-int',has_traffic_filtering=True,id=68b6901f-6f94-4e02-af4c-d45b8f67fbea,network=Network(3f7305f6-e668-4fc6-82bd-f6f519c2bd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b6901f-6f')
Nov 28 20:19:09 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Deleting instance files /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb_del
Nov 28 20:19:09 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Deletion of /opt/stack/data/nova/instances/785632ec-4b56-4fca-82a5-67e3d52de9cb_del complete
Nov 28 20:19:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:09 user nova-compute[75571]: INFO nova.compute.manager [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 28 20:19:09 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:19:09 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:19:09 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Took 0.80 seconds to deallocate network for instance.
Nov 28 20:19:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-d7d3b77b-46b1-4e19-9fcb-182d7bf0dd50 req-43c59821-b3a2-4cff-b8b2-de1fa6571a6f service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received event network-vif-deleted-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received event network-vif-unplugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Acquiring lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] No waiting events found dispatching network-vif-unplugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:10 user nova-compute[75571]: WARNING nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received unexpected event network-vif-unplugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance with vm_state deleted and task_state None.
Nov 28 20:19:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received event network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Acquiring lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] No waiting events found dispatching network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:10 user nova-compute[75571]: WARNING nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received unexpected event network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance with vm_state deleted and task_state None.
Nov 28 20:19:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received event network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Acquiring lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] No waiting events found dispatching network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:10 user nova-compute[75571]: WARNING nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received unexpected event network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance with vm_state deleted and task_state None.
Nov 28 20:19:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received event network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Acquiring lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] No waiting events found dispatching network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:10 user nova-compute[75571]: WARNING nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received unexpected event network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance with vm_state deleted and task_state None.
Nov 28 20:19:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received event network-vif-unplugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Acquiring lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] No waiting events found dispatching network-vif-unplugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:10 user nova-compute[75571]: WARNING nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received unexpected event network-vif-unplugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance with vm_state deleted and task_state None.
Nov 28 20:19:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received event network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Acquiring lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] No waiting events found dispatching network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:10 user nova-compute[75571]: WARNING nova.compute.manager [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Received unexpected event network-vif-plugged-68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance with vm_state deleted and task_state None.
Nov 28 20:19:10 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:10 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Deleted allocations for instance 785632ec-4b56-4fca-82a5-67e3d52de9cb
Nov 28 20:19:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "785632ec-4b56-4fca-82a5-67e3d52de9cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.338s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:19:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:12 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:19:12 user nova-compute[75571]: INFO nova.compute.claims [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Claim successful on node user
Nov 28 20:19:13 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG nova.network.neutron [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:19:13 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:19:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG nova.policy [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '270de3ab19964431afa20c767af7b23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4056e8f34a4e8da54592d28d7a75a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:19:13 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Creating image(s)
Nov 28 20:19:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "/opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "/opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "/opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.183s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.193s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk 1073741824" returned: 0 in 0.051s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG nova.network.neutron [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Successfully created port: 524df3be-b94b-462e-89c0-57ffa9878bd1 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.208s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Cannot resize image /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Ensure instance console log exists: /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG nova.network.neutron [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Successfully updated port: 524df3be-b94b-462e-89c0-57ffa9878bd1 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "refresh_cache-86c31e96-70cf-45fd-9578-194706af2ad0" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquired lock "refresh_cache-86c31e96-70cf-45fd-9578-194706af2ad0" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG nova.network.neutron [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-6654f517-d4c4-4d1c-b61b-e427e7f34b34 req-6e4202b0-bd04-4dc8-9c18-d4b6054f6508 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Received event network-changed-524df3be-b94b-462e-89c0-57ffa9878bd1 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-6654f517-d4c4-4d1c-b61b-e427e7f34b34 req-6e4202b0-bd04-4dc8-9c18-d4b6054f6508 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Refreshing instance network info cache due to event network-changed-524df3be-b94b-462e-89c0-57ffa9878bd1. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6654f517-d4c4-4d1c-b61b-e427e7f34b34 req-6e4202b0-bd04-4dc8-9c18-d4b6054f6508 service nova] Acquiring lock "refresh_cache-86c31e96-70cf-45fd-9578-194706af2ad0" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:19:14 user nova-compute[75571]: DEBUG nova.network.neutron [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.network.neutron [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Updating instance_info_cache with network_info: [{"id": "524df3be-b94b-462e-89c0-57ffa9878bd1", "address": "fa:16:3e:94:a9:66", "network": {"id": "ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-242564008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee4056e8f34a4e8da54592d28d7a75a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524df3be-b9", "ovs_interfaceid": "524df3be-b94b-462e-89c0-57ffa9878bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Releasing lock "refresh_cache-86c31e96-70cf-45fd-9578-194706af2ad0" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.compute.manager [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Instance network_info: |[{"id": "524df3be-b94b-462e-89c0-57ffa9878bd1", "address": "fa:16:3e:94:a9:66", "network": {"id": "ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-242564008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee4056e8f34a4e8da54592d28d7a75a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524df3be-b9", "ovs_interfaceid": "524df3be-b94b-462e-89c0-57ffa9878bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6654f517-d4c4-4d1c-b61b-e427e7f34b34 req-6e4202b0-bd04-4dc8-9c18-d4b6054f6508 service nova] Acquired lock "refresh_cache-86c31e96-70cf-45fd-9578-194706af2ad0" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.network.neutron [req-6654f517-d4c4-4d1c-b61b-e427e7f34b34 req-6e4202b0-bd04-4dc8-9c18-d4b6054f6508 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Refreshing network info cache for port 524df3be-b94b-462e-89c0-57ffa9878bd1 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Start _get_guest_xml network_info=[{"id": "524df3be-b94b-462e-89c0-57ffa9878bd1", "address": "fa:16:3e:94:a9:66", "network": {"id": "ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-242564008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee4056e8f34a4e8da54592d28d7a75a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524df3be-b9", "ovs_interfaceid": "524df3be-b94b-462e-89c0-57ffa9878bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:19:15 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:19:15 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1119065400',display_name='tempest-SnapshotDataIntegrityTests-server-1119065400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1119065400',id=23,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGh0OvPNUnw0HlK5G584yN+gpnf86YMaudmoj1ZhKVFwAinhV6vAO9CJeiE48YExnyL1P7BzKCVI1GwObgP7Q4v0iy8rjQmkoZJJgf8xiwgR6GgkTRhAfEFVt2LCndxirA==',key_name='tempest-keypair-2062785846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee4056e8f34a4e8da54592d28d7a75a1',ramdisk_id='',reservation_id='r-w57gfsl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1740984498',owner_user_name='tempest-SnapshotDataIntegrityTests-1740984498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270de3ab19964431afa20c767af7b23c',uuid=86c31e96-70cf-45fd-9578-194706af2ad0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "524df3be-b94b-462e-89c0-57ffa9878bd1", "address": "fa:16:3e:94:a9:66", "network": {"id": "ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-242564008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee4056e8f34a4e8da54592d28d7a75a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524df3be-b9", "ovs_interfaceid": "524df3be-b94b-462e-89c0-57ffa9878bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Converting VIF {"id": "524df3be-b94b-462e-89c0-57ffa9878bd1", "address": "fa:16:3e:94:a9:66", "network": {"id": "ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-242564008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee4056e8f34a4e8da54592d28d7a75a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524df3be-b9", "ovs_interfaceid": "524df3be-b94b-462e-89c0-57ffa9878bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:a9:66,bridge_name='br-int',has_traffic_filtering=True,id=524df3be-b94b-462e-89c0-57ffa9878bd1,network=Network(ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524df3be-b9') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.objects.instance [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'pci_devices' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:19:15 user nova-compute[75571]:   <uuid>86c31e96-70cf-45fd-9578-194706af2ad0</uuid>
Nov 28 20:19:15 user nova-compute[75571]:   <name>instance-00000017</name>
Nov 28 20:19:15 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:19:15 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:19:15 user nova-compute[75571]:   <metadata>
Nov 28 20:19:15 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:19:15 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:19:15 user nova-compute[75571]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1119065400</nova:name>
Nov 28 20:19:15 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:19:15</nova:creationTime>
Nov 28 20:19:15 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:19:15 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:19:15 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:19:15 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:19:15 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:19:15 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:19:15 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:19:15 user nova-compute[75571]:       <nova:owner>
Nov 28 20:19:15 user nova-compute[75571]:         <nova:user uuid="270de3ab19964431afa20c767af7b23c">tempest-SnapshotDataIntegrityTests-1740984498-project-member</nova:user>
Nov 28 20:19:15 user nova-compute[75571]:         <nova:project uuid="ee4056e8f34a4e8da54592d28d7a75a1">tempest-SnapshotDataIntegrityTests-1740984498</nova:project>
Nov 28 20:19:15 user nova-compute[75571]:       </nova:owner>
Nov 28 20:19:15 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:19:15 user nova-compute[75571]:       <nova:ports>
Nov 28 20:19:15 user nova-compute[75571]:         <nova:port uuid="524df3be-b94b-462e-89c0-57ffa9878bd1">
Nov 28 20:19:15 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 20:19:15 user nova-compute[75571]:         </nova:port>
Nov 28 20:19:15 user nova-compute[75571]:       </nova:ports>
Nov 28 20:19:15 user nova-compute[75571]:     </nova:instance>
Nov 28 20:19:15 user nova-compute[75571]:   </metadata>
Nov 28 20:19:15 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:19:15 user nova-compute[75571]:     <system>
Nov 28 20:19:15 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:19:15 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:19:15 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:19:15 user nova-compute[75571]:       <entry name="serial">86c31e96-70cf-45fd-9578-194706af2ad0</entry>
Nov 28 20:19:15 user nova-compute[75571]:       <entry name="uuid">86c31e96-70cf-45fd-9578-194706af2ad0</entry>
Nov 28 20:19:15 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:19:15 user nova-compute[75571]:     </system>
Nov 28 20:19:15 user nova-compute[75571]:   </sysinfo>
Nov 28 20:19:15 user nova-compute[75571]:   <os>
Nov 28 20:19:15 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:19:15 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:19:15 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:19:15 user nova-compute[75571]:   </os>
Nov 28 20:19:15 user nova-compute[75571]:   <features>
Nov 28 20:19:15 user nova-compute[75571]:     <acpi/>
Nov 28 20:19:15 user nova-compute[75571]:     <apic/>
Nov 28 20:19:15 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:19:15 user nova-compute[75571]:   </features>
Nov 28 20:19:15 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:19:15 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:19:15 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:19:15 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:19:15 user nova-compute[75571]:   </clock>
Nov 28 20:19:15 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:19:15 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:19:15 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:19:15 user nova-compute[75571]:   </cpu>
Nov 28 20:19:15 user nova-compute[75571]:   <devices>
Nov 28 20:19:15 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:19:15 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:19:15 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk"/>
Nov 28 20:19:15 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:19:15 user nova-compute[75571]:     </disk>
Nov 28 20:19:15 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:19:15 user nova-compute[75571]:       <mac address="fa:16:3e:94:a9:66"/>
Nov 28 20:19:15 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:19:15 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:19:15 user nova-compute[75571]:       <target dev="tap524df3be-b9"/>
Nov 28 20:19:15 user nova-compute[75571]:     </interface>
Nov 28 20:19:15 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:19:15 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/console.log" append="off"/>
Nov 28 20:19:15 user nova-compute[75571]:     </serial>
Nov 28 20:19:15 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:19:15 user nova-compute[75571]:     <video>
Nov 28 20:19:15 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:19:15 user nova-compute[75571]:     </video>
Nov 28 20:19:15 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:19:15 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:19:15 user nova-compute[75571]:     </rng>
Nov 28 20:19:15 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:19:15 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:19:15 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:19:15 user nova-compute[75571]:     </memballoon>
Nov 28 20:19:15 user nova-compute[75571]:   </devices>
Nov 28 20:19:15 user nova-compute[75571]: </domain>
Nov 28 20:19:15 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1119065400',display_name='tempest-SnapshotDataIntegrityTests-server-1119065400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1119065400',id=23,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGh0OvPNUnw0HlK5G584yN+gpnf86YMaudmoj1ZhKVFwAinhV6vAO9CJeiE48YExnyL1P7BzKCVI1GwObgP7Q4v0iy8rjQmkoZJJgf8xiwgR6GgkTRhAfEFVt2LCndxirA==',key_name='tempest-keypair-2062785846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee4056e8f34a4e8da54592d28d7a75a1',ramdisk_id='',reservation_id='r-w57gfsl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1740984498',owner_user_name='tempest-SnapshotDataIntegrityTests-1740984498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270de3ab19964431afa20c767af7b23c',uuid=86c31e96-70cf-45fd-9578-194706af2ad0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "524df3be-b94b-462e-89c0-57ffa9878bd1", "address": "fa:16:3e:94:a9:66", "network": {"id": "ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-242564008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee4056e8f34a4e8da54592d28d7a75a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524df3be-b9", "ovs_interfaceid": "524df3be-b94b-462e-89c0-57ffa9878bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Converting VIF {"id": "524df3be-b94b-462e-89c0-57ffa9878bd1", "address": "fa:16:3e:94:a9:66", "network": {"id": "ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-242564008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee4056e8f34a4e8da54592d28d7a75a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524df3be-b9", "ovs_interfaceid": "524df3be-b94b-462e-89c0-57ffa9878bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:a9:66,bridge_name='br-int',has_traffic_filtering=True,id=524df3be-b94b-462e-89c0-57ffa9878bd1,network=Network(ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524df3be-b9') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG os_vif [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:a9:66,bridge_name='br-int',has_traffic_filtering=True,id=524df3be-b94b-462e-89c0-57ffa9878bd1,network=Network(ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524df3be-b9') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7154a732-f418-5be7-99c3-6fb09cfa7db7', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap524df3be-b9, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap524df3be-b9, col_values=(('qos', UUID('6158981d-ff43-44d4-aadd-ce4b29893698')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap524df3be-b9, col_values=(('external_ids', {'iface-id': '524df3be-b94b-462e-89c0-57ffa9878bd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:a9:66', 'vm-uuid': '86c31e96-70cf-45fd-9578-194706af2ad0'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:15 user nova-compute[75571]: INFO os_vif [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:a9:66,bridge_name='br-int',has_traffic_filtering=True,id=524df3be-b94b-462e-89c0-57ffa9878bd1,network=Network(ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524df3be-b9')
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:19:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] No VIF found with MAC fa:16:3e:94:a9:66, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:19:16 user nova-compute[75571]: DEBUG nova.network.neutron [req-6654f517-d4c4-4d1c-b61b-e427e7f34b34 req-6e4202b0-bd04-4dc8-9c18-d4b6054f6508 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Updated VIF entry in instance network info cache for port 524df3be-b94b-462e-89c0-57ffa9878bd1. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:19:16 user nova-compute[75571]: DEBUG nova.network.neutron [req-6654f517-d4c4-4d1c-b61b-e427e7f34b34 req-6e4202b0-bd04-4dc8-9c18-d4b6054f6508 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Updating instance_info_cache with network_info: [{"id": "524df3be-b94b-462e-89c0-57ffa9878bd1", "address": "fa:16:3e:94:a9:66", "network": {"id": "ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-242564008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee4056e8f34a4e8da54592d28d7a75a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524df3be-b9", "ovs_interfaceid": "524df3be-b94b-462e-89c0-57ffa9878bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:19:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6654f517-d4c4-4d1c-b61b-e427e7f34b34 req-6e4202b0-bd04-4dc8-9c18-d4b6054f6508 service nova] Releasing lock "refresh_cache-86c31e96-70cf-45fd-9578-194706af2ad0" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:19:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-1f9eea4f-c882-4ef1-85c6-9e9d3c38a47f req-5130f61d-0630-4e16-abfe-9d314d4cb6d2 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Received event network-vif-plugged-524df3be-b94b-462e-89c0-57ffa9878bd1 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1f9eea4f-c882-4ef1-85c6-9e9d3c38a47f req-5130f61d-0630-4e16-abfe-9d314d4cb6d2 service nova] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1f9eea4f-c882-4ef1-85c6-9e9d3c38a47f req-5130f61d-0630-4e16-abfe-9d314d4cb6d2 service nova] Lock "86c31e96-70cf-45fd-9578-194706af2ad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1f9eea4f-c882-4ef1-85c6-9e9d3c38a47f req-5130f61d-0630-4e16-abfe-9d314d4cb6d2 service nova] Lock "86c31e96-70cf-45fd-9578-194706af2ad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-1f9eea4f-c882-4ef1-85c6-9e9d3c38a47f req-5130f61d-0630-4e16-abfe-9d314d4cb6d2 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] No waiting events found dispatching network-vif-plugged-524df3be-b94b-462e-89c0-57ffa9878bd1 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:16 user nova-compute[75571]: WARNING nova.compute.manager [req-1f9eea4f-c882-4ef1-85c6-9e9d3c38a47f req-5130f61d-0630-4e16-abfe-9d314d4cb6d2 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Received unexpected event network-vif-plugged-524df3be-b94b-462e-89c0-57ffa9878bd1 for instance with vm_state building and task_state spawning.
Nov 28 20:19:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "40ac5386-d43f-443c-ac15-186b368728f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:17 user nova-compute[75571]: DEBUG nova.objects.instance [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lazy-loading 'flavor' on Instance uuid 40ac5386-d43f-443c-ac15-186b368728f8 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:19:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "40ac5386-d43f-443c-ac15-186b368728f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "40ac5386-d43f-443c-ac15-186b368728f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:18 user nova-compute[75571]: INFO nova.compute.manager [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Attaching volume 78f18bcc-3456-4d6b-a070-51c3de9d32ec to /dev/vdb
Nov 28 20:19:18 user nova-compute[75571]: DEBUG os_brick.utils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe716fb-0ea2-43de-b5e3-03178cac809a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63cbe58-ac80-4deb-8ef9-54198f98e793]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed47266-d55c-4598-9ac6-511f8ca47835]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[083c4fe6-ad0a-46f4-a488-9813fe2cc5e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:19:18 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[086c191b-2fae-4271-85bb-48de4009bed2]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG os_brick.utils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating existing volume attachment record: 12acb353-e712-4812-950f-c11e298070fe {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:19:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Instance spawned successfully.
Nov 28 20:19:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:19:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-16808692-2ffb-4c4d-952e-683b236bd6c4 req-f37d82e4-b3da-4539-8129-5fe4c84c9def service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Received event network-vif-plugged-524df3be-b94b-462e-89c0-57ffa9878bd1 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-16808692-2ffb-4c4d-952e-683b236bd6c4 req-f37d82e4-b3da-4539-8129-5fe4c84c9def service nova] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-16808692-2ffb-4c4d-952e-683b236bd6c4 req-f37d82e4-b3da-4539-8129-5fe4c84c9def service nova] Lock "86c31e96-70cf-45fd-9578-194706af2ad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-16808692-2ffb-4c4d-952e-683b236bd6c4 req-f37d82e4-b3da-4539-8129-5fe4c84c9def service nova] Lock "86c31e96-70cf-45fd-9578-194706af2ad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-16808692-2ffb-4c4d-952e-683b236bd6c4 req-f37d82e4-b3da-4539-8129-5fe4c84c9def service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] No waiting events found dispatching network-vif-plugged-524df3be-b94b-462e-89c0-57ffa9878bd1 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:19 user nova-compute[75571]: WARNING nova.compute.manager [req-16808692-2ffb-4c4d-952e-683b236bd6c4 req-f37d82e4-b3da-4539-8129-5fe4c84c9def service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Received unexpected event network-vif-plugged-524df3be-b94b-462e-89c0-57ffa9878bd1 for instance with vm_state building and task_state spawning.
Nov 28 20:19:19 user nova-compute[75571]: INFO nova.compute.manager [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 28 20:19:19 user nova-compute[75571]: DEBUG nova.compute.manager [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:19:19 user nova-compute[75571]: INFO nova.compute.manager [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Took 6.30 seconds to build instance.
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.395s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:19 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b4000485-c53c-46e7-b585-cec40c114ec9 is timed out.
Nov 28 20:19:19 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Successfully detached device vdb from instance b4000485-c53c-46e7-b585-cec40c114ec9 from the live domain config.
Nov 28 20:19:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnSTsjQG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:19:19 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[872a8727-3bd2-4d4f-8343-ea967a620f83]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:19:19 user nova-compute[75571]: No targets found.
Nov 28 20:19:19 user nova-compute[75571]: iSNS:
Nov 28 20:19:19 user nova-compute[75571]: No targets found.
Nov 28 20:19:19 user nova-compute[75571]: STATIC:
Nov 28 20:19:19 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669
Nov 28 20:19:19 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:19:19 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:19:19 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851
Nov 28 20:19:19 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:19:19 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:19:19 user nova-compute[75571]: FIRMWARE:
Nov 28 20:19:19 user nova-compute[75571]: No targets found.
Nov 28 20:19:19 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:19:19 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:19:19 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[57739d1b-f09f-457a-9147-a1e551b9b576]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd09ad37-e89c-43d8-b168-ae6d06cd54dd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:19:19 user nova-compute[75571]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 (non-flash)
Nov 28 20:19:19 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 (non-flash)
Nov 28 20:19:19 user nova-compute[75571]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 (non-flash)
Nov 28 20:19:19 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f774870ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7ab535-ea22-4f4f-a2cc-8c91a3278f84]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abdf968-cdf3-4873-a78e-3a2cb0f57ee5]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[870e0cb6-ac52-4e5b-b29d-b52c3deaf542]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef76823c-d3ac-4a93-98ca-ba1cf133354c]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2d2683-71f1-43a7-9dc9-4c0d4f5beea6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[10da9976-d0de-49ea-b678-92726831f9a2]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260]
Nov 28 20:19:19 user nova-compute[75571]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851, portal: 172.16.0.220,3260] successful.
Nov 28 20:19:19 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be8885e7-c3ff-4344-ba63-87e0e83cf851 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62a8f5f-3658-4384-bb68-3e88e33b0f13]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] <== disconnect_volume: return (316ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:19:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:19:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:20 user nova-compute[75571]: DEBUG nova.objects.instance [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lazy-loading 'flavor' on Instance uuid b4000485-c53c-46e7-b585-cec40c114ec9 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:19:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "b4000485-c53c-46e7-b585-cec40c114ec9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.898s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRGlTqEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:19:25 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:19:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:19:25 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:19:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:19:25 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f80ece2-9bb4-4e4e-bb53-43cafe11d0cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:19:25 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faa5c32-cfae-498c-af7d-240f72272ed3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec] added
Nov 28 20:19:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f243e2-181d-4468-89f7-6727ed604412]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.121s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9870b9-a256-4d8d-8a97-2dd548de5053]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRGlTqEK {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRGlTqEK" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47235e1-b17d-4c36-b79e-6d73be5f8e77]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sRGlTqEK'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e16501f-0f5d-45a5-a80e-af5ca9edc6b3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3e71b2-1a98-465b-a2a6-48a39b729245]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 (non-flash)
Nov 28 20:19:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 (non-flash)
Nov 28 20:19:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf9cd88-4ca1-4b67-a770-66c23d2cc3b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260]
Nov 28 20:19:25 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260] successful.
Nov 28 20:19:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[704e8c26-d570-47f6-a99f-b7a96c69dda4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1176b5-0ec4-4e78-bf22-01f0261e8ad5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 (non-flash)
Nov 28 20:19:26 user nova-compute[75571]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:19:26 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:19:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 (non-flash)
Nov 28 20:19:26 user nova-compute[75571]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:19:26 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:19:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:19:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:19:26 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:19:26 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:19:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff7d09a-8e73-4535-a1d2-9b230f930524]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:26 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:19:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRGlTqEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '26533303238663166', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533303238663166', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG nova.objects.instance [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lazy-loading 'flavor' on Instance uuid 40ac5386-d43f-443c-ac15-186b368728f8 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:19:27 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:19:27 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:19:27 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:19:27 user nova-compute[75571]:   <serial>78f18bcc-3456-4d6b-a070-51c3de9d32ec</serial>
Nov 28 20:19:27 user nova-compute[75571]: </disk>
Nov 28 20:19:27 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:19:27 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fc91159a-f3ce-4674-b9e4-a548d373471b is timed out.
Nov 28 20:19:27 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Successfully detached device vdb from instance fc91159a-f3ce-4674-b9e4-a548d373471b from the live domain config.
Nov 28 20:19:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcNAGRJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:19:27 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab037e25-a92f-440a-9ea5-f65d2983884e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:19:27 user nova-compute[75571]: No targets found.
Nov 28 20:19:27 user nova-compute[75571]: iSNS:
Nov 28 20:19:27 user nova-compute[75571]: No targets found.
Nov 28 20:19:27 user nova-compute[75571]: STATIC:
Nov 28 20:19:27 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669
Nov 28 20:19:27 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:19:27 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:19:27 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec
Nov 28 20:19:27 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:19:27 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:19:27 user nova-compute[75571]: FIRMWARE:
Nov 28 20:19:27 user nova-compute[75571]: No targets found.
Nov 28 20:19:27 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:19:27 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:19:27 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bc2820-67d5-44eb-afb7-91f7f6a68496]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2970d62a-6544-40c4-a0d8-fd1b3b53ee30]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 (non-flash)
Nov 28 20:19:27 user nova-compute[75571]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:19:27 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 (non-flash)
Nov 28 20:19:27 user nova-compute[75571]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:19:27 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f774870c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669'): ({'sdc'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Removing single pathed devices sdc {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[df615946-f0f5-490a-ac71-b79487eb8a16]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[50148338-6dd6-460e-9c2d-63986e7206d5]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Flushing IO for device /dev/sdc {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f411885-2fd0-4146-b50c-2dc646c9607d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f6352e-c134-41dd-a992-aed5d6b5f50d]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[db13a333-3740-4b9d-ac7c-884f7c60afc5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[398948bc-bf42-4ad5-a10d-b421fde09048]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669, portal: 172.16.0.220,3260]
Nov 28 20:19:27 user nova-compute[75571]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669, portal: 172.16.0.220,3260] successful.
Nov 28 20:19:27 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c94154d-13b0-49d9-b711-6921c3faef9b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] <== disconnect_volume: return (331ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] No VIF found with MAC fa:16:3e:68:de:09, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:19:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "40ac5386-d43f-443c-ac15-186b368728f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.553s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:28 user nova-compute[75571]: DEBUG nova.objects.instance [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lazy-loading 'flavor' on Instance uuid fc91159a-f3ce-4674-b9e4-a548d373471b {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:19:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.765s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.596s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "fc91159a-f3ce-4674-b9e4-a548d373471b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:28 user nova-compute[75571]: INFO nova.compute.manager [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Terminating instance
Nov 28 20:19:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:19:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-1031ea79-b941-4c23-873e-61c9e94f76e4 req-c5f09a98-2d75-45d6-8dd8-7dd472acafd0 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Received event network-vif-unplugged-d190a550-01ac-49d5-a9dc-b62ed711fe32 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1031ea79-b941-4c23-873e-61c9e94f76e4 req-c5f09a98-2d75-45d6-8dd8-7dd472acafd0 service nova] Acquiring lock "fc91159a-f3ce-4674-b9e4-a548d373471b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1031ea79-b941-4c23-873e-61c9e94f76e4 req-c5f09a98-2d75-45d6-8dd8-7dd472acafd0 service nova] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1031ea79-b941-4c23-873e-61c9e94f76e4 req-c5f09a98-2d75-45d6-8dd8-7dd472acafd0 service nova] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-1031ea79-b941-4c23-873e-61c9e94f76e4 req-c5f09a98-2d75-45d6-8dd8-7dd472acafd0 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] No waiting events found dispatching network-vif-unplugged-d190a550-01ac-49d5-a9dc-b62ed711fe32 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-1031ea79-b941-4c23-873e-61c9e94f76e4 req-c5f09a98-2d75-45d6-8dd8-7dd472acafd0 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Received event network-vif-unplugged-d190a550-01ac-49d5-a9dc-b62ed711fe32 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:19:29 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Instance destroyed successfully.
Nov 28 20:19:29 user nova-compute[75571]: DEBUG nova.objects.instance [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lazy-loading 'resources' on Instance uuid fc91159a-f3ce-4674-b9e4-a548d373471b {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:16:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1646342622',display_name='tempest-VolumesSnapshotTestJSON-instance-1646342622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1646342622',id=20,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhZkQDdLZeWcw+DLJgWEP7/QLMXDWRzm0CPVYVn2k4jy1vGUzXjooGrXig9p8ufo5hQjxqLQZi7n2kxD83VZKSlK30YLJPXw2/ETdSXJesP9+5Qq2fcU4CsAGjcrk0PAw==',key_name='tempest-keypair-526921959',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:16:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548f7955f73e434cb014eeaeffa2824f',ramdisk_id='',reservation_id='r-5si3jb4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2135983630',owner_user_name='tempest-VolumesSnapshotTestJSON-2135983630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:16:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='740070b2e6434ca9a733cb932663572c',uuid=fc91159a-f3ce-4674-b9e4-a548d373471b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "address": "fa:16:3e:db:bb:ee", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd190a550-01", "ovs_interfaceid": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Converting VIF {"id": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "address": "fa:16:3e:db:bb:ee", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd190a550-01", "ovs_interfaceid": "d190a550-01ac-49d5-a9dc-b62ed711fe32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=d190a550-01ac-49d5-a9dc-b62ed711fe32,network=Network(80eb1442-8e05-4d31-96b5-26df5f47f887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd190a550-01') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG os_vif [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=d190a550-01ac-49d5-a9dc-b62ed711fe32,network=Network(80eb1442-8e05-4d31-96b5-26df5f47f887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd190a550-01') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd190a550-01, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=171168f4-4b3c-4315-871b-5340b1fe4244) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:29 user nova-compute[75571]: INFO os_vif [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=d190a550-01ac-49d5-a9dc-b62ed711fe32,network=Network(80eb1442-8e05-4d31-96b5-26df5f47f887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd190a550-01')
Nov 28 20:19:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcNAGRJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:19:29 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:19:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b4aa74-0e58-473e-a264-edc8be6334b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:19:29 user nova-compute[75571]: No targets found.
Nov 28 20:19:29 user nova-compute[75571]: iSNS:
Nov 28 20:19:29 user nova-compute[75571]: No targets found.
Nov 28 20:19:29 user nova-compute[75571]: STATIC:
Nov 28 20:19:29 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec
Nov 28 20:19:29 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:19:29 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:19:29 user nova-compute[75571]: FIRMWARE:
Nov 28 20:19:29 user nova-compute[75571]: No targets found.
Nov 28 20:19:29 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:19:29 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:19:29 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ff37446-5abc-43b6-899c-41739cf0e669', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d2d3e3-7e97-4560-a4f4-68b2e327876f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a37d3a1-ff3a-46be-9f47-1d61ff9af375]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:19:29 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:19:29 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768565fc0>, {}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Disconnecting from: [] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] <== disconnect_volume: return (77ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:19:29 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Deleting instance files /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b_del
Nov 28 20:19:29 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Deletion of /opt/stack/data/nova/instances/fc91159a-f3ce-4674-b9e4-a548d373471b_del complete
Nov 28 20:19:29 user nova-compute[75571]: INFO nova.compute.manager [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 28 20:19:29 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:19:29 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:19:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Stashing vm_state: active {{(pid=75571) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 20:19:30 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:19:30 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Took 0.86 seconds to deallocate network for instance.
Nov 28 20:19:30 user nova-compute[75571]: WARNING nova.volume.cinder [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Attachment 8c373350-1f25-4e7f-a7de-08ba774ace5f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8c373350-1f25-4e7f-a7de-08ba774ace5f. (HTTP 404) (Request-ID: req-424d8dfc-ed1b-475c-9264-0aef6cc8cb36)
Nov 28 20:19:30 user nova-compute[75571]: INFO nova.compute.manager [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Took 0.03 seconds to detach 1 volumes for instance.
Nov 28 20:19:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:30 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:19:30 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:19:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.359s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:30 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Deleted allocations for instance fc91159a-f3ce-4674-b9e4-a548d373471b
Nov 28 20:19:30 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:19:30 user nova-compute[75571]: INFO nova.compute.claims [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Claim successful on node user
Nov 28 20:19:30 user nova-compute[75571]: INFO nova.compute.resource_tracker [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating resource usage from migration 673ad9be-bcb1-471c-ac1b-1ba267fcdb40
Nov 28 20:19:30 user nova-compute[75571]: DEBUG nova.compute.manager [req-e0b2a45f-4bc5-482d-82d6-7b41640f8dbc req-0a8d8bcd-4bfb-4d02-a80b-64fc0e6f40a7 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Received event network-vif-plugged-d190a550-01ac-49d5-a9dc-b62ed711fe32 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e0b2a45f-4bc5-482d-82d6-7b41640f8dbc req-0a8d8bcd-4bfb-4d02-a80b-64fc0e6f40a7 service nova] Acquiring lock "fc91159a-f3ce-4674-b9e4-a548d373471b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e0b2a45f-4bc5-482d-82d6-7b41640f8dbc req-0a8d8bcd-4bfb-4d02-a80b-64fc0e6f40a7 service nova] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e0b2a45f-4bc5-482d-82d6-7b41640f8dbc req-0a8d8bcd-4bfb-4d02-a80b-64fc0e6f40a7 service nova] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:30 user nova-compute[75571]: DEBUG nova.compute.manager [req-e0b2a45f-4bc5-482d-82d6-7b41640f8dbc req-0a8d8bcd-4bfb-4d02-a80b-64fc0e6f40a7 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] No waiting events found dispatching network-vif-plugged-d190a550-01ac-49d5-a9dc-b62ed711fe32 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:30 user nova-compute[75571]: WARNING nova.compute.manager [req-e0b2a45f-4bc5-482d-82d6-7b41640f8dbc req-0a8d8bcd-4bfb-4d02-a80b-64fc0e6f40a7 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Received unexpected event network-vif-plugged-d190a550-01ac-49d5-a9dc-b62ed711fe32 for instance with vm_state deleted and task_state None.
Nov 28 20:19:30 user nova-compute[75571]: DEBUG nova.compute.manager [req-e0b2a45f-4bc5-482d-82d6-7b41640f8dbc req-0a8d8bcd-4bfb-4d02-a80b-64fc0e6f40a7 service nova] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Received event network-vif-deleted-d190a550-01ac-49d5-a9dc-b62ed711fe32 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "fc91159a-f3ce-4674-b9e4-a548d373471b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.530s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:31 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:19:31 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:19:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.434s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:31 user nova-compute[75571]: INFO nova.compute.manager [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Migrating
Nov 28 20:19:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:19:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:19:31 user nova-compute[75571]: INFO nova.compute.rpcapi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 28 20:19:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:19:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:19:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquired lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:19:31 user nova-compute[75571]: DEBUG nova.network.neutron [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:19:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:31 user nova-compute[75571]: DEBUG nova.network.neutron [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating instance_info_cache with network_info: [{"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:19:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Releasing lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:19:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Starting migrate_disk_and_power_off {{(pid=75571) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 20:19:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:32 user nova-compute[75571]: DEBUG nova.compute.manager [req-e9d2179c-6280-4207-957e-5fee37633673 req-aa99445e-8e5a-479a-a093-217419b3ab39 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-vif-unplugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e9d2179c-6280-4207-957e-5fee37633673 req-aa99445e-8e5a-479a-a093-217419b3ab39 service nova] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e9d2179c-6280-4207-957e-5fee37633673 req-aa99445e-8e5a-479a-a093-217419b3ab39 service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e9d2179c-6280-4207-957e-5fee37633673 req-aa99445e-8e5a-479a-a093-217419b3ab39 service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:32 user nova-compute[75571]: DEBUG nova.compute.manager [req-e9d2179c-6280-4207-957e-5fee37633673 req-aa99445e-8e5a-479a-a093-217419b3ab39 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] No waiting events found dispatching network-vif-unplugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:32 user nova-compute[75571]: WARNING nova.compute.manager [req-e9d2179c-6280-4207-957e-5fee37633673 req-aa99445e-8e5a-479a-a093-217419b3ab39 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received unexpected event network-vif-unplugged-38a389ab-f2f2-413a-85e1-b40415fc156c for instance with vm_state active and task_state resize_migrating.
Nov 28 20:19:33 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Instance destroyed successfully.
Nov 28 20:19:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2039159279',display_name='tempest-ServerActionsTestOtherB-server-2039159279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2039159279',id=17,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGleHnng/iZf+pKcaRfN4ki3/kKcZ1lAUwQTncf758ioT4v9Nu4+2KyDgP5bUFKo8JEMegAuoMjbKaD/3O2Xdr1tfYfEaBfckP1a0BpsnLhWEjCdte2x0agDjBhSwM7chQ==',key_name='tempest-keypair-1179232993',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8895df748b4644e9bad362ea318e04c7',ramdisk_id='',reservation_id='r-dfynuxpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1446981498',owner_user_name='tempest-ServerActionsTestOtherB-1446981498-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:19:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ffae0c69e0c40e0917cf412e7757616',uuid=40ac5386-d43f-443c-ac15-186b368728f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1134666504-network", "vif_mac": "fa:16:3e:68:de:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converting VIF {"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1134666504-network", "vif_mac": "fa:16:3e:68:de:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_vif [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38a389ab-f2, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30966d17-d909-4329-9ac5-aab3b97c46f3) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:19:33 user nova-compute[75571]: INFO os_vif [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2')
Nov 28 20:19:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRGlTqEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:19:33 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e92eda9-ea6e-42ce-8e84-2802a5daf229]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:19:33 user nova-compute[75571]: No targets found.
Nov 28 20:19:33 user nova-compute[75571]: iSNS:
Nov 28 20:19:33 user nova-compute[75571]: No targets found.
Nov 28 20:19:33 user nova-compute[75571]: STATIC:
Nov 28 20:19:33 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec
Nov 28 20:19:33 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:19:33 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:19:33 user nova-compute[75571]: FIRMWARE:
Nov 28 20:19:33 user nova-compute[75571]: No targets found.
Nov 28 20:19:33 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:19:33 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:19:33 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b84de7b-d591-49b9-ae92-995ab748b761]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db67d46-4ee0-493c-ba44-79eaeb0593a7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:19:33 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:19:33 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77682d8790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf226a3-7dbf-40d9-bb0f-fb56ba155efe]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a991d04-e801-4634-be14-80904c8b343b]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[796e1aaa-b3db-4736-b802-88855de80d08]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[514803ef-e97b-4d9d-a549-3e754c577f02]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9d03c6-03d4-4809-96d8-f48f53146536]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8791cf3-ade9-4c36-811c-fea1e578fc40]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260]
Nov 28 20:19:33 user nova-compute[75571]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260] successful.
Nov 28 20:19:33 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cce5df-d3a2-4420-98c3-3a3bab56d1cf]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] <== disconnect_volume: return (345ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:19:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8_resize/disk /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CMD "cp -r /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8_resize/disk /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk" returned: 0 in 0.391s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8_resize/disk.info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk.info {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CMD "cp -r /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8_resize/disk.info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk.info" returned: 0 in 0.038s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:34 user nova-compute[75571]: DEBUG nova.compute.manager [req-3a4f68c8-b9a6-43aa-ac4f-d850602afebd req-04c22317-c7ce-457d-bbc4-18e8ab5db1aa service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3a4f68c8-b9a6-43aa-ac4f-d850602afebd req-04c22317-c7ce-457d-bbc4-18e8ab5db1aa service nova] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3a4f68c8-b9a6-43aa-ac4f-d850602afebd req-04c22317-c7ce-457d-bbc4-18e8ab5db1aa service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3a4f68c8-b9a6-43aa-ac4f-d850602afebd req-04c22317-c7ce-457d-bbc4-18e8ab5db1aa service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:34 user nova-compute[75571]: DEBUG nova.compute.manager [req-3a4f68c8-b9a6-43aa-ac4f-d850602afebd req-04c22317-c7ce-457d-bbc4-18e8ab5db1aa service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] No waiting events found dispatching network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:34 user nova-compute[75571]: WARNING nova.compute.manager [req-3a4f68c8-b9a6-43aa-ac4f-d850602afebd req-04c22317-c7ce-457d-bbc4-18e8ab5db1aa service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received unexpected event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c for instance with vm_state active and task_state resize_migrating.
Nov 28 20:19:35 user nova-compute[75571]: DEBUG nova.network.neutron [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Port 38a389ab-f2f2-413a-85e1-b40415fc156c binding to destination host user is already ACTIVE {{(pid=75571) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 20:19:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:19:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquired lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:19:35 user nova-compute[75571]: DEBUG nova.network.neutron [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG nova.network.neutron [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating instance_info_cache with network_info: [{"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Releasing lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG os_brick.utils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3618eed-564d-41ab-aaa4-755e219db4ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa76f0ab-4ea3-4d4d-be72-726866c669a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8f4054-bd3d-4951-bfa5-d1d62604bfde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6578316e-4717-41c0-879b-d4458bf47974]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:19:36 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:19:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0899f5f2-699c-415b-a197-72d06ebac2c2]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:19:36 user nova-compute[75571]: DEBUG os_brick.utils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:19:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Starting finish_migration {{(pid=75571) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Instance directory exists: not creating {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 20:19:43 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Creating image(s)
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.207s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk. size=21474836480 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk 21474836480 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk 21474836480" returned: 0 in 0.047s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Ensure instance console log exists: /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Start _get_guest_xml network_info=[{"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1134666504-network", "vif_mac": "fa:16:3e:68:de:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRGlTqEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '40ac5386-d43f-443c-ac15-186b368728f8', 'attached_at': '2023-11-28T20:19:43.000000', 'detached_at': '', 'volume_id': '78f18bcc-3456-4d6b-a070-51c3de9d32ec', 'serial': '78f18bcc-3456-4d6b-a070-51c3de9d32ec'}, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '107bfd05-6c3c-4d66-818c-4653fd25bd8e', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:19:43 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:19:43 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRGlTqEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:19:43 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:19:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:19:43 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:19:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:19:43 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:19:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6069cfe-c139-4749-86f2-724d68a7f7c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:19:43 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[817bc4a7-d2b6-4beb-babb-2c928953e83c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec] added
Nov 28 20:19:43 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed1654b-377f-459f-9668-fdc2788c683d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef915a0-684c-48ce-a729-1f5c3f77cbd4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRGlTqEK {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRGlTqEK" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c44291-a621-4e41-a245-703d619bf84c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sRGlTqEK'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf13787-954f-4b93-a901-0fdfc807cf7a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f310c1-cff7-4183-87af-7785fbe8f984]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:19:43 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:19:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:19:43 user nova-compute[75571]:  {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:19:43 user nova-compute[75571]: WARNING os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 20:19:43 user nova-compute[75571]: 
Nov 28 20:19:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1afbecf-c65b-4ea1-a2aa-0fc590816755]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260]
Nov 28 20:19:44 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260] successful.
Nov 28 20:19:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30d334f-2774-4055-8927-82678e7cfa8e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c263959b-4b03-4b98-95b1-85c19753b587]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:19:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:19:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7f8162-d27b-4e83-bbd4-f01285175c5f]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRGlTqEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:19:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26533303238663166', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533303238663166', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2039159279',display_name='tempest-ServerActionsTestOtherB-server-2039159279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2039159279',id=17,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGleHnng/iZf+pKcaRfN4ki3/kKcZ1lAUwQTncf758ioT4v9Nu4+2KyDgP5bUFKo8JEMegAuoMjbKaD/3O2Xdr1tfYfEaBfckP1a0BpsnLhWEjCdte2x0agDjBhSwM7chQ==',key_name='tempest-keypair-1179232993',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8895df748b4644e9bad362ea318e04c7',ramdisk_id='',reservation_id='r-dfynuxpw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1446981498',owner_user_name='tempest-ServerActionsTestOtherB-1446981498-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:19:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ffae0c69e0c40e0917cf412e7757616',uuid=40ac5386-d43f-443c-ac15-186b368728f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1134666504-network", "vif_mac": "fa:16:3e:68:de:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converting VIF {"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1134666504-network", "vif_mac": "fa:16:3e:68:de:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:19:45 user nova-compute[75571]:   <uuid>40ac5386-d43f-443c-ac15-186b368728f8</uuid>
Nov 28 20:19:45 user nova-compute[75571]:   <name>instance-00000011</name>
Nov 28 20:19:45 user nova-compute[75571]:   <memory>2097152</memory>
Nov 28 20:19:45 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:19:45 user nova-compute[75571]:   <metadata>
Nov 28 20:19:45 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:19:45 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:19:45 user nova-compute[75571]:       <nova:name>tempest-ServerActionsTestOtherB-server-2039159279</nova:name>
Nov 28 20:19:45 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:19:43</nova:creationTime>
Nov 28 20:19:45 user nova-compute[75571]:       <nova:flavor name="m1.small">
Nov 28 20:19:45 user nova-compute[75571]:         <nova:memory>2048</nova:memory>
Nov 28 20:19:45 user nova-compute[75571]:         <nova:disk>20</nova:disk>
Nov 28 20:19:45 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:19:45 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:19:45 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:19:45 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:19:45 user nova-compute[75571]:       <nova:owner>
Nov 28 20:19:45 user nova-compute[75571]:         <nova:user uuid="0ffae0c69e0c40e0917cf412e7757616">tempest-ServerActionsTestOtherB-1446981498-project-member</nova:user>
Nov 28 20:19:45 user nova-compute[75571]:         <nova:project uuid="8895df748b4644e9bad362ea318e04c7">tempest-ServerActionsTestOtherB-1446981498</nova:project>
Nov 28 20:19:45 user nova-compute[75571]:       </nova:owner>
Nov 28 20:19:45 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:19:45 user nova-compute[75571]:       <nova:ports>
Nov 28 20:19:45 user nova-compute[75571]:         <nova:port uuid="38a389ab-f2f2-413a-85e1-b40415fc156c">
Nov 28 20:19:45 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:19:45 user nova-compute[75571]:         </nova:port>
Nov 28 20:19:45 user nova-compute[75571]:       </nova:ports>
Nov 28 20:19:45 user nova-compute[75571]:     </nova:instance>
Nov 28 20:19:45 user nova-compute[75571]:   </metadata>
Nov 28 20:19:45 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:19:45 user nova-compute[75571]:     <system>
Nov 28 20:19:45 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:19:45 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:19:45 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:19:45 user nova-compute[75571]:       <entry name="serial">40ac5386-d43f-443c-ac15-186b368728f8</entry>
Nov 28 20:19:45 user nova-compute[75571]:       <entry name="uuid">40ac5386-d43f-443c-ac15-186b368728f8</entry>
Nov 28 20:19:45 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:19:45 user nova-compute[75571]:     </system>
Nov 28 20:19:45 user nova-compute[75571]:   </sysinfo>
Nov 28 20:19:45 user nova-compute[75571]:   <os>
Nov 28 20:19:45 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:19:45 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:19:45 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:19:45 user nova-compute[75571]:   </os>
Nov 28 20:19:45 user nova-compute[75571]:   <features>
Nov 28 20:19:45 user nova-compute[75571]:     <acpi/>
Nov 28 20:19:45 user nova-compute[75571]:     <apic/>
Nov 28 20:19:45 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:19:45 user nova-compute[75571]:   </features>
Nov 28 20:19:45 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:19:45 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:19:45 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:19:45 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:19:45 user nova-compute[75571]:   </clock>
Nov 28 20:19:45 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:19:45 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:19:45 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:19:45 user nova-compute[75571]:   </cpu>
Nov 28 20:19:45 user nova-compute[75571]:   <devices>
Nov 28 20:19:45 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:19:45 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:19:45 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk"/>
Nov 28 20:19:45 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:19:45 user nova-compute[75571]:     </disk>
Nov 28 20:19:45 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:19:45 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:19:45 user nova-compute[75571]:       <source dev="/dev/sdb"/>
Nov 28 20:19:45 user nova-compute[75571]:       <target dev="vdb" bus="virtio"/>
Nov 28 20:19:45 user nova-compute[75571]:       <serial>78f18bcc-3456-4d6b-a070-51c3de9d32ec</serial>
Nov 28 20:19:45 user nova-compute[75571]:     </disk>
Nov 28 20:19:45 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:19:45 user nova-compute[75571]:       <mac address="fa:16:3e:68:de:09"/>
Nov 28 20:19:45 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:19:45 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:19:45 user nova-compute[75571]:       <target dev="tap38a389ab-f2"/>
Nov 28 20:19:45 user nova-compute[75571]:     </interface>
Nov 28 20:19:45 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:19:45 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/console.log" append="off"/>
Nov 28 20:19:45 user nova-compute[75571]:     </serial>
Nov 28 20:19:45 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:19:45 user nova-compute[75571]:     <video>
Nov 28 20:19:45 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:19:45 user nova-compute[75571]:     </video>
Nov 28 20:19:45 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:19:45 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:19:45 user nova-compute[75571]:     </rng>
Nov 28 20:19:45 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:19:45 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:19:45 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:19:45 user nova-compute[75571]:     </memballoon>
Nov 28 20:19:45 user nova-compute[75571]:   </devices>
Nov 28 20:19:45 user nova-compute[75571]: </domain>
Nov 28 20:19:45 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2039159279',display_name='tempest-ServerActionsTestOtherB-server-2039159279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2039159279',id=17,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGleHnng/iZf+pKcaRfN4ki3/kKcZ1lAUwQTncf758ioT4v9Nu4+2KyDgP5bUFKo8JEMegAuoMjbKaD/3O2Xdr1tfYfEaBfckP1a0BpsnLhWEjCdte2x0agDjBhSwM7chQ==',key_name='tempest-keypair-1179232993',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8895df748b4644e9bad362ea318e04c7',ramdisk_id='',reservation_id='r-dfynuxpw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1446981498',owner_user_name='tempest-ServerActionsTestOtherB-1446981498-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:19:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ffae0c69e0c40e0917cf412e7757616',uuid=40ac5386-d43f-443c-ac15-186b368728f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1134666504-network", "vif_mac": "fa:16:3e:68:de:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converting VIF {"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1134666504-network", "vif_mac": "fa:16:3e:68:de:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG os_vif [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90e5cae5-b4a3-5a4f-94f1-29409c33c29f', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38a389ab-f2, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38a389ab-f2, col_values=(('qos', UUID('164a05da-1e80-46e2-88bb-925259734c65')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38a389ab-f2, col_values=(('external_ids', {'iface-id': '38a389ab-f2f2-413a-85e1-b40415fc156c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:de:09', 'vm-uuid': '40ac5386-d43f-443c-ac15-186b368728f8'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:45 user nova-compute[75571]: INFO os_vif [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2')
Nov 28 20:19:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:19:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] No VIF found with MAC fa:16:3e:68:de:09, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:19:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-bdd30ce0-6c99-41df-939d-1f34c5f8b144 req-2cda9112-33b0-4c5f-91c1-eecbeacc4754 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bdd30ce0-6c99-41df-939d-1f34c5f8b144 req-2cda9112-33b0-4c5f-91c1-eecbeacc4754 service nova] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bdd30ce0-6c99-41df-939d-1f34c5f8b144 req-2cda9112-33b0-4c5f-91c1-eecbeacc4754 service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bdd30ce0-6c99-41df-939d-1f34c5f8b144 req-2cda9112-33b0-4c5f-91c1-eecbeacc4754 service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-bdd30ce0-6c99-41df-939d-1f34c5f8b144 req-2cda9112-33b0-4c5f-91c1-eecbeacc4754 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] No waiting events found dispatching network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:46 user nova-compute[75571]: WARNING nova.compute.manager [req-bdd30ce0-6c99-41df-939d-1f34c5f8b144 req-2cda9112-33b0-4c5f-91c1-eecbeacc4754 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received unexpected event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c for instance with vm_state active and task_state resize_finish.
Nov 28 20:19:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:48 user nova-compute[75571]: DEBUG nova.compute.manager [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:19:48 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Instance running successfully.
Nov 28 20:19:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Failed to set time: agent not configured {{(pid=75571) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 20:19:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] finish_migration finished successfully. {{(pid=75571) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 20:19:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-2b8e8143-b188-4ec5-8f31-328f88fc3ec3 req-d141d8d1-6d3e-498f-b0f5-b9fe35bd9585 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2b8e8143-b188-4ec5-8f31-328f88fc3ec3 req-d141d8d1-6d3e-498f-b0f5-b9fe35bd9585 service nova] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2b8e8143-b188-4ec5-8f31-328f88fc3ec3 req-d141d8d1-6d3e-498f-b0f5-b9fe35bd9585 service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2b8e8143-b188-4ec5-8f31-328f88fc3ec3 req-d141d8d1-6d3e-498f-b0f5-b9fe35bd9585 service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-2b8e8143-b188-4ec5-8f31-328f88fc3ec3 req-d141d8d1-6d3e-498f-b0f5-b9fe35bd9585 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] No waiting events found dispatching network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:48 user nova-compute[75571]: WARNING nova.compute.manager [req-2b8e8143-b188-4ec5-8f31-328f88fc3ec3 req-d141d8d1-6d3e-498f-b0f5-b9fe35bd9585 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received unexpected event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c for instance with vm_state active and task_state resize_finish.
Nov 28 20:19:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "b4000485-c53c-46e7-b585-cec40c114ec9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "b4000485-c53c-46e7-b585-cec40c114ec9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:48 user nova-compute[75571]: INFO nova.compute.manager [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Terminating instance
Nov 28 20:19:48 user nova-compute[75571]: DEBUG nova.compute.manager [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-cc400bc5-6e14-4c4a-8b10-a480f5ad232f req-b277f831-83b4-48cd-a110-de0a9c5da950 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received event network-vif-unplugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cc400bc5-6e14-4c4a-8b10-a480f5ad232f req-b277f831-83b4-48cd-a110-de0a9c5da950 service nova] Acquiring lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cc400bc5-6e14-4c4a-8b10-a480f5ad232f req-b277f831-83b4-48cd-a110-de0a9c5da950 service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cc400bc5-6e14-4c4a-8b10-a480f5ad232f req-b277f831-83b4-48cd-a110-de0a9c5da950 service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-cc400bc5-6e14-4c4a-8b10-a480f5ad232f req-b277f831-83b4-48cd-a110-de0a9c5da950 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] No waiting events found dispatching network-vif-unplugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-cc400bc5-6e14-4c4a-8b10-a480f5ad232f req-b277f831-83b4-48cd-a110-de0a9c5da950 service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received event network-vif-unplugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Instance destroyed successfully.
Nov 28 20:19:49 user nova-compute[75571]: DEBUG nova.objects.instance [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lazy-loading 'resources' on Instance uuid b4000485-c53c-46e7-b585-cec40c114ec9 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T20:13:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-966969358',display_name='tempest-ServerActionsTestOtherA-server-1075406910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-966969358',id=12,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcv8uQz+nR5/2Kyh5iIwf3OHys6PaLMAb2ymkOGNgmsCNHOoLJgjnILAd0z5T3cqhz2i9h9soKwPeCr9xdFkv0bMWCGWMfoC+gS3+jMXGPbetTiYDkWA2a0ddXyoobpZQ==',key_name='tempest-keypair-1082993848',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:16:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a85595c9e1704e71903d25a65f5b696c',ramdisk_id='',reservation_id='r-w442wsrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-390918760',owner_user_name='tempest-ServerActionsTestOtherA-390918760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098319d33fa243f5a044cf3f3c9f983c',uuid=b4000485-c53c-46e7-b585-cec40c114ec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converting VIF {"id": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "address": "fa:16:3e:35:4b:c8", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bae30f2-56", "ovs_interfaceid": "0bae30f2-569a-4d1d-8e35-77ad39e87209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:4b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0bae30f2-569a-4d1d-8e35-77ad39e87209,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bae30f2-56') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG os_vif [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:4b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0bae30f2-569a-4d1d-8e35-77ad39e87209,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bae30f2-56') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bae30f2-56, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d566708e-8dd0-49f8-96b5-388718d101d2) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:49 user nova-compute[75571]: INFO os_vif [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:4b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0bae30f2-569a-4d1d-8e35-77ad39e87209,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bae30f2-56')
Nov 28 20:19:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Deleting instance files /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9_del
Nov 28 20:19:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Deletion of /opt/stack/data/nova/instances/b4000485-c53c-46e7-b585-cec40c114ec9_del complete
Nov 28 20:19:49 user nova-compute[75571]: INFO nova.compute.manager [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 20:19:49 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:19:49 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:19:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:50 user nova-compute[75571]: DEBUG nova.compute.manager [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:19:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:50 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:19:50 user nova-compute[75571]: INFO nova.compute.claims [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Claim successful on node user
Nov 28 20:19:51 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG nova.compute.manager [req-1856b361-b766-4dfe-8ff6-0897481219fe req-de624aaa-df88-4d55-a313-7f3100cf969a service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received event network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1856b361-b766-4dfe-8ff6-0897481219fe req-de624aaa-df88-4d55-a313-7f3100cf969a service nova] Acquiring lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1856b361-b766-4dfe-8ff6-0897481219fe req-de624aaa-df88-4d55-a313-7f3100cf969a service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1856b361-b766-4dfe-8ff6-0897481219fe req-de624aaa-df88-4d55-a313-7f3100cf969a service nova] Lock "b4000485-c53c-46e7-b585-cec40c114ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG nova.compute.manager [req-1856b361-b766-4dfe-8ff6-0897481219fe req-de624aaa-df88-4d55-a313-7f3100cf969a service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] No waiting events found dispatching network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:51 user nova-compute[75571]: WARNING nova.compute.manager [req-1856b361-b766-4dfe-8ff6-0897481219fe req-de624aaa-df88-4d55-a313-7f3100cf969a service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received unexpected event network-vif-plugged-0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance with vm_state active and task_state deleting.
Nov 28 20:19:51 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Took 1.46 seconds to deallocate network for instance.
Nov 28 20:19:51 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.012s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG nova.network.neutron [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:19:51 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:19:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:19:51 user nova-compute[75571]: INFO nova.virt.block_device [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Booting with volume eaa2b1ac-220a-42a8-99fd-893e37359fd9 at /dev/vda
Nov 28 20:19:51 user nova-compute[75571]: DEBUG nova.policy [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca4e178401f940438a766a048076af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcf01c7a7d24806a2ffe82ec75c8a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG os_brick.utils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[416124b2-1b8f-452e-8473-18d2239c7adf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[33000b8c-6973-41bf-a8fc-a7a73ffbbcb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a63a00d-d8a5-442b-ae4c-f3e10cd12421]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a1d867-1ab9-4c02-87dd-51cd5898ba9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:19:51 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11c1a62-6d3d-478c-85e6-39c2d97cfcce]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG os_brick.utils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updating existing volume attachment record: f97ef80c-fb52-4322-a5a0-e8a789819269 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:19:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:51 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Deleted allocations for instance b4000485-c53c-46e7-b585-cec40c114ec9
Nov 28 20:19:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "b4000485-c53c-46e7-b585-cec40c114ec9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.171s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:53 user nova-compute[75571]: DEBUG nova.compute.manager [req-6d136346-a82a-4167-82d8-b57cd385aae1 req-a9354ee7-14d6-4203-8877-c0039d5ec89a service nova] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Received event network-vif-deleted-0bae30f2-569a-4d1d-8e35-77ad39e87209 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:53 user nova-compute[75571]: DEBUG nova.compute.manager [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:19:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:53 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:19:53 user nova-compute[75571]: INFO nova.compute.claims [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Claim successful on node user
Nov 28 20:19:54 user nova-compute[75571]: DEBUG nova.network.neutron [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Successfully created port: 4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG nova.compute.manager [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG nova.compute.manager [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG nova.network.neutron [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:19:54 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:19:54 user nova-compute[75571]: DEBUG nova.compute.manager [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG nova.policy [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24aa8ca42c7342fa91f5eab19b6c0c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc33efd1bb7f49679e13621e8dd3449a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG nova.compute.manager [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:19:54 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Creating image(s)
Nov 28 20:19:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "/opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "/opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "/opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.223s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.195s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk 1073741824" returned: 0 in 0.058s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.network.neutron [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Successfully created port: 585ae662-b7ec-4f43-b5bd-5966bd473eb3 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.network.neutron [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Successfully updated port: 4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.198s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquired lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.network.neutron [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.network.neutron [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Cannot resize image /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Ensure instance console log exists: /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-4c4f45e0-f929-4a63-9c47-68d78d79a6da req-568e73b0-04c5-481c-9565-b250a5c76826 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-changed-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-4c4f45e0-f929-4a63-9c47-68d78d79a6da req-568e73b0-04c5-481c-9565-b250a5c76826 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Refreshing instance network info cache due to event network-changed-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4c4f45e0-f929-4a63-9c47-68d78d79a6da req-568e73b0-04c5-481c-9565-b250a5c76826 service nova] Acquiring lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.network.neutron [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updating instance_info_cache with network_info: [{"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Releasing lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Instance network_info: |[{"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4c4f45e0-f929-4a63-9c47-68d78d79a6da req-568e73b0-04c5-481c-9565-b250a5c76826 service nova] Acquired lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.network.neutron [req-4c4f45e0-f929-4a63-9c47-68d78d79a6da req-568e73b0-04c5-481c-9565-b250a5c76826 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Refreshing network info cache for port 4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.network.neutron [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Successfully updated port: 585ae662-b7ec-4f43-b5bd-5966bd473eb3 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "refresh_cache-20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquired lock "refresh_cache-20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.network.neutron [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-ff6c1348-ea8e-43c5-84d9-34d30936e2ad req-4ee1cfac-0af6-4232-a0ff-75fd99e620b6 service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Received event network-changed-585ae662-b7ec-4f43-b5bd-5966bd473eb3 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-ff6c1348-ea8e-43c5-84d9-34d30936e2ad req-4ee1cfac-0af6-4232-a0ff-75fd99e620b6 service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Refreshing instance network info cache due to event network-changed-585ae662-b7ec-4f43-b5bd-5966bd473eb3. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ff6c1348-ea8e-43c5-84d9-34d30936e2ad req-4ee1cfac-0af6-4232-a0ff-75fd99e620b6 service nova] Acquiring lock "refresh_cache-20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.network.neutron [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.network.neutron [req-4c4f45e0-f929-4a63-9c47-68d78d79a6da req-568e73b0-04c5-481c-9565-b250a5c76826 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updated VIF entry in instance network info cache for port 4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.network.neutron [req-4c4f45e0-f929-4a63-9c47-68d78d79a6da req-568e73b0-04c5-481c-9565-b250a5c76826 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updating instance_info_cache with network_info: [{"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4c4f45e0-f929-4a63-9c47-68d78d79a6da req-568e73b0-04c5-481c-9565-b250a5c76826 service nova] Releasing lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.network.neutron [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Updating instance_info_cache with network_info: [{"id": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "address": "fa:16:3e:36:90:f8", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585ae662-b7", "ovs_interfaceid": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Releasing lock "refresh_cache-20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.compute.manager [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Instance network_info: |[{"id": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "address": "fa:16:3e:36:90:f8", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585ae662-b7", "ovs_interfaceid": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ff6c1348-ea8e-43c5-84d9-34d30936e2ad req-4ee1cfac-0af6-4232-a0ff-75fd99e620b6 service nova] Acquired lock "refresh_cache-20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.network.neutron [req-ff6c1348-ea8e-43c5-84d9-34d30936e2ad req-4ee1cfac-0af6-4232-a0ff-75fd99e620b6 service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Refreshing network info cache for port 585ae662-b7ec-4f43-b5bd-5966bd473eb3 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Start _get_guest_xml network_info=[{"id": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "address": "fa:16:3e:36:90:f8", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585ae662-b7", "ovs_interfaceid": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:19:56 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:19:56 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-379425302',display_name='tempest-ServersNegativeTestJSON-server-379425302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-379425302',id=25,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc33efd1bb7f49679e13621e8dd3449a',ramdisk_id='',reservation_id='r-fv8h5a7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-146088746',owner_user_name='tempest-ServersNegativeTestJSON-146088746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:19:54Z,user_data=None,user_id='24aa8ca42c7342fa91f5eab19b6c0c9b',uuid=20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "address": "fa:16:3e:36:90:f8", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585ae662-b7", "ovs_interfaceid": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Converting VIF {"id": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "address": "fa:16:3e:36:90:f8", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585ae662-b7", "ovs_interfaceid": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:90:f8,bridge_name='br-int',has_traffic_filtering=True,id=585ae662-b7ec-4f43-b5bd-5966bd473eb3,network=Network(b45a9bdc-c522-435b-8532-28ec9780b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap585ae662-b7') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.objects.instance [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lazy-loading 'pci_devices' on Instance uuid 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:19:56 user nova-compute[75571]:   <uuid>20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6</uuid>
Nov 28 20:19:56 user nova-compute[75571]:   <name>instance-00000019</name>
Nov 28 20:19:56 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:19:56 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:19:56 user nova-compute[75571]:   <metadata>
Nov 28 20:19:56 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:19:56 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:19:56 user nova-compute[75571]:       <nova:name>tempest-ServersNegativeTestJSON-server-379425302</nova:name>
Nov 28 20:19:56 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:19:56</nova:creationTime>
Nov 28 20:19:56 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:19:56 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:19:56 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:19:56 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:19:56 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:19:56 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:19:56 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:19:56 user nova-compute[75571]:       <nova:owner>
Nov 28 20:19:56 user nova-compute[75571]:         <nova:user uuid="24aa8ca42c7342fa91f5eab19b6c0c9b">tempest-ServersNegativeTestJSON-146088746-project-member</nova:user>
Nov 28 20:19:56 user nova-compute[75571]:         <nova:project uuid="fc33efd1bb7f49679e13621e8dd3449a">tempest-ServersNegativeTestJSON-146088746</nova:project>
Nov 28 20:19:56 user nova-compute[75571]:       </nova:owner>
Nov 28 20:19:56 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:19:56 user nova-compute[75571]:       <nova:ports>
Nov 28 20:19:56 user nova-compute[75571]:         <nova:port uuid="585ae662-b7ec-4f43-b5bd-5966bd473eb3">
Nov 28 20:19:56 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 20:19:56 user nova-compute[75571]:         </nova:port>
Nov 28 20:19:56 user nova-compute[75571]:       </nova:ports>
Nov 28 20:19:56 user nova-compute[75571]:     </nova:instance>
Nov 28 20:19:56 user nova-compute[75571]:   </metadata>
Nov 28 20:19:56 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:19:56 user nova-compute[75571]:     <system>
Nov 28 20:19:56 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:19:56 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:19:56 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:19:56 user nova-compute[75571]:       <entry name="serial">20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6</entry>
Nov 28 20:19:56 user nova-compute[75571]:       <entry name="uuid">20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6</entry>
Nov 28 20:19:56 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:19:56 user nova-compute[75571]:     </system>
Nov 28 20:19:56 user nova-compute[75571]:   </sysinfo>
Nov 28 20:19:56 user nova-compute[75571]:   <os>
Nov 28 20:19:56 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:19:56 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:19:56 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:19:56 user nova-compute[75571]:   </os>
Nov 28 20:19:56 user nova-compute[75571]:   <features>
Nov 28 20:19:56 user nova-compute[75571]:     <acpi/>
Nov 28 20:19:56 user nova-compute[75571]:     <apic/>
Nov 28 20:19:56 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:19:56 user nova-compute[75571]:   </features>
Nov 28 20:19:56 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:19:56 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:19:56 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:19:56 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:19:56 user nova-compute[75571]:   </clock>
Nov 28 20:19:56 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:19:56 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:19:56 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:19:56 user nova-compute[75571]:   </cpu>
Nov 28 20:19:56 user nova-compute[75571]:   <devices>
Nov 28 20:19:56 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:19:56 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:19:56 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk"/>
Nov 28 20:19:56 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:19:56 user nova-compute[75571]:     </disk>
Nov 28 20:19:56 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:19:56 user nova-compute[75571]:       <mac address="fa:16:3e:36:90:f8"/>
Nov 28 20:19:56 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:19:56 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:19:56 user nova-compute[75571]:       <target dev="tap585ae662-b7"/>
Nov 28 20:19:56 user nova-compute[75571]:     </interface>
Nov 28 20:19:56 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:19:56 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/console.log" append="off"/>
Nov 28 20:19:56 user nova-compute[75571]:     </serial>
Nov 28 20:19:56 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:19:56 user nova-compute[75571]:     <video>
Nov 28 20:19:56 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:19:56 user nova-compute[75571]:     </video>
Nov 28 20:19:56 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:19:56 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:19:56 user nova-compute[75571]:     </rng>
Nov 28 20:19:56 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:19:56 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:19:56 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:19:56 user nova-compute[75571]:     </memballoon>
Nov 28 20:19:56 user nova-compute[75571]:   </devices>
Nov 28 20:19:56 user nova-compute[75571]: </domain>
Nov 28 20:19:56 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-379425302',display_name='tempest-ServersNegativeTestJSON-server-379425302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-379425302',id=25,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc33efd1bb7f49679e13621e8dd3449a',ramdisk_id='',reservation_id='r-fv8h5a7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-146088746',owner_user_name='tempest-ServersNegativeTestJSON-146088746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:19:54Z,user_data=None,user_id='24aa8ca42c7342fa91f5eab19b6c0c9b',uuid=20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "address": "fa:16:3e:36:90:f8", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585ae662-b7", "ovs_interfaceid": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Converting VIF {"id": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "address": "fa:16:3e:36:90:f8", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585ae662-b7", "ovs_interfaceid": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:90:f8,bridge_name='br-int',has_traffic_filtering=True,id=585ae662-b7ec-4f43-b5bd-5966bd473eb3,network=Network(b45a9bdc-c522-435b-8532-28ec9780b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap585ae662-b7') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG os_vif [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:90:f8,bridge_name='br-int',has_traffic_filtering=True,id=585ae662-b7ec-4f43-b5bd-5966bd473eb3,network=Network(b45a9bdc-c522-435b-8532-28ec9780b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap585ae662-b7') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1272de1-5d6b-5fd5-ad49-42404bad9592', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap585ae662-b7, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap585ae662-b7, col_values=(('qos', UUID('8874c89b-c1cd-40cb-b0cb-57464d24e538')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap585ae662-b7, col_values=(('external_ids', {'iface-id': '585ae662-b7ec-4f43-b5bd-5966bd473eb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:90:f8', 'vm-uuid': '20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:56 user nova-compute[75571]: INFO os_vif [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:90:f8,bridge_name='br-int',has_traffic_filtering=True,id=585ae662-b7ec-4f43-b5bd-5966bd473eb3,network=Network(b45a9bdc-c522-435b-8532-28ec9780b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap585ae662-b7')
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:19:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] No VIF found with MAC fa:16:3e:36:90:f8, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:19:57 user nova-compute[75571]: DEBUG nova.network.neutron [req-ff6c1348-ea8e-43c5-84d9-34d30936e2ad req-4ee1cfac-0af6-4232-a0ff-75fd99e620b6 service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Updated VIF entry in instance network info cache for port 585ae662-b7ec-4f43-b5bd-5966bd473eb3. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:19:57 user nova-compute[75571]: DEBUG nova.network.neutron [req-ff6c1348-ea8e-43c5-84d9-34d30936e2ad req-4ee1cfac-0af6-4232-a0ff-75fd99e620b6 service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Updating instance_info_cache with network_info: [{"id": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "address": "fa:16:3e:36:90:f8", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585ae662-b7", "ovs_interfaceid": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:19:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ff6c1348-ea8e-43c5-84d9-34d30936e2ad req-4ee1cfac-0af6-4232-a0ff-75fd99e620b6 service nova] Releasing lock "refresh_cache-20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:19:57 user nova-compute[75571]: DEBUG nova.compute.manager [req-4ab46b9f-0455-4410-800e-73a57e5e2f3a req-01f345f5-2269-431b-bfba-08002a4447bf service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-changed-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:57 user nova-compute[75571]: DEBUG nova.compute.manager [req-4ab46b9f-0455-4410-800e-73a57e5e2f3a req-01f345f5-2269-431b-bfba-08002a4447bf service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Refreshing instance network info cache due to event network-changed-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:19:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4ab46b9f-0455-4410-800e-73a57e5e2f3a req-01f345f5-2269-431b-bfba-08002a4447bf service nova] Acquiring lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:19:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4ab46b9f-0455-4410-800e-73a57e5e2f3a req-01f345f5-2269-431b-bfba-08002a4447bf service nova] Acquired lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:19:57 user nova-compute[75571]: DEBUG nova.network.neutron [req-4ab46b9f-0455-4410-800e-73a57e5e2f3a req-01f345f5-2269-431b-bfba-08002a4447bf service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Refreshing network info cache for port 1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:19:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:19:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:19:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:58 user nova-compute[75571]: DEBUG nova.network.neutron [req-4ab46b9f-0455-4410-800e-73a57e5e2f3a req-01f345f5-2269-431b-bfba-08002a4447bf service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updated VIF entry in instance network info cache for port 1fbed4dc-8f66-4490-88f7-a0c4ae19fde9. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:19:58 user nova-compute[75571]: DEBUG nova.network.neutron [req-4ab46b9f-0455-4410-800e-73a57e5e2f3a req-01f345f5-2269-431b-bfba-08002a4447bf service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updating instance_info_cache with network_info: [{"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:19:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4ab46b9f-0455-4410-800e-73a57e5e2f3a req-01f345f5-2269-431b-bfba-08002a4447bf service nova] Releasing lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:19:58 user nova-compute[75571]: DEBUG nova.compute.manager [req-d5946a3f-c0f4-4fe4-9d72-c14c9c9d62b9 req-d20720b5-1f5f-4a79-a86d-b323c30f24df service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Received event network-vif-plugged-585ae662-b7ec-4f43-b5bd-5966bd473eb3 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:19:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d5946a3f-c0f4-4fe4-9d72-c14c9c9d62b9 req-d20720b5-1f5f-4a79-a86d-b323c30f24df service nova] Acquiring lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d5946a3f-c0f4-4fe4-9d72-c14c9c9d62b9 req-d20720b5-1f5f-4a79-a86d-b323c30f24df service nova] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d5946a3f-c0f4-4fe4-9d72-c14c9c9d62b9 req-d20720b5-1f5f-4a79-a86d-b323c30f24df service nova] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:58 user nova-compute[75571]: DEBUG nova.compute.manager [req-d5946a3f-c0f4-4fe4-9d72-c14c9c9d62b9 req-d20720b5-1f5f-4a79-a86d-b323c30f24df service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] No waiting events found dispatching network-vif-plugged-585ae662-b7ec-4f43-b5bd-5966bd473eb3 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:19:58 user nova-compute[75571]: WARNING nova.compute.manager [req-d5946a3f-c0f4-4fe4-9d72-c14c9c9d62b9 req-d20720b5-1f5f-4a79-a86d-b323c30f24df service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Received unexpected event network-vif-plugged-585ae662-b7ec-4f43-b5bd-5966bd473eb3 for instance with vm_state building and task_state spawning.
Nov 28 20:19:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.compute.manager [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:19:59 user nova-compute[75571]: INFO nova.compute.manager [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] instance snapshotting
Nov 28 20:19:59 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Beginning live snapshot process
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.compute.manager [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:19:59 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Creating image(s)
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Ensure instance console log exists: /opt/stack/data/nova/instances/f95d416b-d3b7-4b16-adc7-83a06088e167/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Start _get_guest_xml network_info=[{"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhaHYKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f95d416b-d3b7-4b16-adc7-83a06088e167', 'attached_at': '', 'detached_at': '', 'volume_id': 'eaa2b1ac-220a-42a8-99fd-893e37359fd9', 'serial': 'eaa2b1ac-220a-42a8-99fd-893e37359fd9'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'f97ef80c-fb52-4322-a5a0-e8a789819269', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:19:59 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:19:59 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhaHYKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:19:59 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:19:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:19:59 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:19:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:19:59 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:19:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3a72f0-fcd8-4956-b5d1-48327a31d2e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:19:59 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eda605-71bd-4c55-82fc-bd74b3778c21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9] added
Nov 28 20:19:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bc18e8-28fa-4b48-9e2e-d45a1fe348f1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:19:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e659c245-d506-45f5-96be-68a70306c59a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oVhaHYKk {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oVhaHYKk" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec79a351-4e5a-479c-8a51-6c15c0bb2bf9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oVhaHYKk'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json -f qcow2 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb5e530-29cf-4c4d-a35c-52aca8fb82d2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d32c68c-7c73-4116-acae-03958055a542]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:20:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:20:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6c7ccd-01f2-4073-99e2-df86c614eac5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260]
Nov 28 20:20:00 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260] successful.
Nov 28 20:20:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json -f qcow2 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8079294c-5794-4a42-9316-94576da89ce8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2280a38-36ad-4712-a278-a0b07c74fcc3]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:20:00 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:20:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:20:00 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:20:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[53215def-ecf5-4809-9813-d48a09d8e325]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhaHYKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG nova.compute.manager [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.223s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy8xwmunb/037fd77f43be4a52bbd236dd418f9b31.delta 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy8xwmunb/037fd77f43be4a52bbd236dd418f9b31.delta 1073741824" returned: 0 in 0.057s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:00 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 20:20:00 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Instance spawned successfully.
Nov 28 20:20:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-a191e11d-0212-4a31-a061-60876b0cc65d req-68dc3232-1bef-4c38-87f1-77fe32c139d6 service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Received event network-vif-plugged-585ae662-b7ec-4f43-b5bd-5966bd473eb3 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a191e11d-0212-4a31-a061-60876b0cc65d req-68dc3232-1bef-4c38-87f1-77fe32c139d6 service nova] Acquiring lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a191e11d-0212-4a31-a061-60876b0cc65d req-68dc3232-1bef-4c38-87f1-77fe32c139d6 service nova] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a191e11d-0212-4a31-a061-60876b0cc65d req-68dc3232-1bef-4c38-87f1-77fe32c139d6 service nova] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-a191e11d-0212-4a31-a061-60876b0cc65d req-68dc3232-1bef-4c38-87f1-77fe32c139d6 service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] No waiting events found dispatching network-vif-plugged-585ae662-b7ec-4f43-b5bd-5966bd473eb3 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:20:00 user nova-compute[75571]: WARNING nova.compute.manager [req-a191e11d-0212-4a31-a061-60876b0cc65d req-68dc3232-1bef-4c38-87f1-77fe32c139d6 service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Received unexpected event network-vif-plugged-585ae662-b7ec-4f43-b5bd-5966bd473eb3 for instance with vm_state building and task_state spawning.
Nov 28 20:20:00 user nova-compute[75571]: INFO nova.compute.manager [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 28 20:20:00 user nova-compute[75571]: DEBUG nova.compute.manager [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:20:00 user nova-compute[75571]: INFO nova.compute.manager [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Took 7.32 seconds to build instance.
Nov 28 20:20:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.422s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating instance_info_cache with network_info: [{"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '26636633632386330', 'path': '/dev/sdc'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636633632386330', 'path': '/dev/sdc'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1766072383',display_name='tempest-TestShelveInstance-server-1766072383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1766072383',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmRcrC+xEv9eq37KyVT3MN4g49xlT+tn2VHmIKI8IcmxomxVAiv7jCoA2CnKkM7knNVo8lhq5y0km1V+3OkdmA2AikbyaTLdfflHbz5DT3b54IbjGqVSR4M2T2o8iHZcQ==',key_name='tempest-TestShelveInstance-752726007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bcf01c7a7d24806a2ffe82ec75c8a51',ramdisk_id='',reservation_id='r-6nppqoc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1960669737',owner_user_name='tempest-TestShelveInstance-1960669737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:19:52Z,user_data=None,user_id='ca4e178401f940438a766a048076af93',uuid=f95d416b-d3b7-4b16-adc7-83a06088e167,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Converting VIF {"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:2e:14,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f,network=Network(559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6a23-8c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG nova.objects.instance [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lazy-loading 'pci_devices' on Instance uuid f95d416b-d3b7-4b16-adc7-83a06088e167 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:20:01 user nova-compute[75571]:   <uuid>f95d416b-d3b7-4b16-adc7-83a06088e167</uuid>
Nov 28 20:20:01 user nova-compute[75571]:   <name>instance-00000018</name>
Nov 28 20:20:01 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:20:01 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:20:01 user nova-compute[75571]:   <metadata>
Nov 28 20:20:01 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:20:01 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:20:01 user nova-compute[75571]:       <nova:name>tempest-TestShelveInstance-server-1766072383</nova:name>
Nov 28 20:20:01 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:19:59</nova:creationTime>
Nov 28 20:20:01 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:20:01 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:20:01 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:20:01 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:20:01 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:20:01 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:20:01 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:20:01 user nova-compute[75571]:       <nova:owner>
Nov 28 20:20:01 user nova-compute[75571]:         <nova:user uuid="ca4e178401f940438a766a048076af93">tempest-TestShelveInstance-1960669737-project-member</nova:user>
Nov 28 20:20:01 user nova-compute[75571]:         <nova:project uuid="8bcf01c7a7d24806a2ffe82ec75c8a51">tempest-TestShelveInstance-1960669737</nova:project>
Nov 28 20:20:01 user nova-compute[75571]:       </nova:owner>
Nov 28 20:20:01 user nova-compute[75571]:       <nova:ports>
Nov 28 20:20:01 user nova-compute[75571]:         <nova:port uuid="4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f">
Nov 28 20:20:01 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 20:20:01 user nova-compute[75571]:         </nova:port>
Nov 28 20:20:01 user nova-compute[75571]:       </nova:ports>
Nov 28 20:20:01 user nova-compute[75571]:     </nova:instance>
Nov 28 20:20:01 user nova-compute[75571]:   </metadata>
Nov 28 20:20:01 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:20:01 user nova-compute[75571]:     <system>
Nov 28 20:20:01 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:20:01 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:20:01 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:20:01 user nova-compute[75571]:       <entry name="serial">f95d416b-d3b7-4b16-adc7-83a06088e167</entry>
Nov 28 20:20:01 user nova-compute[75571]:       <entry name="uuid">f95d416b-d3b7-4b16-adc7-83a06088e167</entry>
Nov 28 20:20:01 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:20:01 user nova-compute[75571]:     </system>
Nov 28 20:20:01 user nova-compute[75571]:   </sysinfo>
Nov 28 20:20:01 user nova-compute[75571]:   <os>
Nov 28 20:20:01 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:20:01 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:20:01 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:20:01 user nova-compute[75571]:   </os>
Nov 28 20:20:01 user nova-compute[75571]:   <features>
Nov 28 20:20:01 user nova-compute[75571]:     <acpi/>
Nov 28 20:20:01 user nova-compute[75571]:     <apic/>
Nov 28 20:20:01 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:20:01 user nova-compute[75571]:   </features>
Nov 28 20:20:01 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:20:01 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:20:01 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:20:01 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:20:01 user nova-compute[75571]:   </clock>
Nov 28 20:20:01 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:20:01 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:20:01 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:20:01 user nova-compute[75571]:   </cpu>
Nov 28 20:20:01 user nova-compute[75571]:   <devices>
Nov 28 20:20:01 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:20:01 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:20:01 user nova-compute[75571]:       <source dev="/dev/sdc"/>
Nov 28 20:20:01 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:20:01 user nova-compute[75571]:       <serial>eaa2b1ac-220a-42a8-99fd-893e37359fd9</serial>
Nov 28 20:20:01 user nova-compute[75571]:     </disk>
Nov 28 20:20:01 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:20:01 user nova-compute[75571]:       <mac address="fa:16:3e:2d:2e:14"/>
Nov 28 20:20:01 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:20:01 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:20:01 user nova-compute[75571]:       <target dev="tap4f3e6a23-8c"/>
Nov 28 20:20:01 user nova-compute[75571]:     </interface>
Nov 28 20:20:01 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:20:01 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/f95d416b-d3b7-4b16-adc7-83a06088e167/console.log" append="off"/>
Nov 28 20:20:01 user nova-compute[75571]:     </serial>
Nov 28 20:20:01 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:20:01 user nova-compute[75571]:     <video>
Nov 28 20:20:01 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:20:01 user nova-compute[75571]:     </video>
Nov 28 20:20:01 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:20:01 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:20:01 user nova-compute[75571]:     </rng>
Nov 28 20:20:01 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:20:01 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:20:01 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:20:01 user nova-compute[75571]:     </memballoon>
Nov 28 20:20:01 user nova-compute[75571]:   </devices>
Nov 28 20:20:01 user nova-compute[75571]: </domain>
Nov 28 20:20:01 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1766072383',display_name='tempest-TestShelveInstance-server-1766072383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1766072383',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmRcrC+xEv9eq37KyVT3MN4g49xlT+tn2VHmIKI8IcmxomxVAiv7jCoA2CnKkM7knNVo8lhq5y0km1V+3OkdmA2AikbyaTLdfflHbz5DT3b54IbjGqVSR4M2T2o8iHZcQ==',key_name='tempest-TestShelveInstance-752726007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bcf01c7a7d24806a2ffe82ec75c8a51',ramdisk_id='',reservation_id='r-6nppqoc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1960669737',owner_user_name='tempest-TestShelveInstance-1960669737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:19:52Z,user_data=None,user_id='ca4e178401f940438a766a048076af93',uuid=f95d416b-d3b7-4b16-adc7-83a06088e167,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Converting VIF {"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:2e:14,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f,network=Network(559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6a23-8c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG os_vif [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:2e:14,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f,network=Network(559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6a23-8c') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae60e7eb-b17d-5de4-ad60-5e007b92109b', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f3e6a23-8c, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f3e6a23-8c, col_values=(('qos', UUID('de741200-d23f-4358-875d-3d4b05809483')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f3e6a23-8c, col_values=(('external_ids', {'iface-id': '4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:2e:14', 'vm-uuid': 'f95d416b-d3b7-4b16-adc7-83a06088e167'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:01 user nova-compute[75571]: INFO os_vif [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:2e:14,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f,network=Network(559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6a23-8c')
Nov 28 20:20:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:20:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] No VIF found with MAC fa:16:3e:2d:2e:14, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:20:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] COPY block job progress, current cursor: 46923776 final cursor: 75497472 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:20:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:20:02 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 20:20:02 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:20:02 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy8xwmunb/037fd77f43be4a52bbd236dd418f9b31.delta /opt/stack/data/nova/instances/snapshots/tmpy8xwmunb/037fd77f43be4a52bbd236dd418f9b31 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy8xwmunb/037fd77f43be4a52bbd236dd418f9b31.delta /opt/stack/data/nova/instances/snapshots/tmpy8xwmunb/037fd77f43be4a52bbd236dd418f9b31" returned: 0 in 0.593s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:03 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Snapshot extracted, beginning image upload
Nov 28 20:20:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-2454f814-8a03-41f9-807d-195b5fcb783c req-b71309c6-0bb4-496a-b652-a165c1716a4b service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2454f814-8a03-41f9-807d-195b5fcb783c req-b71309c6-0bb4-496a-b652-a165c1716a4b service nova] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2454f814-8a03-41f9-807d-195b5fcb783c req-b71309c6-0bb4-496a-b652-a165c1716a4b service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2454f814-8a03-41f9-807d-195b5fcb783c req-b71309c6-0bb4-496a-b652-a165c1716a4b service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-2454f814-8a03-41f9-807d-195b5fcb783c req-b71309c6-0bb4-496a-b652-a165c1716a4b service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] No waiting events found dispatching network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:20:03 user nova-compute[75571]: WARNING nova.compute.manager [req-2454f814-8a03-41f9-807d-195b5fcb783c req-b71309c6-0bb4-496a-b652-a165c1716a4b service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received unexpected event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance with vm_state building and task_state spawning.
Nov 28 20:20:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:20:05 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Instance spawned successfully.
Nov 28 20:20:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-3dc0d76f-2f42-4768-a270-cff85f6b726e req-d3a5eded-37c6-4e43-918e-510c38f912d4 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3dc0d76f-2f42-4768-a270-cff85f6b726e req-d3a5eded-37c6-4e43-918e-510c38f912d4 service nova] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3dc0d76f-2f42-4768-a270-cff85f6b726e req-d3a5eded-37c6-4e43-918e-510c38f912d4 service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3dc0d76f-2f42-4768-a270-cff85f6b726e req-d3a5eded-37c6-4e43-918e-510c38f912d4 service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-3dc0d76f-2f42-4768-a270-cff85f6b726e req-d3a5eded-37c6-4e43-918e-510c38f912d4 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] No waiting events found dispatching network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:20:05 user nova-compute[75571]: WARNING nova.compute.manager [req-3dc0d76f-2f42-4768-a270-cff85f6b726e req-d3a5eded-37c6-4e43-918e-510c38f912d4 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received unexpected event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance with vm_state building and task_state spawning.
Nov 28 20:20:05 user nova-compute[75571]: INFO nova.compute.manager [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 28 20:20:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:05 user nova-compute[75571]: INFO nova.compute.manager [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Took 15.06 seconds to build instance.
Nov 28 20:20:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.176s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:06 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Snapshot image upload complete
Nov 28 20:20:06 user nova-compute[75571]: INFO nova.compute.manager [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Took 6.62 seconds to snapshot the instance on the hypervisor.
Nov 28 20:20:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:20:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-25bf1ec0-6288-4099-906a-2d6d91422990 req-4a8304b1-2026-44b8-b890-2cb483880fd2 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received event network-changed-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-25bf1ec0-6288-4099-906a-2d6d91422990 req-4a8304b1-2026-44b8-b890-2cb483880fd2 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Refreshing instance network info cache due to event network-changed-11217ca7-1cb1-404d-8a7c-a8a33ff80098. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-25bf1ec0-6288-4099-906a-2d6d91422990 req-4a8304b1-2026-44b8-b890-2cb483880fd2 service nova] Acquiring lock "refresh_cache-a8112c4a-cb42-49df-81a7-97b42f5cc87d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-25bf1ec0-6288-4099-906a-2d6d91422990 req-4a8304b1-2026-44b8-b890-2cb483880fd2 service nova] Acquired lock "refresh_cache-a8112c4a-cb42-49df-81a7-97b42f5cc87d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.network.neutron [req-25bf1ec0-6288-4099-906a-2d6d91422990 req-4a8304b1-2026-44b8-b890-2cb483880fd2 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Refreshing network info cache for port 11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:08 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:20:08 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=7689MB free_disk=25.156349182128906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:08 user nova-compute[75571]: INFO nova.compute.manager [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Terminating instance
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.manager [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Applying migration context for instance 40ac5386-d43f-443c-ac15-186b368728f8 as it has an incoming, in-progress migration 673ad9be-bcb1-471c-ac1b-1ba267fcdb40. Migration status is finished {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 20:20:08 user nova-compute[75571]: INFO nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating resource usage from migration 673ad9be-bcb1-471c-ac1b-1ba267fcdb40
Nov 28 20:20:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance a8112c4a-cb42-49df-81a7-97b42f5cc87d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 86c31e96-70cf-45fd-9578-194706af2ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Migration 673ad9be-bcb1-471c-ac1b-1ba267fcdb40 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 40ac5386-d43f-443c-ac15-186b368728f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance f95d416b-d3b7-4b16-adc7-83a06088e167 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.network.neutron [req-25bf1ec0-6288-4099-906a-2d6d91422990 req-4a8304b1-2026-44b8-b890-2cb483880fd2 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Updated VIF entry in instance network info cache for port 11217ca7-1cb1-404d-8a7c-a8a33ff80098. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.network.neutron [req-25bf1ec0-6288-4099-906a-2d6d91422990 req-4a8304b1-2026-44b8-b890-2cb483880fd2 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Updating instance_info_cache with network_info: [{"id": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "address": "fa:16:3e:f7:a3:4b", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11217ca7-1c", "ovs_interfaceid": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-25bf1ec0-6288-4099-906a-2d6d91422990 req-4a8304b1-2026-44b8-b890-2cb483880fd2 service nova] Releasing lock "refresh_cache-a8112c4a-cb42-49df-81a7-97b42f5cc87d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:08 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Instance destroyed successfully.
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.objects.instance [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lazy-loading 'resources' on Instance uuid a8112c4a-cb42-49df-81a7-97b42f5cc87d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-693276343',display_name='tempest-TestStampPattern-server-693276343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-693276343',id=11,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKHSIcqSS6r5Xbk8DWkPtgQAYtxPI66k2MpIys7luJ+eXKJCwl3YX7s+WE2XtlqbyhCHYbp1Jbg6h1ZtUXzTkBXgQiD1zygrVkmZ1u0tehRUXvexgqD4sXlJ9Q5zsLuRw==',key_name='tempest-TestStampPattern-550063434',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:13:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='742419219fb94804bef60efd10716a41',ramdisk_id='',reservation_id='r-t59romih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-152273837',owner_user_name='tempest-TestStampPattern-152273837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:16:08Z,user_data=None,user_id='29664fb367db470abbd15cfbf39dd38a',uuid=a8112c4a-cb42-49df-81a7-97b42f5cc87d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "address": "fa:16:3e:f7:a3:4b", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11217ca7-1c", "ovs_interfaceid": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Converting VIF {"id": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "address": "fa:16:3e:f7:a3:4b", "network": {"id": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85", "bridge": "br-int", "label": "tempest-TestStampPattern-116809130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742419219fb94804bef60efd10716a41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11217ca7-1c", "ovs_interfaceid": "11217ca7-1cb1-404d-8a7c-a8a33ff80098", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:a3:4b,bridge_name='br-int',has_traffic_filtering=True,id=11217ca7-1cb1-404d-8a7c-a8a33ff80098,network=Network(3f7305f6-e668-4fc6-82bd-f6f519c2bd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11217ca7-1c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG os_vif [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:a3:4b,bridge_name='br-int',has_traffic_filtering=True,id=11217ca7-1cb1-404d-8a7c-a8a33ff80098,network=Network(3f7305f6-e668-4fc6-82bd-f6f519c2bd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11217ca7-1c') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11217ca7-1c, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4a4c230-eef7-4340-89ba-2ecbbb0d6288) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:20:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:08 user nova-compute[75571]: INFO os_vif [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:a3:4b,bridge_name='br-int',has_traffic_filtering=True,id=11217ca7-1cb1-404d-8a7c-a8a33ff80098,network=Network(3f7305f6-e668-4fc6-82bd-f6f519c2bd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11217ca7-1c')
Nov 28 20:20:08 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Deleting instance files /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d_del
Nov 28 20:20:08 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Deletion of /opt/stack/data/nova/instances/a8112c4a-cb42-49df-81a7-97b42f5cc87d_del complete
Nov 28 20:20:09 user nova-compute[75571]: INFO nova.compute.manager [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received event network-vif-unplugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Acquiring lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] No waiting events found dispatching network-vif-unplugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received event network-vif-unplugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received event network-vif-plugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Acquiring lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] No waiting events found dispatching network-vif-plugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:20:09 user nova-compute[75571]: WARNING nova.compute.manager [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received unexpected event network-vif-plugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance with vm_state active and task_state deleting.
Nov 28 20:20:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received event network-vif-plugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Acquiring lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] No waiting events found dispatching network-vif-plugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:20:09 user nova-compute[75571]: WARNING nova.compute.manager [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received unexpected event network-vif-plugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance with vm_state active and task_state deleting.
Nov 28 20:20:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received event network-vif-plugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Acquiring lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] No waiting events found dispatching network-vif-plugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:20:09 user nova-compute[75571]: WARNING nova.compute.manager [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received unexpected event network-vif-plugged-11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance with vm_state active and task_state deleting.
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:20:09 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Took 0.66 seconds to deallocate network for instance.
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:10 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:20:10 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:20:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:10 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Deleted allocations for instance a8112c4a-cb42-49df-81a7-97b42f5cc87d
Nov 28 20:20:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "a8112c4a-cb42-49df-81a7-97b42f5cc87d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.343s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:11 user nova-compute[75571]: DEBUG nova.compute.manager [req-0eb738f6-8ff4-46f0-8b78-ed6ea99839d9 req-ba0b5dab-d6e8-486e-9350-3c5f43e24f68 service nova] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Received event network-vif-deleted-11217ca7-1cb1-404d-8a7c-a8a33ff80098 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:20:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:17 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:20:17 user nova-compute[75571]: INFO nova.compute.claims [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Claim successful on node user
Nov 28 20:20:18 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG nova.network.neutron [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:20:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:20:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG nova.policy [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '740070b2e6434ca9a733cb932663572c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f7955f73e434cb014eeaeffa2824f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:20:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Creating image(s)
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "/opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "/opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.202s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk 1073741824" returned: 0 in 0.046s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG nova.network.neutron [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Successfully created port: 0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:20:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Cannot resize image /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Ensure instance console log exists: /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG nova.network.neutron [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Successfully updated port: 0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "refresh_cache-2f47c1e6-8450-4e8c-bfc7-99041345ab4f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquired lock "refresh_cache-2f47c1e6-8450-4e8c-bfc7-99041345ab4f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG nova.network.neutron [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-bb908d98-0050-4a39-9558-b8046ca48f2d req-3837c903-8154-4f5b-a3d7-41b55f97ecd6 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Received event network-changed-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-bb908d98-0050-4a39-9558-b8046ca48f2d req-3837c903-8154-4f5b-a3d7-41b55f97ecd6 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Refreshing instance network info cache due to event network-changed-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bb908d98-0050-4a39-9558-b8046ca48f2d req-3837c903-8154-4f5b-a3d7-41b55f97ecd6 service nova] Acquiring lock "refresh_cache-2f47c1e6-8450-4e8c-bfc7-99041345ab4f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:20:19 user nova-compute[75571]: DEBUG nova.network.neutron [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Updating instance_info_cache with network_info: [{"id": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "address": "fa:16:3e:e7:9f:a8", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2c8a4a-7c", "ovs_interfaceid": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Releasing lock "refresh_cache-2f47c1e6-8450-4e8c-bfc7-99041345ab4f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Instance network_info: |[{"id": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "address": "fa:16:3e:e7:9f:a8", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2c8a4a-7c", "ovs_interfaceid": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bb908d98-0050-4a39-9558-b8046ca48f2d req-3837c903-8154-4f5b-a3d7-41b55f97ecd6 service nova] Acquired lock "refresh_cache-2f47c1e6-8450-4e8c-bfc7-99041345ab4f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.network.neutron [req-bb908d98-0050-4a39-9558-b8046ca48f2d req-3837c903-8154-4f5b-a3d7-41b55f97ecd6 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Refreshing network info cache for port 0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Start _get_guest_xml network_info=[{"id": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "address": "fa:16:3e:e7:9f:a8", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2c8a4a-7c", "ovs_interfaceid": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:20:20 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:20:20 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1332545386',display_name='tempest-VolumesSnapshotTestJSON-instance-1332545386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1332545386',id=26,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEe+U0yATBZxQ9869JR+Ry2x+zXaAsyzCIkLVlxJuCzBwEDsBg6c7RuNJ8gA/Szm2NBEa0jvxejV7Y8Q4TuJC8bs5g+QCEs7wblJAv8NhiTw7iVdzrfIqdsDfMskYQkNvA==',key_name='tempest-keypair-1730482313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548f7955f73e434cb014eeaeffa2824f',ramdisk_id='',reservation_id='r-dnn01gs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2135983630',owner_user_name='tempest-VolumesSnapshotTestJSON-2135983630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:20:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='740070b2e6434ca9a733cb932663572c',uuid=2f47c1e6-8450-4e8c-bfc7-99041345ab4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "address": "fa:16:3e:e7:9f:a8", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2c8a4a-7c", "ovs_interfaceid": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Converting VIF {"id": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "address": "fa:16:3e:e7:9f:a8", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2c8a4a-7c", "ovs_interfaceid": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9f:a8,bridge_name='br-int',has_traffic_filtering=True,id=0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf,network=Network(80eb1442-8e05-4d31-96b5-26df5f47f887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2c8a4a-7c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.objects.instance [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f47c1e6-8450-4e8c-bfc7-99041345ab4f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:20:20 user nova-compute[75571]:   <uuid>2f47c1e6-8450-4e8c-bfc7-99041345ab4f</uuid>
Nov 28 20:20:20 user nova-compute[75571]:   <name>instance-0000001a</name>
Nov 28 20:20:20 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:20:20 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:20:20 user nova-compute[75571]:   <metadata>
Nov 28 20:20:20 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:20:20 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:20:20 user nova-compute[75571]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1332545386</nova:name>
Nov 28 20:20:20 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:20:20</nova:creationTime>
Nov 28 20:20:20 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:20:20 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:20:20 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:20:20 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:20:20 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:20:20 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:20:20 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:20:20 user nova-compute[75571]:       <nova:owner>
Nov 28 20:20:20 user nova-compute[75571]:         <nova:user uuid="740070b2e6434ca9a733cb932663572c">tempest-VolumesSnapshotTestJSON-2135983630-project-member</nova:user>
Nov 28 20:20:20 user nova-compute[75571]:         <nova:project uuid="548f7955f73e434cb014eeaeffa2824f">tempest-VolumesSnapshotTestJSON-2135983630</nova:project>
Nov 28 20:20:20 user nova-compute[75571]:       </nova:owner>
Nov 28 20:20:20 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:20:20 user nova-compute[75571]:       <nova:ports>
Nov 28 20:20:20 user nova-compute[75571]:         <nova:port uuid="0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf">
Nov 28 20:20:20 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 20:20:20 user nova-compute[75571]:         </nova:port>
Nov 28 20:20:20 user nova-compute[75571]:       </nova:ports>
Nov 28 20:20:20 user nova-compute[75571]:     </nova:instance>
Nov 28 20:20:20 user nova-compute[75571]:   </metadata>
Nov 28 20:20:20 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:20:20 user nova-compute[75571]:     <system>
Nov 28 20:20:20 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:20:20 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:20:20 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:20:20 user nova-compute[75571]:       <entry name="serial">2f47c1e6-8450-4e8c-bfc7-99041345ab4f</entry>
Nov 28 20:20:20 user nova-compute[75571]:       <entry name="uuid">2f47c1e6-8450-4e8c-bfc7-99041345ab4f</entry>
Nov 28 20:20:20 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:20:20 user nova-compute[75571]:     </system>
Nov 28 20:20:20 user nova-compute[75571]:   </sysinfo>
Nov 28 20:20:20 user nova-compute[75571]:   <os>
Nov 28 20:20:20 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:20:20 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:20:20 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:20:20 user nova-compute[75571]:   </os>
Nov 28 20:20:20 user nova-compute[75571]:   <features>
Nov 28 20:20:20 user nova-compute[75571]:     <acpi/>
Nov 28 20:20:20 user nova-compute[75571]:     <apic/>
Nov 28 20:20:20 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:20:20 user nova-compute[75571]:   </features>
Nov 28 20:20:20 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:20:20 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:20:20 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:20:20 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:20:20 user nova-compute[75571]:   </clock>
Nov 28 20:20:20 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:20:20 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:20:20 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:20:20 user nova-compute[75571]:   </cpu>
Nov 28 20:20:20 user nova-compute[75571]:   <devices>
Nov 28 20:20:20 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:20:20 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:20:20 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk"/>
Nov 28 20:20:20 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:20:20 user nova-compute[75571]:     </disk>
Nov 28 20:20:20 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:20:20 user nova-compute[75571]:       <mac address="fa:16:3e:e7:9f:a8"/>
Nov 28 20:20:20 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:20:20 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:20:20 user nova-compute[75571]:       <target dev="tap0a2c8a4a-7c"/>
Nov 28 20:20:20 user nova-compute[75571]:     </interface>
Nov 28 20:20:20 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:20:20 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/console.log" append="off"/>
Nov 28 20:20:20 user nova-compute[75571]:     </serial>
Nov 28 20:20:20 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:20:20 user nova-compute[75571]:     <video>
Nov 28 20:20:20 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:20:20 user nova-compute[75571]:     </video>
Nov 28 20:20:20 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:20:20 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:20:20 user nova-compute[75571]:     </rng>
Nov 28 20:20:20 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:20:20 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:20:20 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:20:20 user nova-compute[75571]:     </memballoon>
Nov 28 20:20:20 user nova-compute[75571]:   </devices>
Nov 28 20:20:20 user nova-compute[75571]: </domain>
Nov 28 20:20:20 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1332545386',display_name='tempest-VolumesSnapshotTestJSON-instance-1332545386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1332545386',id=26,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEe+U0yATBZxQ9869JR+Ry2x+zXaAsyzCIkLVlxJuCzBwEDsBg6c7RuNJ8gA/Szm2NBEa0jvxejV7Y8Q4TuJC8bs5g+QCEs7wblJAv8NhiTw7iVdzrfIqdsDfMskYQkNvA==',key_name='tempest-keypair-1730482313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548f7955f73e434cb014eeaeffa2824f',ramdisk_id='',reservation_id='r-dnn01gs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2135983630',owner_user_name='tempest-VolumesSnapshotTestJSON-2135983630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:20:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='740070b2e6434ca9a733cb932663572c',uuid=2f47c1e6-8450-4e8c-bfc7-99041345ab4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "address": "fa:16:3e:e7:9f:a8", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2c8a4a-7c", "ovs_interfaceid": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Converting VIF {"id": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "address": "fa:16:3e:e7:9f:a8", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2c8a4a-7c", "ovs_interfaceid": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9f:a8,bridge_name='br-int',has_traffic_filtering=True,id=0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf,network=Network(80eb1442-8e05-4d31-96b5-26df5f47f887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2c8a4a-7c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG os_vif [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9f:a8,bridge_name='br-int',has_traffic_filtering=True,id=0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf,network=Network(80eb1442-8e05-4d31-96b5-26df5f47f887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2c8a4a-7c') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd78d15f2-81c9-5e9a-a576-810be7bdfefa', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a2c8a4a-7c, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a2c8a4a-7c, col_values=(('qos', UUID('08661d33-2863-4cf2-9d65-5cd38c7ebae1')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a2c8a4a-7c, col_values=(('external_ids', {'iface-id': '0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:9f:a8', 'vm-uuid': '2f47c1e6-8450-4e8c-bfc7-99041345ab4f'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:20 user nova-compute[75571]: INFO os_vif [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:9f:a8,bridge_name='br-int',has_traffic_filtering=True,id=0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf,network=Network(80eb1442-8e05-4d31-96b5-26df5f47f887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2c8a4a-7c')
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] No VIF found with MAC fa:16:3e:e7:9f:a8, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.network.neutron [req-bb908d98-0050-4a39-9558-b8046ca48f2d req-3837c903-8154-4f5b-a3d7-41b55f97ecd6 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Updated VIF entry in instance network info cache for port 0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG nova.network.neutron [req-bb908d98-0050-4a39-9558-b8046ca48f2d req-3837c903-8154-4f5b-a3d7-41b55f97ecd6 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Updating instance_info_cache with network_info: [{"id": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "address": "fa:16:3e:e7:9f:a8", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2c8a4a-7c", "ovs_interfaceid": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:20:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bb908d98-0050-4a39-9558-b8046ca48f2d req-3837c903-8154-4f5b-a3d7-41b55f97ecd6 service nova] Releasing lock "refresh_cache-2f47c1e6-8450-4e8c-bfc7-99041345ab4f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:20:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-598afd9d-59b9-4f75-89f4-b6930ffe959f req-de5005fc-71fb-494e-b1e1-10d8e5a38533 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Received event network-vif-plugged-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-598afd9d-59b9-4f75-89f4-b6930ffe959f req-de5005fc-71fb-494e-b1e1-10d8e5a38533 service nova] Acquiring lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-598afd9d-59b9-4f75-89f4-b6930ffe959f req-de5005fc-71fb-494e-b1e1-10d8e5a38533 service nova] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-598afd9d-59b9-4f75-89f4-b6930ffe959f req-de5005fc-71fb-494e-b1e1-10d8e5a38533 service nova] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-598afd9d-59b9-4f75-89f4-b6930ffe959f req-de5005fc-71fb-494e-b1e1-10d8e5a38533 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] No waiting events found dispatching network-vif-plugged-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:20:21 user nova-compute[75571]: WARNING nova.compute.manager [req-598afd9d-59b9-4f75-89f4-b6930ffe959f req-de5005fc-71fb-494e-b1e1-10d8e5a38533 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Received unexpected event network-vif-plugged-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf for instance with vm_state building and task_state spawning.
Nov 28 20:20:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:23 user nova-compute[75571]: DEBUG nova.compute.manager [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:20:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:20:23 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Instance spawned successfully.
Nov 28 20:20:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:20:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:23 user nova-compute[75571]: INFO nova.compute.manager [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 28 20:20:23 user nova-compute[75571]: DEBUG nova.compute.manager [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:20:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-2fcb7614-4cd9-480a-829a-75c2dfc9a8f2 req-595978f3-57f3-4ec5-925d-4ebfe461d4f5 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Received event network-vif-plugged-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2fcb7614-4cd9-480a-829a-75c2dfc9a8f2 req-595978f3-57f3-4ec5-925d-4ebfe461d4f5 service nova] Acquiring lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2fcb7614-4cd9-480a-829a-75c2dfc9a8f2 req-595978f3-57f3-4ec5-925d-4ebfe461d4f5 service nova] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2fcb7614-4cd9-480a-829a-75c2dfc9a8f2 req-595978f3-57f3-4ec5-925d-4ebfe461d4f5 service nova] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-2fcb7614-4cd9-480a-829a-75c2dfc9a8f2 req-595978f3-57f3-4ec5-925d-4ebfe461d4f5 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] No waiting events found dispatching network-vif-plugged-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:20:23 user nova-compute[75571]: WARNING nova.compute.manager [req-2fcb7614-4cd9-480a-829a-75c2dfc9a8f2 req-595978f3-57f3-4ec5-925d-4ebfe461d4f5 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Received unexpected event network-vif-plugged-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf for instance with vm_state building and task_state spawning.
Nov 28 20:20:23 user nova-compute[75571]: INFO nova.compute.manager [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Took 6.33 seconds to build instance.
Nov 28 20:20:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.429s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "313a065e-94f3-4435-97af-6a16de64ca7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:20:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:30 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:20:30 user nova-compute[75571]: INFO nova.compute.claims [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Claim successful on node user
Nov 28 20:20:30 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:20:30 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:20:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:20:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:20:30 user nova-compute[75571]: DEBUG nova.network.neutron [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:20:31 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:20:31 user nova-compute[75571]: DEBUG nova.compute.manager [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:20:31 user nova-compute[75571]: INFO nova.virt.block_device [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Booting with blank volume at /dev/vda
Nov 28 20:20:31 user nova-compute[75571]: DEBUG nova.policy [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:20:32 user nova-compute[75571]: DEBUG nova.network.neutron [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Successfully created port: d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:20:32 user nova-compute[75571]: DEBUG nova.network.neutron [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Successfully updated port: d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:20:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:20:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquired lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:20:32 user nova-compute[75571]: DEBUG nova.network.neutron [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:20:32 user nova-compute[75571]: DEBUG nova.compute.manager [req-09c4f48c-e5ef-48a5-b69d-532731da1d93 req-4ac0efec-dcaa-407e-b0e8-8d5ae4e4ebcb service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received event network-changed-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:32 user nova-compute[75571]: DEBUG nova.compute.manager [req-09c4f48c-e5ef-48a5-b69d-532731da1d93 req-4ac0efec-dcaa-407e-b0e8-8d5ae4e4ebcb service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Refreshing instance network info cache due to event network-changed-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:20:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-09c4f48c-e5ef-48a5-b69d-532731da1d93 req-4ac0efec-dcaa-407e-b0e8-8d5ae4e4ebcb service nova] Acquiring lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:20:32 user nova-compute[75571]: DEBUG nova.network.neutron [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:20:33 user nova-compute[75571]: DEBUG nova.network.neutron [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Updating instance_info_cache with network_info: [{"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:20:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Releasing lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:20:33 user nova-compute[75571]: DEBUG nova.compute.manager [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Instance network_info: |[{"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:20:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-09c4f48c-e5ef-48a5-b69d-532731da1d93 req-4ac0efec-dcaa-407e-b0e8-8d5ae4e4ebcb service nova] Acquired lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:20:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-09c4f48c-e5ef-48a5-b69d-532731da1d93 req-4ac0efec-dcaa-407e-b0e8-8d5ae4e4ebcb service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Refreshing network info cache for port d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:20:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-09c4f48c-e5ef-48a5-b69d-532731da1d93 req-4ac0efec-dcaa-407e-b0e8-8d5ae4e4ebcb service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Updated VIF entry in instance network info cache for port d8b8da62-7cf3-4b0d-81b0-181bc7f571bd. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:20:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-09c4f48c-e5ef-48a5-b69d-532731da1d93 req-4ac0efec-dcaa-407e-b0e8-8d5ae4e4ebcb service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Updating instance_info_cache with network_info: [{"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:20:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-09c4f48c-e5ef-48a5-b69d-532731da1d93 req-4ac0efec-dcaa-407e-b0e8-8d5ae4e4ebcb service nova] Releasing lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:20:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:36 user nova-compute[75571]: DEBUG os_brick.utils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:20:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[371164a5-96d5-4cf4-9065-9eb419c88cd2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43b8a3a-8328-4f70-8e94-8f977bc6e052]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f983eeea-8cde-440b-bc00-a78a8e192d29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6193299-4295-4a01-afbe-cf819dddec9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:20:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:20:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:20:37 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:20:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4f699d-81a8-4775-9327-e37032e8d48a]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:20:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:20:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:20:37 user nova-compute[75571]: DEBUG os_brick.utils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:20:37 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Updating existing volume attachment record: aab005a6-a964-4bd1-92f7-760c49c2a222 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:20:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-92b0f01d-722c-412a-8cb6-ca1f248a53e0 req-3d50b159-7a8b-4db8-bc66-25deb76988d7 service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Received event network-changed-d90f48df-d39d-4f9e-b484-7cafb58c032d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-92b0f01d-722c-412a-8cb6-ca1f248a53e0 req-3d50b159-7a8b-4db8-bc66-25deb76988d7 service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Refreshing instance network info cache due to event network-changed-d90f48df-d39d-4f9e-b484-7cafb58c032d. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:20:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-92b0f01d-722c-412a-8cb6-ca1f248a53e0 req-3d50b159-7a8b-4db8-bc66-25deb76988d7 service nova] Acquiring lock "refresh_cache-0061bf04-e594-4e9c-aeb1-5a29bb299749" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:20:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-92b0f01d-722c-412a-8cb6-ca1f248a53e0 req-3d50b159-7a8b-4db8-bc66-25deb76988d7 service nova] Acquired lock "refresh_cache-0061bf04-e594-4e9c-aeb1-5a29bb299749" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:20:39 user nova-compute[75571]: DEBUG nova.network.neutron [req-92b0f01d-722c-412a-8cb6-ca1f248a53e0 req-3d50b159-7a8b-4db8-bc66-25deb76988d7 service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Refreshing network info cache for port d90f48df-d39d-4f9e-b484-7cafb58c032d {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:20:39 user nova-compute[75571]: DEBUG nova.network.neutron [req-92b0f01d-722c-412a-8cb6-ca1f248a53e0 req-3d50b159-7a8b-4db8-bc66-25deb76988d7 service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Updated VIF entry in instance network info cache for port d90f48df-d39d-4f9e-b484-7cafb58c032d. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:20:39 user nova-compute[75571]: DEBUG nova.network.neutron [req-92b0f01d-722c-412a-8cb6-ca1f248a53e0 req-3d50b159-7a8b-4db8-bc66-25deb76988d7 service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Updating instance_info_cache with network_info: [{"id": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "address": "fa:16:3e:08:e7:cd", "network": {"id": "0ea81c46-dc4e-497a-98de-313521fac370", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1733688335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b00222407b41f99d3b983afaeb6c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f48df-d3", "ovs_interfaceid": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:20:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-92b0f01d-722c-412a-8cb6-ca1f248a53e0 req-3d50b159-7a8b-4db8-bc66-25deb76988d7 service nova] Releasing lock "refresh_cache-0061bf04-e594-4e9c-aeb1-5a29bb299749" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG nova.objects.instance [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lazy-loading 'flavor' on Instance uuid 0061bf04-e594-4e9c-aeb1-5a29bb299749 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:40 user nova-compute[75571]: INFO nova.compute.manager [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Attaching volume e915d297-00e2-402f-9c40-530a71954224 to /dev/vdb
Nov 28 20:20:40 user nova-compute[75571]: DEBUG os_brick.utils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac813de-b638-437e-8d78-0297600c78ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e635b12c-e60d-435d-bf00-e72bed48bb6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2310e5-c209-4e0d-bdf4-d874f7a62ece]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[729f0444-72c7-40e5-a735-533dac806da4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:20:40 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:20:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba0af8f-939c-4748-a127-0f56dcbf03d6]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG os_brick.utils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:20:40 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Updating existing volume attachment record: ae584080-a05b-4278-a710-53eb6b87f62e {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.compute.manager [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:20:44 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Creating image(s)
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Ensure instance console log exists: /opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Start _get_guest_xml network_info=[{"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcwTPVqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '313a065e-94f3-4435-97af-6a16de64ca7c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7e2c5b2-c554-44f7-8f54-f55ee81baf56', 'serial': 'a7e2c5b2-c554-44f7-8f54-f55ee81baf56'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'aab005a6-a964-4bd1-92f7-760c49c2a222', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:44 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:20:44 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcwTPVqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:20:44 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:20:44 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:20:44 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9479abd6-76fc-45eb-b314-a0e8c683560d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:20:44 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[116132c2-d924-4075-a5ba-33fa2ef6eff2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56] added
Nov 28 20:20:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b51235-f87e-4280-a7c1-47d70fc729db]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b758fc-e6c5-4d29-ba74-290aa6135cce]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BcwTPVqo {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BcwTPVqo" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bfb9a4-5330-4873-86f4-c8eecf4efbbe]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BcwTPVqo'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec8e3fa-b1d9-4bba-9e9e-4f160c49a859]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8fd73b-d3ad-4e39-82d3-32ad35e526a0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:20:44 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:20:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:20:44 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:20:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddd0e75-0a98-495d-a347-4b5f13212eda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56, portal: 172.16.0.220,3260]
Nov 28 20:20:44 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56, portal: 172.16.0.220,3260] successful.
Nov 28 20:20:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dcef79-4470-4e6d-b1d2-8d1b68a18487]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c875388a-b8cf-40d3-acb8-1fac52181634]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:20:44 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:20:44 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:20:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:20:44 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:20:44 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:20:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ea8536-7dc0-46b9-bcde-589253816615]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:44 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcwTPVqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26133626661623336', 'path': '/dev/sdd'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133626661623336', 'path': '/dev/sdd'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-519855433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-519855433',id=27,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd03007966db45f48ae6c22ed6f84871',ramdisk_id='',reservation_id='r-akcqzo3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-468878',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-468878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:20:31Z,user_data=None,user_id='007af37c9a914cd5863e486c041701be',uuid=313a065e-94f3-4435-97af-6a16de64ca7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converting VIF {"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=d8b8da62-7cf3-4b0d-81b0-181bc7f571bd,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b8da62-7c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG nova.objects.instance [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'pci_devices' on Instance uuid 313a065e-94f3-4435-97af-6a16de64ca7c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:20:45 user nova-compute[75571]:   <uuid>313a065e-94f3-4435-97af-6a16de64ca7c</uuid>
Nov 28 20:20:45 user nova-compute[75571]:   <name>instance-0000001b</name>
Nov 28 20:20:45 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:20:45 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:20:45 user nova-compute[75571]:   <metadata>
Nov 28 20:20:45 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:20:45 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:20:45 user nova-compute[75571]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-519855433</nova:name>
Nov 28 20:20:45 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:20:44</nova:creationTime>
Nov 28 20:20:45 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:20:45 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:20:45 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:20:45 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:20:45 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:20:45 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:20:45 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:20:45 user nova-compute[75571]:       <nova:owner>
Nov 28 20:20:45 user nova-compute[75571]:         <nova:user uuid="007af37c9a914cd5863e486c041701be">tempest-ServerBootFromVolumeStableRescueTest-468878-project-member</nova:user>
Nov 28 20:20:45 user nova-compute[75571]:         <nova:project uuid="dd03007966db45f48ae6c22ed6f84871">tempest-ServerBootFromVolumeStableRescueTest-468878</nova:project>
Nov 28 20:20:45 user nova-compute[75571]:       </nova:owner>
Nov 28 20:20:45 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:20:45 user nova-compute[75571]:       <nova:ports>
Nov 28 20:20:45 user nova-compute[75571]:         <nova:port uuid="d8b8da62-7cf3-4b0d-81b0-181bc7f571bd">
Nov 28 20:20:45 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 20:20:45 user nova-compute[75571]:         </nova:port>
Nov 28 20:20:45 user nova-compute[75571]:       </nova:ports>
Nov 28 20:20:45 user nova-compute[75571]:     </nova:instance>
Nov 28 20:20:45 user nova-compute[75571]:   </metadata>
Nov 28 20:20:45 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:20:45 user nova-compute[75571]:     <system>
Nov 28 20:20:45 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:20:45 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:20:45 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:20:45 user nova-compute[75571]:       <entry name="serial">313a065e-94f3-4435-97af-6a16de64ca7c</entry>
Nov 28 20:20:45 user nova-compute[75571]:       <entry name="uuid">313a065e-94f3-4435-97af-6a16de64ca7c</entry>
Nov 28 20:20:45 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:20:45 user nova-compute[75571]:     </system>
Nov 28 20:20:45 user nova-compute[75571]:   </sysinfo>
Nov 28 20:20:45 user nova-compute[75571]:   <os>
Nov 28 20:20:45 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:20:45 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:20:45 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:20:45 user nova-compute[75571]:   </os>
Nov 28 20:20:45 user nova-compute[75571]:   <features>
Nov 28 20:20:45 user nova-compute[75571]:     <acpi/>
Nov 28 20:20:45 user nova-compute[75571]:     <apic/>
Nov 28 20:20:45 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:20:45 user nova-compute[75571]:   </features>
Nov 28 20:20:45 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:20:45 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:20:45 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:20:45 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:20:45 user nova-compute[75571]:   </clock>
Nov 28 20:20:45 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:20:45 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:20:45 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:20:45 user nova-compute[75571]:   </cpu>
Nov 28 20:20:45 user nova-compute[75571]:   <devices>
Nov 28 20:20:45 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:20:45 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:20:45 user nova-compute[75571]:       <source dev="/dev/sdd"/>
Nov 28 20:20:45 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:20:45 user nova-compute[75571]:       <serial>a7e2c5b2-c554-44f7-8f54-f55ee81baf56</serial>
Nov 28 20:20:45 user nova-compute[75571]:     </disk>
Nov 28 20:20:45 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:20:45 user nova-compute[75571]:       <mac address="fa:16:3e:36:86:6a"/>
Nov 28 20:20:45 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:20:45 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:20:45 user nova-compute[75571]:       <target dev="tapd8b8da62-7c"/>
Nov 28 20:20:45 user nova-compute[75571]:     </interface>
Nov 28 20:20:45 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:20:45 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/console.log" append="off"/>
Nov 28 20:20:45 user nova-compute[75571]:     </serial>
Nov 28 20:20:45 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:20:45 user nova-compute[75571]:     <video>
Nov 28 20:20:45 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:20:45 user nova-compute[75571]:     </video>
Nov 28 20:20:45 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:20:45 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:20:45 user nova-compute[75571]:     </rng>
Nov 28 20:20:45 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:20:45 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:20:45 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:20:45 user nova-compute[75571]:     </memballoon>
Nov 28 20:20:45 user nova-compute[75571]:   </devices>
Nov 28 20:20:45 user nova-compute[75571]: </domain>
Nov 28 20:20:45 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-519855433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-519855433',id=27,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd03007966db45f48ae6c22ed6f84871',ramdisk_id='',reservation_id='r-akcqzo3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-468878',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-468878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:20:31Z,user_data=None,user_id='007af37c9a914cd5863e486c041701be',uuid=313a065e-94f3-4435-97af-6a16de64ca7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converting VIF {"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=d8b8da62-7cf3-4b0d-81b0-181bc7f571bd,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b8da62-7c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG os_vif [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=d8b8da62-7cf3-4b0d-81b0-181bc7f571bd,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b8da62-7c') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95ab0498-4837-57e4-999d-d32efe5b43d7', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8b8da62-7c, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8b8da62-7c, col_values=(('qos', UUID('c7b95eed-a06a-4104-855f-25e2ffe89fdc')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8b8da62-7c, col_values=(('external_ids', {'iface-id': 'd8b8da62-7cf3-4b0d-81b0-181bc7f571bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:86:6a', 'vm-uuid': '313a065e-94f3-4435-97af-6a16de64ca7c'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:45 user nova-compute[75571]: INFO os_vif [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=d8b8da62-7cf3-4b0d-81b0-181bc7f571bd,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b8da62-7c')
Nov 28 20:20:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:20:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] No VIF found with MAC fa:16:3e:36:86:6a, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:20:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-000ce3b0-2a0f-4c9c-ab86-6824893c3f2b req-4278f3e7-b7d9-4cf1-985f-cf36300d4a07 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-000ce3b0-2a0f-4c9c-ab86-6824893c3f2b req-4278f3e7-b7d9-4cf1-985f-cf36300d4a07 service nova] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-000ce3b0-2a0f-4c9c-ab86-6824893c3f2b req-4278f3e7-b7d9-4cf1-985f-cf36300d4a07 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-000ce3b0-2a0f-4c9c-ab86-6824893c3f2b req-4278f3e7-b7d9-4cf1-985f-cf36300d4a07 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-000ce3b0-2a0f-4c9c-ab86-6824893c3f2b req-4278f3e7-b7d9-4cf1-985f-cf36300d4a07 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] No waiting events found dispatching network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:20:47 user nova-compute[75571]: WARNING nova.compute.manager [req-000ce3b0-2a0f-4c9c-ab86-6824893c3f2b req-4278f3e7-b7d9-4cf1-985f-cf36300d4a07 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received unexpected event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance with vm_state building and task_state spawning.
Nov 28 20:20:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xeRfkFVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:20:47 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:20:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:20:47 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:20:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:20:47 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f2fb32-d701-482e-8988-45beb11142c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:20:47 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a481c1b4-335d-4e4b-94cd-9d816330fc21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224] added
Nov 28 20:20:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[01629b31-14b1-48a3-8e77-040eca230d55]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[837cf814-387f-4065-b368-717d63f001f5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xeRfkFVH {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xeRfkFVH" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c9049b-c74f-49d0-98e2-a32abe21eee4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xeRfkFVH'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e683f716-e887-4b02-86d5-b29e16871017]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cd57a3-6dbe-4858-9d93-5f6a88384cd3]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:20:47 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:20:47 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:20:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:20:47 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:20:47 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:20:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:20:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1015b3-f561-4ad0-b86f-f90dba81a518]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224, portal: 172.16.0.220,3260]
Nov 28 20:20:48 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224, portal: 172.16.0.220,3260] successful.
Nov 28 20:20:48 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea36b30a-5f04-4a6b-a87a-7e795a84c366]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6a884d-f423-462c-b2f8-038df677a594]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:20:48 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:20:48 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:20:48 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:20:48 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:20:48 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:20:48 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:20:48 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:20:48 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72cc1e5-eb56-4b01-8a78-d43004fd9f53]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:20:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xeRfkFVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:20:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Instance spawned successfully.
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23236613636666538', 'path': '/dev/sde'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236613636666538', 'path': '/dev/sde'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.objects.instance [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lazy-loading 'flavor' on Instance uuid 0061bf04-e594-4e9c-aeb1-5a29bb299749 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:20:49 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:20:49 user nova-compute[75571]:   <source dev="/dev/sde"/>
Nov 28 20:20:49 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:20:49 user nova-compute[75571]:   <serial>e915d297-00e2-402f-9c40-530a71954224</serial>
Nov 28 20:20:49 user nova-compute[75571]: </disk>
Nov 28 20:20:49 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:20:49 user nova-compute[75571]: INFO nova.compute.manager [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:20:49 user nova-compute[75571]: INFO nova.compute.manager [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Took 18.78 seconds to build instance.
Nov 28 20:20:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "313a065e-94f3-4435-97af-6a16de64ca7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.862s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-1add6df3-34ee-435d-a88b-f1956d15374d req-1af52ade-626e-4af3-9eab-5654fe747f2c service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1add6df3-34ee-435d-a88b-f1956d15374d req-1af52ade-626e-4af3-9eab-5654fe747f2c service nova] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1add6df3-34ee-435d-a88b-f1956d15374d req-1af52ade-626e-4af3-9eab-5654fe747f2c service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1add6df3-34ee-435d-a88b-f1956d15374d req-1af52ade-626e-4af3-9eab-5654fe747f2c service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-1add6df3-34ee-435d-a88b-f1956d15374d req-1af52ade-626e-4af3-9eab-5654fe747f2c service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] No waiting events found dispatching network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:20:49 user nova-compute[75571]: WARNING nova.compute.manager [req-1add6df3-34ee-435d-a88b-f1956d15374d req-1af52ade-626e-4af3-9eab-5654fe747f2c service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received unexpected event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance with vm_state active and task_state None.
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] No VIF found with MAC fa:16:3e:08:e7:cd, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:20:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.262s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG nova.objects.instance [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lazy-loading 'flavor' on Instance uuid 0061bf04-e594-4e9c-aeb1-5a29bb299749 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:20:53 user nova-compute[75571]: INFO nova.compute.manager [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Attaching volume 1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a to /dev/vdc
Nov 28 20:20:53 user nova-compute[75571]: DEBUG os_brick.utils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5c0c9f-5cd8-4281-95fa-b926f6c43b85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c27d07d-f75c-441b-8224-f0e93c2f6cfe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76027ce-b769-448e-a116-6d6b02c23148]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bca0d4-103e-40c1-8f09-c7ca6278ffc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:20:53 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:20:53 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bcb53c-88ac-4445-96ac-52206d4f1141]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG os_brick.utils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:20:53 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Updating existing volume attachment record: c9fd2520-fe88-4b4f-8586-c724f97ef363 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:20:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:20:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:20:59 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:20:59 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:20:59 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:21:00 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:21:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeXFvrdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:21:01 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:21:01 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:21:01 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c53602b-01ac-491f-8bf2-302b4a7fbb78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:21:01 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e50a6d-1fb5-4510-9906-a4dae42b3465]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a] added
Nov 28 20:21:01 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cd3d88-2af5-427e-8dc9-aa088b84019b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.086s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[914ea845-69e6-4887-911e-5cdad55c40e4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KeXFvrdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KeXFvrdc" returned: 0 in 0.187s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54fe269-e0d1-4f18-878e-b5a13c3cdd44]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KeXFvrdc'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec18e98a-737c-4366-be23-713a51406237]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fde598-a626-4fc1-9399-742888ecc5e1]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:01 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:01 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:01 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:01 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:01 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:01 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:01 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:01 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9947ee0f-2e18-4ff0-bc11-e9d1a48c2b1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a, portal: 172.16.0.220,3260]
Nov 28 20:21:01 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a, portal: 172.16.0.220,3260] successful.
Nov 28 20:21:01 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db560cc-62f9-45e0-80f3-7c3fcea16286]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc9433c-5a2d-496c-8479-1dda1c7b33be]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:01 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:01 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:01 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:01 user nova-compute[75571]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a (non-flash)
Nov 28 20:21:01 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:01 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:01 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:01 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:01 user nova-compute[75571]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a (non-flash)
Nov 28 20:21:01 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.556s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e736895b-dafb-4c53-a877-89bd93474b25]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:01 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 3b0d4ca0-b527-4131-97ff-222cd9ced151 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updating instance_info_cache with network_info: [{"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeXFvrdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.590s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] <== connect_volume: return (1593ms) {'type': 'block', 'scsi_wwn': '23763386666326339', 'path': '/dev/sdf'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763386666326339', 'path': '/dev/sdf'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG nova.objects.instance [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lazy-loading 'flavor' on Instance uuid 0061bf04-e594-4e9c-aeb1-5a29bb299749 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:21:02 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:21:02 user nova-compute[75571]:   <source dev="/dev/sdf"/>
Nov 28 20:21:02 user nova-compute[75571]:   <target dev="vdc" bus="virtio"/>
Nov 28 20:21:02 user nova-compute[75571]:   <serial>1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a</serial>
Nov 28 20:21:02 user nova-compute[75571]: </disk>
Nov 28 20:21:02 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] No VIF found with MAC fa:16:3e:08:e7:cd, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.817s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-8ca3b519-a3a5-4443-b262-8b0ac2e24108 req-2106387c-0a98-4d91-810b-df30bbb71000 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Received event network-changed-524df3be-b94b-462e-89c0-57ffa9878bd1 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-8ca3b519-a3a5-4443-b262-8b0ac2e24108 req-2106387c-0a98-4d91-810b-df30bbb71000 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Refreshing instance network info cache due to event network-changed-524df3be-b94b-462e-89c0-57ffa9878bd1. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8ca3b519-a3a5-4443-b262-8b0ac2e24108 req-2106387c-0a98-4d91-810b-df30bbb71000 service nova] Acquiring lock "refresh_cache-86c31e96-70cf-45fd-9578-194706af2ad0" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8ca3b519-a3a5-4443-b262-8b0ac2e24108 req-2106387c-0a98-4d91-810b-df30bbb71000 service nova] Acquired lock "refresh_cache-86c31e96-70cf-45fd-9578-194706af2ad0" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG nova.network.neutron [req-8ca3b519-a3a5-4443-b262-8b0ac2e24108 req-2106387c-0a98-4d91-810b-df30bbb71000 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Refreshing network info cache for port 524df3be-b94b-462e-89c0-57ffa9878bd1 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:21:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:04 user nova-compute[75571]: INFO nova.compute.manager [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Detaching volume 1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a
Nov 28 20:21:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:21:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:04 user nova-compute[75571]: INFO nova.virt.block_device [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Attempting to driver detach volume 1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a from mountpoint /dev/vdc
Nov 28 20:21:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Attempting to detach device vdc from instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:21:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:21:04 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:21:04 user nova-compute[75571]:   <source dev="/dev/sdf"/>
Nov 28 20:21:04 user nova-compute[75571]:   <target dev="vdc" bus="virtio"/>
Nov 28 20:21:04 user nova-compute[75571]:   <serial>1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a</serial>
Nov 28 20:21:04 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 20:21:04 user nova-compute[75571]: </disk>
Nov 28 20:21:04 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:21:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Successfully detached device vdc from instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 from the persistent domain config.
Nov 28 20:21:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:21:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:21:04 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:21:04 user nova-compute[75571]:   <source dev="/dev/sdf"/>
Nov 28 20:21:04 user nova-compute[75571]:   <target dev="vdc" bus="virtio"/>
Nov 28 20:21:04 user nova-compute[75571]:   <serial>1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a</serial>
Nov 28 20:21:04 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 20:21:04 user nova-compute[75571]: </disk>
Nov 28 20:21:04 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:21:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG nova.network.neutron [req-8ca3b519-a3a5-4443-b262-8b0ac2e24108 req-2106387c-0a98-4d91-810b-df30bbb71000 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Updated VIF entry in instance network info cache for port 524df3be-b94b-462e-89c0-57ffa9878bd1. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG nova.network.neutron [req-8ca3b519-a3a5-4443-b262-8b0ac2e24108 req-2106387c-0a98-4d91-810b-df30bbb71000 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Updating instance_info_cache with network_info: [{"id": "524df3be-b94b-462e-89c0-57ffa9878bd1", "address": "fa:16:3e:94:a9:66", "network": {"id": "ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-242564008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee4056e8f34a4e8da54592d28d7a75a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524df3be-b9", "ovs_interfaceid": "524df3be-b94b-462e-89c0-57ffa9878bd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8ca3b519-a3a5-4443-b262-8b0ac2e24108 req-2106387c-0a98-4d91-810b-df30bbb71000 service nova] Releasing lock "refresh_cache-86c31e96-70cf-45fd-9578-194706af2ad0" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:21:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:21:07 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:21:07 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=7398MB free_disk=25.163482666015625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Applying migration context for instance 40ac5386-d43f-443c-ac15-186b368728f8 as it has an incoming, in-progress migration 673ad9be-bcb1-471c-ac1b-1ba267fcdb40. Migration status is finished {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 20:21:07 user nova-compute[75571]: INFO nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating resource usage from migration 673ad9be-bcb1-471c-ac1b-1ba267fcdb40
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 86c31e96-70cf-45fd-9578-194706af2ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Migration 673ad9be-bcb1-471c-ac1b-1ba267fcdb40 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 40ac5386-d43f-443c-ac15-186b368728f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance f95d416b-d3b7-4b16-adc7-83a06088e167 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 313a065e-94f3-4435-97af-6a16de64ca7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:21:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG nova.objects.instance [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'flavor' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:08 user nova-compute[75571]: INFO nova.compute.manager [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Attaching volume 13a8c230-3a9c-4a6d-af71-206fd7925ac2 to /dev/vdb
Nov 28 20:21:08 user nova-compute[75571]: DEBUG os_brick.utils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[77155e55-f493-416b-be29-fa4debaefa9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9b19e8-4ebc-48a6-a7d7-9effa480c822]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3c37f7-ea68-4bc6-ab05-da909bf16cf4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c4fe65-a153-435d-b62e-f74f3e4fd1c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:21:08 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:21:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[322478fd-9b38-47e4-9132-fee2541e8b6f]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG os_brick.utils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:21:08 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Updating existing volume attachment record: a6d1fee7-ddf2-4b2f-a6b4-4cba3f76eddc {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:21:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:21:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:21:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:21:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aycEbURC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:21:16 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:21:16 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:21:16 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[30564fe8-5e19-449f-b60c-3c77f71966ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:21:16 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1823c5bd-909c-4de8-b055-f341b56dcd8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2] added
Nov 28 20:21:16 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf424e51-a20e-4d23-91f6-f97f27ac375b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3410fd5-09e7-4443-a39a-02b135b52c9c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aycEbURC {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aycEbURC" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[025437ee-1f0a-48ad-b6cf-685f0a99345f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aycEbURC'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a35d54-791e-4a02-b67f-ac3d46beb1f6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[323416ee-6b6e-49a5-a8cf-10032de7dce6]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a (non-flash)
Nov 28 20:21:16 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a (non-flash)
Nov 28 20:21:16 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cf0cd7-9700-4bb4-a73c-8a37de9a2d39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2, portal: 172.16.0.220,3260]
Nov 28 20:21:16 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2, portal: 172.16.0.220,3260] successful.
Nov 28 20:21:16 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9345c8a-9404-4e39-b756-9c910e626ee9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb84acc-f1db-4f55-9146-59fc5e6fcde4]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)
Nov 28 20:21:16 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a (non-flash)
Nov 28 20:21:16 user nova-compute[75571]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)
Nov 28 20:21:16 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[006d399b-7780-402e-9689-f78972717ea4]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:16 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:21:17 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:21:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aycEbURC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:21:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:21:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23336346661613939', 'path': '/dev/sdg'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:21:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336346661613939', 'path': '/dev/sdg'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:21:17 user nova-compute[75571]: DEBUG nova.objects.instance [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'flavor' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:21:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:21:17 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:21:17 user nova-compute[75571]:   <source dev="/dev/sdg"/>
Nov 28 20:21:17 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:21:17 user nova-compute[75571]:   <serial>13a8c230-3a9c-4a6d-af71-206fd7925ac2</serial>
Nov 28 20:21:17 user nova-compute[75571]: </disk>
Nov 28 20:21:17 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:21:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:21:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:21:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] No VIF found with MAC fa:16:3e:94:a9:66, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:21:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.520s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Port 38a389ab-f2f2-413a-85e1-b40415fc156c binding to destination host user is already ACTIVE {{(pid=75571) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 20:21:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:21:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquired lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:21:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG nova.network.neutron [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating instance_info_cache with network_info: [{"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Releasing lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Creating tmpfile /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/tmpx7hmv2vj to verify with other compute node that the instance is on the same shared storage. {{(pid=75571) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-a15e4380-c123-423c-81f3-5ca23248e8e6 req-687916df-e2bf-4413-a7f4-f54edefb08b9 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-vif-unplugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a15e4380-c123-423c-81f3-5ca23248e8e6 req-687916df-e2bf-4413-a7f4-f54edefb08b9 service nova] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a15e4380-c123-423c-81f3-5ca23248e8e6 req-687916df-e2bf-4413-a7f4-f54edefb08b9 service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a15e4380-c123-423c-81f3-5ca23248e8e6 req-687916df-e2bf-4413-a7f4-f54edefb08b9 service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-a15e4380-c123-423c-81f3-5ca23248e8e6 req-687916df-e2bf-4413-a7f4-f54edefb08b9 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] No waiting events found dispatching network-vif-unplugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:21:21 user nova-compute[75571]: WARNING nova.compute.manager [req-a15e4380-c123-423c-81f3-5ca23248e8e6 req-687916df-e2bf-4413-a7f4-f54edefb08b9 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received unexpected event network-vif-unplugged-38a389ab-f2f2-413a-85e1-b40415fc156c for instance with vm_state resized and task_state resize_reverting.
Nov 28 20:21:21 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Instance destroyed successfully.
Nov 28 20:21:21 user nova-compute[75571]: DEBUG nova.objects.instance [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lazy-loading 'resources' on Instance uuid 40ac5386-d43f-443c-ac15-186b368728f8 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2039159279',display_name='tempest-ServerActionsTestOtherB-server-2039159279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2039159279',id=17,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGleHnng/iZf+pKcaRfN4ki3/kKcZ1lAUwQTncf758ioT4v9Nu4+2KyDgP5bUFKo8JEMegAuoMjbKaD/3O2Xdr1tfYfEaBfckP1a0BpsnLhWEjCdte2x0agDjBhSwM7chQ==',key_name='tempest-keypair-1179232993',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:19:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8895df748b4644e9bad362ea318e04c7',ramdisk_id='',reservation_id='r-dfynuxpw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1446981498',owner_user_name='tempest-ServerActionsTestOtherB-1446981498-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:19:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ffae0c69e0c40e0917cf412e7757616',uuid=40ac5386-d43f-443c-ac15-186b368728f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converting VIF {"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG os_vif [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38a389ab-f2, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=164a05da-1e80-46e2-88bb-925259734c65) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:21 user nova-compute[75571]: INFO os_vif [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2')
Nov 28 20:21:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:21:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRGlTqEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:21:21 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:21:21 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c098e620-6d5e-4e80-b062-ee25ba91c1db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:21:22 user nova-compute[75571]: No targets found.
Nov 28 20:21:22 user nova-compute[75571]: iSNS:
Nov 28 20:21:22 user nova-compute[75571]: No targets found.
Nov 28 20:21:22 user nova-compute[75571]: STATIC:
Nov 28 20:21:22 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2
Nov 28 20:21:22 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:22 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:22 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224
Nov 28 20:21:22 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:22 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:22 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9
Nov 28 20:21:22 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:22 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:22 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a
Nov 28 20:21:22 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:22 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:22 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec
Nov 28 20:21:22 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:22 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:22 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:21:22 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:22 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:22 user nova-compute[75571]: FIRMWARE:
Nov 28 20:21:22 user nova-compute[75571]: No targets found.
Nov 28 20:21:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:21:22 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:21:22 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbe6a6f-722d-4f53-8945-541267ea4ef7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecd825b-6ec3-42bc-b488-67ea75428e5b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:22 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:22 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:22 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:22 user nova-compute[75571]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a (non-flash)
Nov 28 20:21:22 user nova-compute[75571]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)
Nov 28 20:21:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:22 user nova-compute[75571]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:22 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:22 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:22 user nova-compute[75571]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a (non-flash)
Nov 28 20:21:22 user nova-compute[75571]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)
Nov 28 20:21:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77784ce560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[42784bcf-52de-430c-bde1-8bff03d82388]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[55352095-3921-4dab-a29b-370efeb78da6]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53a5aaf-1b81-4391-8d03-3bc9cc949ca8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddf9e73-f16f-4762-a2a3-59f50da64891]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ee415e-7f99-4bcf-b4bc-7a120615e761]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ffa9ec-ebaa-48aa-b46c-ee5b2250133b]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260]
Nov 28 20:21:22 user nova-compute[75571]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260] successful.
Nov 28 20:21:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b975586f-0867-47e1-a7d4-9336bccb4a60]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] <== disconnect_volume: return (326ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:21:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:21:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:23 user nova-compute[75571]: DEBUG nova.objects.instance [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lazy-loading 'migration_context' on Instance uuid 40ac5386-d43f-443c-ac15-186b368728f8 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:21:23 user nova-compute[75571]: DEBUG nova.objects.base [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Object Instance<40ac5386-d43f-443c-ac15-186b368728f8> lazy-loaded attributes: resources,migration_context {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:21:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-0d18b013-c556-4996-8d7e-ee3753ef5e43 req-9b1641d4-9477-4c9d-be63-e974b8d25a64 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0d18b013-c556-4996-8d7e-ee3753ef5e43 req-9b1641d4-9477-4c9d-be63-e974b8d25a64 service nova] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0d18b013-c556-4996-8d7e-ee3753ef5e43 req-9b1641d4-9477-4c9d-be63-e974b8d25a64 service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0d18b013-c556-4996-8d7e-ee3753ef5e43 req-9b1641d4-9477-4c9d-be63-e974b8d25a64 service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-0d18b013-c556-4996-8d7e-ee3753ef5e43 req-9b1641d4-9477-4c9d-be63-e974b8d25a64 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] No waiting events found dispatching network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:21:23 user nova-compute[75571]: WARNING nova.compute.manager [req-0d18b013-c556-4996-8d7e-ee3753ef5e43 req-9b1641d4-9477-4c9d-be63-e974b8d25a64 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received unexpected event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c for instance with vm_state resized and task_state resize_reverting.
Nov 28 20:21:23 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:21:23 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:21:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.407s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:24 user nova-compute[75571]: INFO nova.compute.manager [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Swapping old allocation on dict_keys(['8c29bfe4-6f4c-483e-b64c-ec0ca018cd17']) held by migration 673ad9be-bcb1-471c-ac1b-1ba267fcdb40 for instance
Nov 28 20:21:24 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Overwriting current allocation {'allocations': {'8c29bfe4-6f4c-483e-b64c-ec0ca018cd17': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 31}}, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'consumer_generation': 1} on consumer 40ac5386-d43f-443c-ac15-186b368728f8 {{(pid=75571) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 28 20:21:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:21:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquired lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:21:24 user nova-compute[75571]: DEBUG nova.network.neutron [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG nova.network.neutron [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating instance_info_cache with network_info: [{"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Releasing lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.utils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:25 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 is timed out.
Nov 28 20:21:25 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Successfully detached device vdc from instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 from the live domain config.
Nov 28 20:21:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeXFvrdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:21:25 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[954f1339-3adb-4b07-8af3-ad29f5cefd61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ea1c6a-4233-4896-bcd2-7d3f27e37abb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:21:25 user nova-compute[75571]: No targets found.
Nov 28 20:21:25 user nova-compute[75571]: iSNS:
Nov 28 20:21:25 user nova-compute[75571]: No targets found.
Nov 28 20:21:25 user nova-compute[75571]: STATIC:
Nov 28 20:21:25 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2
Nov 28 20:21:25 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:25 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:25 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224
Nov 28 20:21:25 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:25 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:25 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9
Nov 28 20:21:25 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:25 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:25 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a
Nov 28 20:21:25 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:25 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:25 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:21:25 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:25 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:25 user nova-compute[75571]: FIRMWARE:
Nov 28 20:21:25 user nova-compute[75571]: No targets found.
Nov 28 20:21:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:21:25 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:21:25 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f9d93c-eef6-42dd-9846-8ed5db895ad1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1533502f-b837-417c-aa31-8b5bd17ec6c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d9332c-f0b8-45ed-ad08-3e73bc7595fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a3a252-4cc9-4d47-9dc4-2a17bdaefdf7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9f5120-9e2a-4b1f-a174-d20a96bd1547]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:25 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:25 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:25 user nova-compute[75571]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a (non-flash)
Nov 28 20:21:25 user nova-compute[75571]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)
Nov 28 20:21:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:25 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:25 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:25 user nova-compute[75571]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a (non-flash)
Nov 28 20:21:25 user nova-compute[75571]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)
Nov 28 20:21:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7778338550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a'): ({'sdf'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Removing single pathed devices sdf {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:21:25 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6370800d-14e5-4215-b169-a10c59fa4103]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.utils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8de9f93-720f-49f9-a0b7-8de6562ae7a7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe476d0-90a1-41f5-a025-ed031260c94e]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Flushing IO for device /dev/sdf {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8debe412-bb1d-45bf-9086-6e3f47593d35]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[308aeee0-6a32-401d-9627-b15e3be66e58]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] SCSI volumes sdf have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00636ed-05d3-4bd9-a090-5224a1adbf53]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8352a2c9-30e7-4841-a0ee-8ade00f64acf]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a, portal: 172.16.0.220,3260]
Nov 28 20:21:25 user nova-compute[75571]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a, portal: 172.16.0.220,3260] successful.
Nov 28 20:21:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e530ebb-8cc2-4ca3-94b7-487b381e1f09]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] <== disconnect_volume: return (367ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:21:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:21:26 user nova-compute[75571]: DEBUG nova.objects.instance [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lazy-loading 'flavor' on Instance uuid 0061bf04-e594-4e9c-aeb1-5a29bb299749 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:21:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.771s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:31 user nova-compute[75571]: INFO nova.compute.manager [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Detaching volume 13a8c230-3a9c-4a6d-af71-206fd7925ac2
Nov 28 20:21:31 user nova-compute[75571]: INFO nova.virt.block_device [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Attempting to driver detach volume 13a8c230-3a9c-4a6d-af71-206fd7925ac2 from mountpoint /dev/vdb
Nov 28 20:21:31 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Attempting to detach device vdb from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:21:31 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:21:31 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:21:31 user nova-compute[75571]:   <source dev="/dev/sdg"/>
Nov 28 20:21:31 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:21:31 user nova-compute[75571]:   <serial>13a8c230-3a9c-4a6d-af71-206fd7925ac2</serial>
Nov 28 20:21:31 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:21:31 user nova-compute[75571]: </disk>
Nov 28 20:21:31 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:21:31 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Successfully detached device vdb from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the persistent domain config.
Nov 28 20:21:31 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:21:31 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:21:31 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:21:31 user nova-compute[75571]:   <source dev="/dev/sdg"/>
Nov 28 20:21:31 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:21:31 user nova-compute[75571]:   <serial>13a8c230-3a9c-4a6d-af71-206fd7925ac2</serial>
Nov 28 20:21:31 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:21:31 user nova-compute[75571]: </disk>
Nov 28 20:21:31 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:21:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Starting finish_revert_migration {{(pid=75571) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Start _get_guest_xml network_info=[{"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRGlTqEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '40ac5386-d43f-443c-ac15-186b368728f8', 'attached_at': '2023-11-28T20:21:32.000000', 'detached_at': '', 'volume_id': '78f18bcc-3456-4d6b-a070-51c3de9d32ec', 'serial': '78f18bcc-3456-4d6b-a070-51c3de9d32ec'}, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'add3175f-c2e3-4905-923b-8a8d10a77c41', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:21:32 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:21:32 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.objects.instance [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lazy-loading 'vcpu_model' on Instance uuid 40ac5386-d43f-443c-ac15-186b368728f8 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRGlTqEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:21:32 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:21:32 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:21:32 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4410ad8d-5012-4291-bfc9-d0d25de16412]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:21:32 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b95d53d-02c7-4408-944a-5915c016ab3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec] added
Nov 28 20:21:32 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e6bf54-3a9b-4a68-abb6-d43757cae851]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c01426-eab5-4f44-bcc4-30ad4deb9f46]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRGlTqEK {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRGlTqEK" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee99cef-0547-43b0-b9ba-f9d784576ba9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sRGlTqEK'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bc17f8-767b-4132-a3bf-7b6772655359]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[397cc5e5-2259-419d-9e39-f61e67159da8]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ce18a8-2408-45a8-bad9-f470892ed3f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260]
Nov 28 20:21:32 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260] successful.
Nov 28 20:21:32 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[93032b3b-91e2-4306-afdb-39bc3d783752]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d9d67f-1c72-4e96-88a2-d0a43777a4b7]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:32 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)
Nov 28 20:21:32 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:32 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[627f19d0-1a1f-4514-aaa9-dccad382d67e]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRGlTqEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:21:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:21:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26533303238663166', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:21:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533303238663166', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2039159279',display_name='tempest-ServerActionsTestOtherB-server-2039159279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2039159279',id=17,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGleHnng/iZf+pKcaRfN4ki3/kKcZ1lAUwQTncf758ioT4v9Nu4+2KyDgP5bUFKo8JEMegAuoMjbKaD/3O2Xdr1tfYfEaBfckP1a0BpsnLhWEjCdte2x0agDjBhSwM7chQ==',key_name='tempest-keypair-1179232993',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:19:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8895df748b4644e9bad362ea318e04c7',ramdisk_id='',reservation_id='r-dfynuxpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1446981498',owner_user_name='tempest-ServerActionsTestOtherB-1446981498-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:21:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ffae0c69e0c40e0917cf412e7757616',uuid=40ac5386-d43f-443c-ac15-186b368728f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converting VIF {"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:21:34 user nova-compute[75571]:   <uuid>40ac5386-d43f-443c-ac15-186b368728f8</uuid>
Nov 28 20:21:34 user nova-compute[75571]:   <name>instance-00000011</name>
Nov 28 20:21:34 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:21:34 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:21:34 user nova-compute[75571]:   <metadata>
Nov 28 20:21:34 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:21:34 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:21:34 user nova-compute[75571]:       <nova:name>tempest-ServerActionsTestOtherB-server-2039159279</nova:name>
Nov 28 20:21:34 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:21:32</nova:creationTime>
Nov 28 20:21:34 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:21:34 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:21:34 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:21:34 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:21:34 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:21:34 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:21:34 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:21:34 user nova-compute[75571]:       <nova:owner>
Nov 28 20:21:34 user nova-compute[75571]:         <nova:user uuid="0ffae0c69e0c40e0917cf412e7757616">tempest-ServerActionsTestOtherB-1446981498-project-member</nova:user>
Nov 28 20:21:34 user nova-compute[75571]:         <nova:project uuid="8895df748b4644e9bad362ea318e04c7">tempest-ServerActionsTestOtherB-1446981498</nova:project>
Nov 28 20:21:34 user nova-compute[75571]:       </nova:owner>
Nov 28 20:21:34 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:21:34 user nova-compute[75571]:       <nova:ports>
Nov 28 20:21:34 user nova-compute[75571]:         <nova:port uuid="38a389ab-f2f2-413a-85e1-b40415fc156c">
Nov 28 20:21:34 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:21:34 user nova-compute[75571]:         </nova:port>
Nov 28 20:21:34 user nova-compute[75571]:       </nova:ports>
Nov 28 20:21:34 user nova-compute[75571]:     </nova:instance>
Nov 28 20:21:34 user nova-compute[75571]:   </metadata>
Nov 28 20:21:34 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:21:34 user nova-compute[75571]:     <system>
Nov 28 20:21:34 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:21:34 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:21:34 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:21:34 user nova-compute[75571]:       <entry name="serial">40ac5386-d43f-443c-ac15-186b368728f8</entry>
Nov 28 20:21:34 user nova-compute[75571]:       <entry name="uuid">40ac5386-d43f-443c-ac15-186b368728f8</entry>
Nov 28 20:21:34 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:21:34 user nova-compute[75571]:     </system>
Nov 28 20:21:34 user nova-compute[75571]:   </sysinfo>
Nov 28 20:21:34 user nova-compute[75571]:   <os>
Nov 28 20:21:34 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:21:34 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:21:34 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:21:34 user nova-compute[75571]:   </os>
Nov 28 20:21:34 user nova-compute[75571]:   <features>
Nov 28 20:21:34 user nova-compute[75571]:     <acpi/>
Nov 28 20:21:34 user nova-compute[75571]:     <apic/>
Nov 28 20:21:34 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:21:34 user nova-compute[75571]:   </features>
Nov 28 20:21:34 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:21:34 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:21:34 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:21:34 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:21:34 user nova-compute[75571]:   </clock>
Nov 28 20:21:34 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:21:34 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:21:34 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:21:34 user nova-compute[75571]:   </cpu>
Nov 28 20:21:34 user nova-compute[75571]:   <devices>
Nov 28 20:21:34 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:21:34 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:21:34 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk"/>
Nov 28 20:21:34 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:21:34 user nova-compute[75571]:     </disk>
Nov 28 20:21:34 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:21:34 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:21:34 user nova-compute[75571]:       <source dev="/dev/sdb"/>
Nov 28 20:21:34 user nova-compute[75571]:       <target dev="vdb" bus="virtio"/>
Nov 28 20:21:34 user nova-compute[75571]:       <serial>78f18bcc-3456-4d6b-a070-51c3de9d32ec</serial>
Nov 28 20:21:34 user nova-compute[75571]:     </disk>
Nov 28 20:21:34 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:21:34 user nova-compute[75571]:       <mac address="fa:16:3e:68:de:09"/>
Nov 28 20:21:34 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:21:34 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:21:34 user nova-compute[75571]:       <target dev="tap38a389ab-f2"/>
Nov 28 20:21:34 user nova-compute[75571]:     </interface>
Nov 28 20:21:34 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:21:34 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/console.log" append="off"/>
Nov 28 20:21:34 user nova-compute[75571]:     </serial>
Nov 28 20:21:34 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:21:34 user nova-compute[75571]:     <video>
Nov 28 20:21:34 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:21:34 user nova-compute[75571]:     </video>
Nov 28 20:21:34 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:21:34 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:21:34 user nova-compute[75571]:     </rng>
Nov 28 20:21:34 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:21:34 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:21:34 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:21:34 user nova-compute[75571]:     </memballoon>
Nov 28 20:21:34 user nova-compute[75571]:   </devices>
Nov 28 20:21:34 user nova-compute[75571]: </domain>
Nov 28 20:21:34 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2039159279',display_name='tempest-ServerActionsTestOtherB-server-2039159279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2039159279',id=17,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGleHnng/iZf+pKcaRfN4ki3/kKcZ1lAUwQTncf758ioT4v9Nu4+2KyDgP5bUFKo8JEMegAuoMjbKaD/3O2Xdr1tfYfEaBfckP1a0BpsnLhWEjCdte2x0agDjBhSwM7chQ==',key_name='tempest-keypair-1179232993',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:19:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8895df748b4644e9bad362ea318e04c7',ramdisk_id='',reservation_id='r-dfynuxpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1446981498',owner_user_name='tempest-ServerActionsTestOtherB-1446981498-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:21:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ffae0c69e0c40e0917cf412e7757616',uuid=40ac5386-d43f-443c-ac15-186b368728f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converting VIF {"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG os_vif [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90e5cae5-b4a3-5a4f-94f1-29409c33c29f', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38a389ab-f2, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38a389ab-f2, col_values=(('qos', UUID('f9a5931c-488e-4d3d-a4c0-72fd45c869a9')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38a389ab-f2, col_values=(('external_ids', {'iface-id': '38a389ab-f2f2-413a-85e1-b40415fc156c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:de:09', 'vm-uuid': '40ac5386-d43f-443c-ac15-186b368728f8'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:21:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:34 user nova-compute[75571]: INFO os_vif [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2')
Nov 28 20:21:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-7de73050-367a-475a-bc86-7ddc6ace7033 req-80e09441-465a-496c-9933-3eb4b6772930 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7de73050-367a-475a-bc86-7ddc6ace7033 req-80e09441-465a-496c-9933-3eb4b6772930 service nova] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7de73050-367a-475a-bc86-7ddc6ace7033 req-80e09441-465a-496c-9933-3eb4b6772930 service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7de73050-367a-475a-bc86-7ddc6ace7033 req-80e09441-465a-496c-9933-3eb4b6772930 service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-7de73050-367a-475a-bc86-7ddc6ace7033 req-80e09441-465a-496c-9933-3eb4b6772930 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] No waiting events found dispatching network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:21:35 user nova-compute[75571]: WARNING nova.compute.manager [req-7de73050-367a-475a-bc86-7ddc6ace7033 req-80e09441-465a-496c-9933-3eb4b6772930 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received unexpected event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c for instance with vm_state resized and task_state resize_reverting.
Nov 28 20:21:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:21:37 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Instance running successfully.
Nov 28 20:21:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] finish_revert_migration finished successfully. {{(pid=75571) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 28 20:21:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-a8048378-9f0e-497d-bf42-8f0038d08833 req-a22ce9cc-4591-46ac-aa2b-b5b2fa4b0c2c service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a8048378-9f0e-497d-bf42-8f0038d08833 req-a22ce9cc-4591-46ac-aa2b-b5b2fa4b0c2c service nova] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a8048378-9f0e-497d-bf42-8f0038d08833 req-a22ce9cc-4591-46ac-aa2b-b5b2fa4b0c2c service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a8048378-9f0e-497d-bf42-8f0038d08833 req-a22ce9cc-4591-46ac-aa2b-b5b2fa4b0c2c service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-a8048378-9f0e-497d-bf42-8f0038d08833 req-a22ce9cc-4591-46ac-aa2b-b5b2fa4b0c2c service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] No waiting events found dispatching network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:21:37 user nova-compute[75571]: WARNING nova.compute.manager [req-a8048378-9f0e-497d-bf42-8f0038d08833 req-a22ce9cc-4591-46ac-aa2b-b5b2fa4b0c2c service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received unexpected event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c for instance with vm_state resized and task_state resize_reverting.
Nov 28 20:21:37 user nova-compute[75571]: INFO nova.compute.manager [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating instance to original state: 'active'
Nov 28 20:21:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-d859f98d-2b23-4050-b3b2-813a0e6a2bbc req-91e2692b-dfb7-4046-bd98-9725d34c22c5 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-changed-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-d859f98d-2b23-4050-b3b2-813a0e6a2bbc req-91e2692b-dfb7-4046-bd98-9725d34c22c5 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Refreshing instance network info cache due to event network-changed-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:21:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d859f98d-2b23-4050-b3b2-813a0e6a2bbc req-91e2692b-dfb7-4046-bd98-9725d34c22c5 service nova] Acquiring lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:21:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d859f98d-2b23-4050-b3b2-813a0e6a2bbc req-91e2692b-dfb7-4046-bd98-9725d34c22c5 service nova] Acquired lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:21:43 user nova-compute[75571]: DEBUG nova.network.neutron [req-d859f98d-2b23-4050-b3b2-813a0e6a2bbc req-91e2692b-dfb7-4046-bd98-9725d34c22c5 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Refreshing network info cache for port 4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:21:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:44 user nova-compute[75571]: DEBUG nova.network.neutron [req-d859f98d-2b23-4050-b3b2-813a0e6a2bbc req-91e2692b-dfb7-4046-bd98-9725d34c22c5 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updated VIF entry in instance network info cache for port 4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:21:44 user nova-compute[75571]: DEBUG nova.network.neutron [req-d859f98d-2b23-4050-b3b2-813a0e6a2bbc req-91e2692b-dfb7-4046-bd98-9725d34c22c5 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updating instance_info_cache with network_info: [{"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:21:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d859f98d-2b23-4050-b3b2-813a0e6a2bbc req-91e2692b-dfb7-4046-bd98-9725d34c22c5 service nova] Releasing lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:21:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:44 user nova-compute[75571]: INFO nova.compute.manager [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Shelve offloading
Nov 28 20:21:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.compute.manager [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:45 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Instance destroyed successfully.
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.compute.manager [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquired lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.network.neutron [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:21:45 user nova-compute[75571]: INFO nova.compute.claims [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Claim successful on node user
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.network.neutron [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updating instance_info_cache with network_info: [{"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Releasing lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-vif-unplugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] No waiting events found dispatching network-vif-unplugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:21:45 user nova-compute[75571]: WARNING nova.compute.manager [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received unexpected event network-vif-unplugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance with vm_state active and task_state shelving.
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] No waiting events found dispatching network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:21:45 user nova-compute[75571]: WARNING nova.compute.manager [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received unexpected event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance with vm_state active and task_state shelving.
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] No waiting events found dispatching network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:21:45 user nova-compute[75571]: WARNING nova.compute.manager [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received unexpected event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance with vm_state active and task_state shelving.
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] No waiting events found dispatching network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:21:45 user nova-compute[75571]: WARNING nova.compute.manager [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received unexpected event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance with vm_state active and task_state shelving.
Nov 28 20:21:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:45 user nova-compute[75571]: DEBUG nova.compute.manager [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:21:46 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:21:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.policy [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24aa8ca42c7342fa91f5eab19b6c0c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc33efd1bb7f49679e13621e8dd3449a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:21:46 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Creating image(s)
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "/opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "/opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "/opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.197s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:46 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Instance destroyed successfully.
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.objects.instance [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lazy-loading 'resources' on Instance uuid f95d416b-d3b7-4b16-adc7-83a06088e167 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1766072383',display_name='tempest-TestShelveInstance-server-1766072383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1766072383',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmRcrC+xEv9eq37KyVT3MN4g49xlT+tn2VHmIKI8IcmxomxVAiv7jCoA2CnKkM7knNVo8lhq5y0km1V+3OkdmA2AikbyaTLdfflHbz5DT3b54IbjGqVSR4M2T2o8iHZcQ==',key_name='tempest-TestShelveInstance-752726007',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:20:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bcf01c7a7d24806a2ffe82ec75c8a51',ramdisk_id='',reservation_id='r-6nppqoc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1960669737',owner_user_name='tempest-TestShelveInstance-1960669737-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:20:06Z,user_data=None,user_id='ca4e178401f940438a766a048076af93',uuid=f95d416b-d3b7-4b16-adc7-83a06088e167,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Converting VIF {"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:2e:14,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f,network=Network(559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6a23-8c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_vif [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:2e:14,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f,network=Network(559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6a23-8c') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-2ed5eb0a-13de-495b-b154-e2df41999126 req-cacc4252-2fff-442b-9144-fd98ce7473b7 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-changed-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-2ed5eb0a-13de-495b-b154-e2df41999126 req-cacc4252-2fff-442b-9144-fd98ce7473b7 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Refreshing instance network info cache due to event network-changed-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2ed5eb0a-13de-495b-b154-e2df41999126 req-cacc4252-2fff-442b-9144-fd98ce7473b7 service nova] Acquiring lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2ed5eb0a-13de-495b-b154-e2df41999126 req-cacc4252-2fff-442b-9144-fd98ce7473b7 service nova] Acquired lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.network.neutron [req-2ed5eb0a-13de-495b-b154-e2df41999126 req-cacc4252-2fff-442b-9144-fd98ce7473b7 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Refreshing network info cache for port 4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f3e6a23-8c, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de741200-d23f-4358-875d-3d4b05809483) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:46 user nova-compute[75571]: INFO os_vif [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:2e:14,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f,network=Network(559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6a23-8c')
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhaHYKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:21:46 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecce9a27-6aae-4abf-b5e3-e1195b76959c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:21:46 user nova-compute[75571]: No targets found.
Nov 28 20:21:46 user nova-compute[75571]: iSNS:
Nov 28 20:21:46 user nova-compute[75571]: No targets found.
Nov 28 20:21:46 user nova-compute[75571]: STATIC:
Nov 28 20:21:46 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2
Nov 28 20:21:46 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:46 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:46 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224
Nov 28 20:21:46 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:46 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:46 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9
Nov 28 20:21:46 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:46 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:46 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec
Nov 28 20:21:46 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:46 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:46 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:21:46 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:46 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:46 user nova-compute[75571]: FIRMWARE:
Nov 28 20:21:46 user nova-compute[75571]: No targets found.
Nov 28 20:21:46 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:21:46 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:21:46 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddbcc6e-5a5c-4aec-9287-2c80a9fedda6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk 1073741824" returned: 0 in 0.052s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fe7825-02f1-42d3-902f-83b13123eeb3]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:46 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:46 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:46 user nova-compute[75571]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)
Nov 28 20:21:46 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:46 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:21:46 user nova-compute[75571]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:46 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:46 user nova-compute[75571]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)
Nov 28 20:21:46 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:46 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7779dfa170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9'): ({'sdc'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Removing single pathed devices sdc {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e89d20-fbcb-4db3-b243-82a5346e7716]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a7136c-2ca0-4292-9d10-fa3811c47f99]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Flushing IO for device /dev/sdc {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef888a3-0b89-455a-801b-3ee977168b02]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Successfully created port: 7397580b-2855-4fab-b878-638f22ebbc53 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7fb437-0182-44ad-bb87-340a160e0c17]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.194s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c4c286-0ba7-4f6a-b8e3-9a30258ae579]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa3377b-670e-4db4-92c1-ccb44adf768c]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260]
Nov 28 20:21:47 user nova-compute[75571]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260] successful.
Nov 28 20:21:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e5cda4-0fcb-4ac0-9b7b-700f6b5e86c4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] <== disconnect_volume: return (440ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:21:47 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Deleting instance files /opt/stack/data/nova/instances/f95d416b-d3b7-4b16-adc7-83a06088e167_del
Nov 28 20:21:47 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Deletion of /opt/stack/data/nova/instances/f95d416b-d3b7-4b16-adc7-83a06088e167_del complete
Nov 28 20:21:47 user nova-compute[75571]: DEBUG nova.network.neutron [req-2ed5eb0a-13de-495b-b154-e2df41999126 req-cacc4252-2fff-442b-9144-fd98ce7473b7 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updated VIF entry in instance network info cache for port 4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG nova.network.neutron [req-2ed5eb0a-13de-495b-b154-e2df41999126 req-cacc4252-2fff-442b-9144-fd98ce7473b7 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updating instance_info_cache with network_info: [{"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": null, "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Cannot resize image /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Ensure instance console log exists: /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2ed5eb0a-13de-495b-b154-e2df41999126 req-cacc4252-2fff-442b-9144-fd98ce7473b7 service nova] Releasing lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG nova.network.neutron [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Successfully updated port: 7397580b-2855-4fab-b878-638f22ebbc53 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "refresh_cache-11c97ebd-b684-4c98-9f49-57d25ea0c81b" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquired lock "refresh_cache-11c97ebd-b684-4c98-9f49-57d25ea0c81b" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG nova.network.neutron [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:21:47 user nova-compute[75571]: DEBUG nova.network.neutron [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-vif-unplugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] No waiting events found dispatching network-vif-unplugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:21:48 user nova-compute[75571]: WARNING nova.compute.manager [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received unexpected event network-vif-unplugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance with vm_state active and task_state shelving.
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] No waiting events found dispatching network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:21:48 user nova-compute[75571]: WARNING nova.compute.manager [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received unexpected event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance with vm_state active and task_state shelving.
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Received event network-changed-7397580b-2855-4fab-b878-638f22ebbc53 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Refreshing instance network info cache due to event network-changed-7397580b-2855-4fab-b878-638f22ebbc53. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Acquiring lock "refresh_cache-11c97ebd-b684-4c98-9f49-57d25ea0c81b" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.network.neutron [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Updating instance_info_cache with network_info: [{"id": "7397580b-2855-4fab-b878-638f22ebbc53", "address": "fa:16:3e:82:47:6a", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7397580b-28", "ovs_interfaceid": "7397580b-2855-4fab-b878-638f22ebbc53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Releasing lock "refresh_cache-11c97ebd-b684-4c98-9f49-57d25ea0c81b" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.compute.manager [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Instance network_info: |[{"id": "7397580b-2855-4fab-b878-638f22ebbc53", "address": "fa:16:3e:82:47:6a", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7397580b-28", "ovs_interfaceid": "7397580b-2855-4fab-b878-638f22ebbc53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Acquired lock "refresh_cache-11c97ebd-b684-4c98-9f49-57d25ea0c81b" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Refreshing network info cache for port 7397580b-2855-4fab-b878-638f22ebbc53 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Start _get_guest_xml network_info=[{"id": "7397580b-2855-4fab-b878-638f22ebbc53", "address": "fa:16:3e:82:47:6a", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7397580b-28", "ovs_interfaceid": "7397580b-2855-4fab-b878-638f22ebbc53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:21:48 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:21:48 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-135830086',display_name='tempest-ServersNegativeTestJSON-server-135830086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-135830086',id=28,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc33efd1bb7f49679e13621e8dd3449a',ramdisk_id='',reservation_id='r-3v4c56dq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-146088746',owner_user_name='tempest-ServersNegativeTestJSON-146088746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:21:46Z,user_data=None,user_id='24aa8ca42c7342fa91f5eab19b6c0c9b',uuid=11c97ebd-b684-4c98-9f49-57d25ea0c81b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7397580b-2855-4fab-b878-638f22ebbc53", "address": "fa:16:3e:82:47:6a", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7397580b-28", "ovs_interfaceid": "7397580b-2855-4fab-b878-638f22ebbc53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Converting VIF {"id": "7397580b-2855-4fab-b878-638f22ebbc53", "address": "fa:16:3e:82:47:6a", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7397580b-28", "ovs_interfaceid": "7397580b-2855-4fab-b878-638f22ebbc53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:47:6a,bridge_name='br-int',has_traffic_filtering=True,id=7397580b-2855-4fab-b878-638f22ebbc53,network=Network(b45a9bdc-c522-435b-8532-28ec9780b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7397580b-28') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.objects.instance [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lazy-loading 'pci_devices' on Instance uuid 11c97ebd-b684-4c98-9f49-57d25ea0c81b {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:21:48 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Deleted allocations for instance f95d416b-d3b7-4b16-adc7-83a06088e167
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:21:48 user nova-compute[75571]:   <uuid>11c97ebd-b684-4c98-9f49-57d25ea0c81b</uuid>
Nov 28 20:21:48 user nova-compute[75571]:   <name>instance-0000001c</name>
Nov 28 20:21:48 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:21:48 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:21:48 user nova-compute[75571]:   <metadata>
Nov 28 20:21:48 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:21:48 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:21:48 user nova-compute[75571]:       <nova:name>tempest-ServersNegativeTestJSON-server-135830086</nova:name>
Nov 28 20:21:48 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:21:48</nova:creationTime>
Nov 28 20:21:48 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:21:48 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:21:48 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:21:48 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:21:48 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:21:48 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:21:48 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:21:48 user nova-compute[75571]:       <nova:owner>
Nov 28 20:21:48 user nova-compute[75571]:         <nova:user uuid="24aa8ca42c7342fa91f5eab19b6c0c9b">tempest-ServersNegativeTestJSON-146088746-project-member</nova:user>
Nov 28 20:21:48 user nova-compute[75571]:         <nova:project uuid="fc33efd1bb7f49679e13621e8dd3449a">tempest-ServersNegativeTestJSON-146088746</nova:project>
Nov 28 20:21:48 user nova-compute[75571]:       </nova:owner>
Nov 28 20:21:48 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:21:48 user nova-compute[75571]:       <nova:ports>
Nov 28 20:21:48 user nova-compute[75571]:         <nova:port uuid="7397580b-2855-4fab-b878-638f22ebbc53">
Nov 28 20:21:48 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:21:48 user nova-compute[75571]:         </nova:port>
Nov 28 20:21:48 user nova-compute[75571]:       </nova:ports>
Nov 28 20:21:48 user nova-compute[75571]:     </nova:instance>
Nov 28 20:21:48 user nova-compute[75571]:   </metadata>
Nov 28 20:21:48 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:21:48 user nova-compute[75571]:     <system>
Nov 28 20:21:48 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:21:48 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:21:48 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:21:48 user nova-compute[75571]:       <entry name="serial">11c97ebd-b684-4c98-9f49-57d25ea0c81b</entry>
Nov 28 20:21:48 user nova-compute[75571]:       <entry name="uuid">11c97ebd-b684-4c98-9f49-57d25ea0c81b</entry>
Nov 28 20:21:48 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:21:48 user nova-compute[75571]:     </system>
Nov 28 20:21:48 user nova-compute[75571]:   </sysinfo>
Nov 28 20:21:48 user nova-compute[75571]:   <os>
Nov 28 20:21:48 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:21:48 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:21:48 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:21:48 user nova-compute[75571]:   </os>
Nov 28 20:21:48 user nova-compute[75571]:   <features>
Nov 28 20:21:48 user nova-compute[75571]:     <acpi/>
Nov 28 20:21:48 user nova-compute[75571]:     <apic/>
Nov 28 20:21:48 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:21:48 user nova-compute[75571]:   </features>
Nov 28 20:21:48 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:21:48 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:21:48 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:21:48 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:21:48 user nova-compute[75571]:   </clock>
Nov 28 20:21:48 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:21:48 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:21:48 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:21:48 user nova-compute[75571]:   </cpu>
Nov 28 20:21:48 user nova-compute[75571]:   <devices>
Nov 28 20:21:48 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:21:48 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:21:48 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk"/>
Nov 28 20:21:48 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:21:48 user nova-compute[75571]:     </disk>
Nov 28 20:21:48 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:21:48 user nova-compute[75571]:       <mac address="fa:16:3e:82:47:6a"/>
Nov 28 20:21:48 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:21:48 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:21:48 user nova-compute[75571]:       <target dev="tap7397580b-28"/>
Nov 28 20:21:48 user nova-compute[75571]:     </interface>
Nov 28 20:21:48 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:21:48 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/console.log" append="off"/>
Nov 28 20:21:48 user nova-compute[75571]:     </serial>
Nov 28 20:21:48 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:21:48 user nova-compute[75571]:     <video>
Nov 28 20:21:48 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:21:48 user nova-compute[75571]:     </video>
Nov 28 20:21:48 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:21:48 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:21:48 user nova-compute[75571]:     </rng>
Nov 28 20:21:48 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:21:48 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:21:48 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:21:48 user nova-compute[75571]:     </memballoon>
Nov 28 20:21:48 user nova-compute[75571]:   </devices>
Nov 28 20:21:48 user nova-compute[75571]: </domain>
Nov 28 20:21:48 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-135830086',display_name='tempest-ServersNegativeTestJSON-server-135830086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-135830086',id=28,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc33efd1bb7f49679e13621e8dd3449a',ramdisk_id='',reservation_id='r-3v4c56dq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-146088746',owner_user_name='tempest-ServersNegativeTestJSON-146088746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:21:46Z,user_data=None,user_id='24aa8ca42c7342fa91f5eab19b6c0c9b',uuid=11c97ebd-b684-4c98-9f49-57d25ea0c81b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7397580b-2855-4fab-b878-638f22ebbc53", "address": "fa:16:3e:82:47:6a", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7397580b-28", "ovs_interfaceid": "7397580b-2855-4fab-b878-638f22ebbc53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Converting VIF {"id": "7397580b-2855-4fab-b878-638f22ebbc53", "address": "fa:16:3e:82:47:6a", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7397580b-28", "ovs_interfaceid": "7397580b-2855-4fab-b878-638f22ebbc53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:47:6a,bridge_name='br-int',has_traffic_filtering=True,id=7397580b-2855-4fab-b878-638f22ebbc53,network=Network(b45a9bdc-c522-435b-8532-28ec9780b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7397580b-28') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG os_vif [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:47:6a,bridge_name='br-int',has_traffic_filtering=True,id=7397580b-2855-4fab-b878-638f22ebbc53,network=Network(b45a9bdc-c522-435b-8532-28ec9780b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7397580b-28') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '063d9ea6-a3b5-57b2-addf-c1843adb6d42', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7397580b-28, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7397580b-28, col_values=(('qos', UUID('37b767d9-13c2-4704-b634-7ad8c87bd927')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7397580b-28, col_values=(('external_ids', {'iface-id': '7397580b-2855-4fab-b878-638f22ebbc53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:47:6a', 'vm-uuid': '11c97ebd-b684-4c98-9f49-57d25ea0c81b'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:48 user nova-compute[75571]: INFO os_vif [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:47:6a,bridge_name='br-int',has_traffic_filtering=True,id=7397580b-2855-4fab-b878-638f22ebbc53,network=Network(b45a9bdc-c522-435b-8532-28ec9780b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7397580b-28')
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.objects.instance [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lazy-loading 'numa_topology' on Instance uuid f95d416b-d3b7-4b16-adc7-83a06088e167 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.objects.base [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Object Instance<f95d416b-d3b7-4b16-adc7-83a06088e167> lazy-loaded attributes: resources,numa_topology {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] No VIF found with MAC fa:16:3e:82:47:6a, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "93392110-c3c3-44ff-a046-2f11608106c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "93392110-c3c3-44ff-a046-2f11608106c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.092s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:21:48 user nova-compute[75571]: INFO nova.compute.claims [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Claim successful on node user
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Updated VIF entry in instance network info cache for port 7397580b-2855-4fab-b878-638f22ebbc53. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Updating instance_info_cache with network_info: [{"id": "7397580b-2855-4fab-b878-638f22ebbc53", "address": "fa:16:3e:82:47:6a", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7397580b-28", "ovs_interfaceid": "7397580b-2855-4fab-b878-638f22ebbc53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.318s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Releasing lock "refresh_cache-11c97ebd-b684-4c98-9f49-57d25ea0c81b" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:21:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:21:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:49 user nova-compute[75571]: INFO nova.virt.block_device [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Booting with volume 12945667-6430-4669-b816-315eefdfd6f8 at /dev/vda
Nov 28 20:21:49 user nova-compute[75571]: DEBUG nova.policy [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG os_brick.utils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e8b258-0f9f-44fe-87ec-4396d5d1cd0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.185s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80a691f-7d2f-4457-b864-05361bfd7560]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc6de6d-e434-4fdd-8679-53d8604a5ff7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dbf7e0-d8b3-4ade-9c13-64e04fa33ff3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:21:49 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:21:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0684d69e-882b-4d22-9154-de4192acaeed]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG os_brick.utils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] <== get_connector_properties: return (303ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Updating existing volume attachment record: ecc45f07-8bb7-4354-af37-72aa21ac1fd6 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:50 user nova-compute[75571]: DEBUG nova.compute.manager [req-c687c1c0-1f05-47cb-9dbd-a9709017bdd3 req-d75f4a3e-3922-4aee-8e5f-7b53676fe69d service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Received event network-vif-plugged-7397580b-2855-4fab-b878-638f22ebbc53 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c687c1c0-1f05-47cb-9dbd-a9709017bdd3 req-d75f4a3e-3922-4aee-8e5f-7b53676fe69d service nova] Acquiring lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c687c1c0-1f05-47cb-9dbd-a9709017bdd3 req-d75f4a3e-3922-4aee-8e5f-7b53676fe69d service nova] Lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c687c1c0-1f05-47cb-9dbd-a9709017bdd3 req-d75f4a3e-3922-4aee-8e5f-7b53676fe69d service nova] Lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:50 user nova-compute[75571]: DEBUG nova.compute.manager [req-c687c1c0-1f05-47cb-9dbd-a9709017bdd3 req-d75f4a3e-3922-4aee-8e5f-7b53676fe69d service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] No waiting events found dispatching network-vif-plugged-7397580b-2855-4fab-b878-638f22ebbc53 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:21:50 user nova-compute[75571]: WARNING nova.compute.manager [req-c687c1c0-1f05-47cb-9dbd-a9709017bdd3 req-d75f4a3e-3922-4aee-8e5f-7b53676fe69d service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Received unexpected event network-vif-plugged-7397580b-2855-4fab-b878-638f22ebbc53 for instance with vm_state building and task_state spawning.
Nov 28 20:21:50 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Successfully created port: 45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG nova.objects.instance [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lazy-loading 'flavor' on Instance uuid 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] There are 0 instances to clean {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:51 user nova-compute[75571]: INFO nova.compute.manager [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Attaching volume e5a18686-4ce1-48a9-8657-5d9ca9a6f618 to /dev/vdb
Nov 28 20:21:51 user nova-compute[75571]: DEBUG os_brick.utils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bae9f0-5965-4c04-9c6f-f9a97d596ee3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf39578-6d44-425c-9751-6025f47a5670]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4a2f0e-5e09-46ac-9915-a8d0a23f0c89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e718158-97d1-4a63-ae99-a69a1ee200a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:21:51 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[87842ac9-161c-4ce1-8243-43259ce0def2]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG os_brick.utils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updating existing volume attachment record: 6eb4afca-c13a-4db3-a1c4-0f7111535f0c {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Successfully updated port: 45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquired lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Updating instance_info_cache with network_info: [{"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Releasing lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:21:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Instance network_info: |[{"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.compute.manager [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:21:52 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Instance spawned successfully.
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:21:52 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 86c31e96-70cf-45fd-9578-194706af2ad0 is timed out.
Nov 28 20:21:52 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Successfully detached device vdb from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the live domain config.
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aycEbURC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:21:52 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0a8da7-e00c-419e-b96b-bea2a395002c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:21:52 user nova-compute[75571]: No targets found.
Nov 28 20:21:52 user nova-compute[75571]: iSNS:
Nov 28 20:21:52 user nova-compute[75571]: No targets found.
Nov 28 20:21:52 user nova-compute[75571]: STATIC:
Nov 28 20:21:52 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2
Nov 28 20:21:52 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:52 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:52 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224
Nov 28 20:21:52 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:52 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:52 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec
Nov 28 20:21:52 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:52 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:52 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:21:52 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:21:52 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:21:52 user nova-compute[75571]: FIRMWARE:
Nov 28 20:21:52 user nova-compute[75571]: No targets found.
Nov 28 20:21:52 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:21:52 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:21:52 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5f2e5f-5731-4806-ae11-21300ee4de42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:52 user nova-compute[75571]: INFO nova.compute.manager [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Took 5.89 seconds to spawn the instance on the hypervisor.
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.compute.manager [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[174eb81d-b77c-4f52-a019-fc33400cce6e]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:52 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:52 user nova-compute[75571]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)
Nov 28 20:21:52 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:52 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:52 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:52 user nova-compute[75571]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 (non-flash)
Nov 28 20:21:52 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:52 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77682f65f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2'): ({'sdg'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Removing single pathed devices sdg {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.compute.manager [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Received event network-vif-plugged-7397580b-2855-4fab-b878-638f22ebbc53 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] Acquiring lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] Lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] Lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.compute.manager [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] No waiting events found dispatching network-vif-plugged-7397580b-2855-4fab-b878-638f22ebbc53 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:21:52 user nova-compute[75571]: WARNING nova.compute.manager [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Received unexpected event network-vif-plugged-7397580b-2855-4fab-b878-638f22ebbc53 for instance with vm_state building and task_state spawning.
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.compute.manager [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received event network-changed-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.compute.manager [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Refreshing instance network info cache due to event network-changed-45eabb36-f147-4900-b1dc-8b48e4141866. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] Acquiring lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] Acquired lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.network.neutron [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Refreshing network info cache for port 45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6337e9a-873d-4dad-abd1-ae4effaf320f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7be3a8b-f799-47ea-bddf-35a77663048c]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Flushing IO for device /dev/sdg {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:52 user nova-compute[75571]: INFO nova.compute.manager [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Took 6.91 seconds to build instance.
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5fbf79-b912-40a9-92cd-90e61ffb45da]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.052s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a023a01-d900-43f6-835f-8c69e5db9be8]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] SCSI volumes sdg have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a185505-3ebc-4a43-8e18-7699f2dabcf6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e844c453-b87b-4c1c-957e-7eb38b047130]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2, portal: 172.16.0.220,3260]
Nov 28 20:21:52 user nova-compute[75571]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2, portal: 172.16.0.220,3260] successful.
Nov 28 20:21:52 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13a8c230-3a9c-4a6d-af71-206fd7925ac2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4842a74-6700-4c84-a5f0-f822a086abff]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] <== disconnect_volume: return (325ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.network.neutron [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Updated VIF entry in instance network info cache for port 45eabb36-f147-4900-b1dc-8b48e4141866. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG nova.network.neutron [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Updating instance_info_cache with network_info: [{"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:21:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] Releasing lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:21:53 user nova-compute[75571]: DEBUG nova.objects.instance [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'flavor' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:21:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.824s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:55 user nova-compute[75571]: INFO nova.compute.manager [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Detaching volume e915d297-00e2-402f-9c40-530a71954224
Nov 28 20:21:55 user nova-compute[75571]: INFO nova.virt.block_device [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Attempting to driver detach volume e915d297-00e2-402f-9c40-530a71954224 from mountpoint /dev/vdb
Nov 28 20:21:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Attempting to detach device vdb from instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:21:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:21:55 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:21:55 user nova-compute[75571]:   <source dev="/dev/sde"/>
Nov 28 20:21:55 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:21:55 user nova-compute[75571]:   <serial>e915d297-00e2-402f-9c40-530a71954224</serial>
Nov 28 20:21:55 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:21:55 user nova-compute[75571]: </disk>
Nov 28 20:21:55 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:21:55 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Successfully detached device vdb from instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 from the persistent domain config.
Nov 28 20:21:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:21:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:21:55 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:21:55 user nova-compute[75571]:   <source dev="/dev/sde"/>
Nov 28 20:21:55 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:21:55 user nova-compute[75571]:   <serial>e915d297-00e2-402f-9c40-530a71954224</serial>
Nov 28 20:21:55 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:21:55 user nova-compute[75571]: </disk>
Nov 28 20:21:55 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:21:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:21:57 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Creating image(s)
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Ensure instance console log exists: /opt/stack/data/nova/instances/93392110-c3c3-44ff-a046-2f11608106c3/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Start _get_guest_xml network_info=[{"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqDoeFXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '93392110-c3c3-44ff-a046-2f11608106c3', 'attached_at': '', 'detached_at': '', 'volume_id': '12945667-6430-4669-b816-315eefdfd6f8', 'serial': '12945667-6430-4669-b816-315eefdfd6f8'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'ecc45f07-8bb7-4354-af37-72aa21ac1fd6', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:21:57 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:21:57 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqDoeFXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:21:57 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:21:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:21:57 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:21:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:21:57 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cf1724-7a8e-4dfa-bb63-fc36b8e459c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:21:57 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a680292f-3a1c-4c07-8ce0-03a3b6b73775]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8] added
Nov 28 20:21:57 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c3c9c9-23b4-4e6a-b166-0080f67b0a2f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[febf9d13-d18a-4efc-97b6-bfb7f67a85a4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SqDoeFXN {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SqDoeFXN" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd50669c-0e71-40ea-b1bf-8d8030ad55af]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SqDoeFXN'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[296559db-2e8e-4d6b-838b-88433983a0fd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c356ec-546e-4fb2-8ed9-3615ae0c5501]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:57 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:57 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:57 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:57 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:57 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:57 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b137e2-642b-4d04-a7c9-25ee5f5d3e72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260]
Nov 28 20:21:57 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260] successful.
Nov 28 20:21:57 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[892aec6b-d04e-4de3-b5d8-10a6155f8931]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6141774-4912-4d6b-85c1-a314c4fcea0e]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:58 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:58 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:58 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:21:58 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:58 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:58 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:58 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:21:58 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7231c09b-aada-446f-93f6-7706a792814a]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqDoeFXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:21:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKdOiMxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:21:58 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:21:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23235383236383761', 'path': '/dev/sdc'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235383236383761', 'path': '/dev/sdc'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.120s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:21:59 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:21:59 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1507891953',display_name='tempest-ServerActionsTestOtherA-server-1507891953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1507891953',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORLi9cBeKxwKZF2rkLIldgYbs91Se5SaovgAyOLlR1LAXkmJO85TwVIU01jacVfp8MokOP7s1wTMn2ItcMxD1z+b2y7pkirDp4yb/pOf68MDBPxyqhiOej8r0TiPf6AAg==',key_name='tempest-keypair-344088806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a85595c9e1704e71903d25a65f5b696c',ramdisk_id='',reservation_id='r-0cgit2ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-390918760',owner_user_name='tempest-ServerActionsTestOtherA-390918760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098319d33fa243f5a044cf3f3c9f983c',uuid=93392110-c3c3-44ff-a046-2f11608106c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converting VIF {"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:a2:04,bridge_name='br-int',has_traffic_filtering=True,id=45eabb36-f147-4900-b1dc-8b48e4141866,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eabb36-f1') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG nova.objects.instance [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lazy-loading 'pci_devices' on Instance uuid 93392110-c3c3-44ff-a046-2f11608106c3 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5446da92-2738-42eb-ab74-081f1fcd1169]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:21:59 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:21:59 user nova-compute[75571]:   <uuid>93392110-c3c3-44ff-a046-2f11608106c3</uuid>
Nov 28 20:21:59 user nova-compute[75571]:   <name>instance-0000001d</name>
Nov 28 20:21:59 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:21:59 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:21:59 user nova-compute[75571]:   <metadata>
Nov 28 20:21:59 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:21:59 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:21:59 user nova-compute[75571]:       <nova:name>tempest-ServerActionsTestOtherA-server-1507891953</nova:name>
Nov 28 20:21:59 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:21:57</nova:creationTime>
Nov 28 20:21:59 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:21:59 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:21:59 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:21:59 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:21:59 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:21:59 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:21:59 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:21:59 user nova-compute[75571]:       <nova:owner>
Nov 28 20:21:59 user nova-compute[75571]:         <nova:user uuid="098319d33fa243f5a044cf3f3c9f983c">tempest-ServerActionsTestOtherA-390918760-project-member</nova:user>
Nov 28 20:21:59 user nova-compute[75571]:         <nova:project uuid="a85595c9e1704e71903d25a65f5b696c">tempest-ServerActionsTestOtherA-390918760</nova:project>
Nov 28 20:21:59 user nova-compute[75571]:       </nova:owner>
Nov 28 20:21:59 user nova-compute[75571]:       <nova:ports>
Nov 28 20:21:59 user nova-compute[75571]:         <nova:port uuid="45eabb36-f147-4900-b1dc-8b48e4141866">
Nov 28 20:21:59 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 20:21:59 user nova-compute[75571]:         </nova:port>
Nov 28 20:21:59 user nova-compute[75571]:       </nova:ports>
Nov 28 20:21:59 user nova-compute[75571]:     </nova:instance>
Nov 28 20:21:59 user nova-compute[75571]:   </metadata>
Nov 28 20:21:59 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:21:59 user nova-compute[75571]:     <system>
Nov 28 20:21:59 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:21:59 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:21:59 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:21:59 user nova-compute[75571]:       <entry name="serial">93392110-c3c3-44ff-a046-2f11608106c3</entry>
Nov 28 20:21:59 user nova-compute[75571]:       <entry name="uuid">93392110-c3c3-44ff-a046-2f11608106c3</entry>
Nov 28 20:21:59 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:21:59 user nova-compute[75571]:     </system>
Nov 28 20:21:59 user nova-compute[75571]:   </sysinfo>
Nov 28 20:21:59 user nova-compute[75571]:   <os>
Nov 28 20:21:59 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:21:59 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:21:59 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:21:59 user nova-compute[75571]:   </os>
Nov 28 20:21:59 user nova-compute[75571]:   <features>
Nov 28 20:21:59 user nova-compute[75571]:     <acpi/>
Nov 28 20:21:59 user nova-compute[75571]:     <apic/>
Nov 28 20:21:59 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:21:59 user nova-compute[75571]:   </features>
Nov 28 20:21:59 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:21:59 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:21:59 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:21:59 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:21:59 user nova-compute[75571]:   </clock>
Nov 28 20:21:59 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:21:59 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:21:59 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:21:59 user nova-compute[75571]:   </cpu>
Nov 28 20:21:59 user nova-compute[75571]:   <devices>
Nov 28 20:21:59 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:21:59 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:21:59 user nova-compute[75571]:       <source dev="/dev/sdc"/>
Nov 28 20:21:59 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:21:59 user nova-compute[75571]:       <serial>12945667-6430-4669-b816-315eefdfd6f8</serial>
Nov 28 20:21:59 user nova-compute[75571]:     </disk>
Nov 28 20:21:59 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:21:59 user nova-compute[75571]:       <mac address="fa:16:3e:a9:a2:04"/>
Nov 28 20:21:59 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:21:59 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:21:59 user nova-compute[75571]:       <target dev="tap45eabb36-f1"/>
Nov 28 20:21:59 user nova-compute[75571]:     </interface>
Nov 28 20:21:59 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:21:59 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/93392110-c3c3-44ff-a046-2f11608106c3/console.log" append="off"/>
Nov 28 20:21:59 user nova-compute[75571]:     </serial>
Nov 28 20:21:59 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:21:59 user nova-compute[75571]:     <video>
Nov 28 20:21:59 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:21:59 user nova-compute[75571]:     </video>
Nov 28 20:21:59 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:21:59 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:21:59 user nova-compute[75571]:     </rng>
Nov 28 20:21:59 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:21:59 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:21:59 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:21:59 user nova-compute[75571]:     </memballoon>
Nov 28 20:21:59 user nova-compute[75571]:   </devices>
Nov 28 20:21:59 user nova-compute[75571]: </domain>
Nov 28 20:21:59 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1507891953',display_name='tempest-ServerActionsTestOtherA-server-1507891953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1507891953',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORLi9cBeKxwKZF2rkLIldgYbs91Se5SaovgAyOLlR1LAXkmJO85TwVIU01jacVfp8MokOP7s1wTMn2ItcMxD1z+b2y7pkirDp4yb/pOf68MDBPxyqhiOej8r0TiPf6AAg==',key_name='tempest-keypair-344088806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a85595c9e1704e71903d25a65f5b696c',ramdisk_id='',reservation_id='r-0cgit2ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-390918760',owner_user_name='tempest-ServerActionsTestOtherA-390918760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098319d33fa243f5a044cf3f3c9f983c',uuid=93392110-c3c3-44ff-a046-2f11608106c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converting VIF {"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:a2:04,bridge_name='br-int',has_traffic_filtering=True,id=45eabb36-f147-4900-b1dc-8b48e4141866,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eabb36-f1') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_vif [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:a2:04,bridge_name='br-int',has_traffic_filtering=True,id=45eabb36-f147-4900-b1dc-8b48e4141866,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eabb36-f1') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d783342-e802-452d-be63-f71ce3b3673a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618] added
Nov 28 20:21:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3964d909-7af9-5c44-9158-726a6b916756', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45eabb36-f1, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45eabb36-f1, col_values=(('qos', UUID('ae595b55-23d6-4b9c-9052-be7d1afb7871')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45eabb36-f1, col_values=(('external_ids', {'iface-id': '45eabb36-f147-4900-b1dc-8b48e4141866', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:a2:04', 'vm-uuid': '93392110-c3c3-44ff-a046-2f11608106c3'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66dba3e-3d29-40ea-a92f-8d1717f1ec43]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:59 user nova-compute[75571]: INFO os_vif [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:a2:04,bridge_name='br-int',has_traffic_filtering=True,id=45eabb36-f147-4900-b1dc-8b48e4141866,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eabb36-f1')
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae94cf92-38b3-4c6b-96d9-eaa753dc1078]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKdOiMxA {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKdOiMxA" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3dfb53-e65a-461a-ab3e-43572fc30f47]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zKdOiMxA'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] No VIF found with MAC fa:16:3e:a9:a2:04, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a2033b-e0da-4628-bd99-3aa82619f20c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3fd1c0-221f-4583-ba82-29282b752ab3]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:59 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:59 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:59 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:21:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:59 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:59 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:59 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:21:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0b797f-d7b8-49b4-afba-33a1bd1f942b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618, portal: 172.16.0.220,3260]
Nov 28 20:21:59 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618, portal: 172.16.0.220,3260] successful.
Nov 28 20:21:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5572fad3-5b07-426a-8e37-271ab0bdccbf]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[287092bf-a0ce-410f-b83d-1552c7dc34fc]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:59 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:59 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:59 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:21:59 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:21:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:21:59 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:21:59 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:21:59 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:21:59 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:21:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[310b580c-d49a-4478-b00b-34feb6596ab5]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:21:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKdOiMxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:22:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:22:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] <== connect_volume: return (1489ms) {'type': 'block', 'scsi_wwn': '26236366638306564', 'path': '/dev/sdf'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:22:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236366638306564', 'path': '/dev/sdf'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:22:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:00 user nova-compute[75571]: DEBUG nova.objects.instance [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lazy-loading 'flavor' on Instance uuid 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:22:00 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:22:00 user nova-compute[75571]:   <source dev="/dev/sdf"/>
Nov 28 20:22:00 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:22:00 user nova-compute[75571]:   <serial>e5a18686-4ce1-48a9-8657-5d9ca9a6f618</serial>
Nov 28 20:22:00 user nova-compute[75571]: </disk>
Nov 28 20:22:00 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:22:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-26ef4cee-ceee-4286-8355-4d9595c71fea req-e876080b-784c-4bdb-b667-75ce3f3b509e service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received event network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:22:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-26ef4cee-ceee-4286-8355-4d9595c71fea req-e876080b-784c-4bdb-b667-75ce3f3b509e service nova] Acquiring lock "93392110-c3c3-44ff-a046-2f11608106c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-26ef4cee-ceee-4286-8355-4d9595c71fea req-e876080b-784c-4bdb-b667-75ce3f3b509e service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-26ef4cee-ceee-4286-8355-4d9595c71fea req-e876080b-784c-4bdb-b667-75ce3f3b509e service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-26ef4cee-ceee-4286-8355-4d9595c71fea req-e876080b-784c-4bdb-b667-75ce3f3b509e service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] No waiting events found dispatching network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:22:00 user nova-compute[75571]: WARNING nova.compute.manager [req-26ef4cee-ceee-4286-8355-4d9595c71fea req-e876080b-784c-4bdb-b667-75ce3f3b509e service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received unexpected event network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 for instance with vm_state building and task_state spawning.
Nov 28 20:22:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:22:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:22:01 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:22:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:22:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:22:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] No VIF found with MAC fa:16:3e:fc:63:7a, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:22:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.100s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:22:02 user nova-compute[75571]: INFO nova.compute.manager [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Rescuing
Nov 28 20:22:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquired lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG nova.network.neutron [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG nova.network.neutron [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updating instance_info_cache with network_info: [{"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Releasing lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating instance_info_cache with network_info: [{"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-44c37c82-56de-43a7-bfe6-e381c90c3bee req-d9bada63-2802-4beb-9136-ed6bffbd0982 service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received event network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-44c37c82-56de-43a7-bfe6-e381c90c3bee req-d9bada63-2802-4beb-9136-ed6bffbd0982 service nova] Acquiring lock "93392110-c3c3-44ff-a046-2f11608106c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-44c37c82-56de-43a7-bfe6-e381c90c3bee req-d9bada63-2802-4beb-9136-ed6bffbd0982 service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-44c37c82-56de-43a7-bfe6-e381c90c3bee req-d9bada63-2802-4beb-9136-ed6bffbd0982 service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-44c37c82-56de-43a7-bfe6-e381c90c3bee req-d9bada63-2802-4beb-9136-ed6bffbd0982 service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] No waiting events found dispatching network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:22:02 user nova-compute[75571]: WARNING nova.compute.manager [req-44c37c82-56de-43a7-bfe6-e381c90c3bee req-d9bada63-2802-4beb-9136-ed6bffbd0982 service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received unexpected event network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 for instance with vm_state building and task_state spawning.
Nov 28 20:22:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-40ac5386-d43f-443c-ac15-186b368728f8" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:22:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:22:02 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Instance spawned successfully.
Nov 28 20:22:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:03 user nova-compute[75571]: INFO nova.compute.manager [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 28 20:22:03 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:03 user nova-compute[75571]: INFO nova.compute.manager [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Took 14.58 seconds to build instance.
Nov 28 20:22:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "93392110-c3c3-44ff-a046-2f11608106c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.692s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-21f8161a-a34e-44fb-8a73-8202ca3e4e6d req-c3f4349c-1c38-4a7f-a9ec-cc183068183f service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-vif-unplugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-21f8161a-a34e-44fb-8a73-8202ca3e4e6d req-c3f4349c-1c38-4a7f-a9ec-cc183068183f service nova] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-21f8161a-a34e-44fb-8a73-8202ca3e4e6d req-c3f4349c-1c38-4a7f-a9ec-cc183068183f service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-21f8161a-a34e-44fb-8a73-8202ca3e4e6d req-c3f4349c-1c38-4a7f-a9ec-cc183068183f service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-21f8161a-a34e-44fb-8a73-8202ca3e4e6d req-c3f4349c-1c38-4a7f-a9ec-cc183068183f service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] No waiting events found dispatching network-vif-unplugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:22:03 user nova-compute[75571]: WARNING nova.compute.manager [req-21f8161a-a34e-44fb-8a73-8202ca3e4e6d req-c3f4349c-1c38-4a7f-a9ec-cc183068183f service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received unexpected event network-vif-unplugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance with vm_state active and task_state rescuing.
Nov 28 20:22:03 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Instance destroyed successfully.
Nov 28 20:22:03 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Attempting a stable device rescue
Nov 28 20:22:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75571) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Instance directory exists: not creating {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 20:22:03 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Creating image(s)
Nov 28 20:22:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "/opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "/opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "/opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG nova.objects.instance [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "4270e978df50c6d046d840d5a70f83fda4f426c1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "4270e978df50c6d046d840d5a70f83fda4f426c1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4270e978df50c6d046d840d5a70f83fda4f426c1.part --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:04 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:22:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:04 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:22:04 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:22:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4270e978df50c6d046d840d5a70f83fda4f426c1.part --force-share --output=json" returned: 0 in 0.194s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG nova.virt.images [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] f77204ba-f257-4f61-8ad9-2a67f408d308 was qcow2, converting to raw {{(pid=75571) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4270e978df50c6d046d840d5a70f83fda4f426c1.part /opt/stack/data/nova/instances/_base/4270e978df50c6d046d840d5a70f83fda4f426c1.converted {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-6732e0f5-2341-4bfe-ad3d-53ebecd43c1e req-546f96ae-9038-49bf-a21a-224ac90ec9af service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6732e0f5-2341-4bfe-ad3d-53ebecd43c1e req-546f96ae-9038-49bf-a21a-224ac90ec9af service nova] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6732e0f5-2341-4bfe-ad3d-53ebecd43c1e req-546f96ae-9038-49bf-a21a-224ac90ec9af service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6732e0f5-2341-4bfe-ad3d-53ebecd43c1e req-546f96ae-9038-49bf-a21a-224ac90ec9af service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-6732e0f5-2341-4bfe-ad3d-53ebecd43c1e req-546f96ae-9038-49bf-a21a-224ac90ec9af service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] No waiting events found dispatching network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:22:05 user nova-compute[75571]: WARNING nova.compute.manager [req-6732e0f5-2341-4bfe-ad3d-53ebecd43c1e req-546f96ae-9038-49bf-a21a-224ac90ec9af service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received unexpected event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance with vm_state active and task_state rescuing.
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4270e978df50c6d046d840d5a70f83fda4f426c1.part /opt/stack/data/nova/instances/_base/4270e978df50c6d046d840d5a70f83fda4f426c1.converted" returned: 0 in 0.382s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4270e978df50c6d046d840d5a70f83fda4f426c1.converted --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4270e978df50c6d046d840d5a70f83fda4f426c1.converted --force-share --output=json" returned: 0 in 0.406s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "4270e978df50c6d046d840d5a70f83fda4f426c1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.126s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "4270e978df50c6d046d840d5a70f83fda4f426c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "4270e978df50c6d046d840d5a70f83fda4f426c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4270e978df50c6d046d840d5a70f83fda4f426c1 --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4270e978df50c6d046d840d5a70f83fda4f426c1 --force-share --output=json" returned: 0 in 0.183s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4270e978df50c6d046d840d5a70f83fda4f426c1,backing_fmt=raw /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.rescue {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4270e978df50c6d046d840d5a70f83fda4f426c1,backing_fmt=raw /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.rescue" returned: 0 in 0.048s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "4270e978df50c6d046d840d5a70f83fda4f426c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.objects.instance [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lazy-loading 'migration_context' on Instance uuid 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.objects.base [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Object Instance<1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Start _get_guest_xml network_info=[{"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "vif_mac": "fa:16:3e:fc:63:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f77204ba-f257-4f61-8ad9-2a67f408d308', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKdOiMxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5a18686-4ce1-48a9-8657-5d9ca9a6f618', 'serial': 'e5a18686-4ce1-48a9-8657-5d9ca9a6f618'}, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '6eb4afca-c13a-4db3-a1c4-0f7111535f0c', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.objects.instance [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lazy-loading 'resources' on Instance uuid 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.objects.base [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Object Instance<1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.objects.instance [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lazy-loading 'numa_topology' on Instance uuid 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.objects.base [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Object Instance<1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:22:06 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:22:06 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.objects.instance [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.objects.base [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Object Instance<1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKdOiMxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:22:06 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:22:06 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:22:06 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[011142fc-6a13-4e6f-a4e7-65ad9dd0b91f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = zKdOiMxA\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 20:22:06 user nova-compute[75571]: node.name = iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618
Nov 28 20:22:06 user nova-compute[75571]: node.tpgt = -1
Nov 28 20:22:06 user nova-compute[75571]: node.startup = automatic
Nov 28 20:22:06 user nova-compute[75571]: node.leading_login = No
Nov 28 20:22:06 user nova-compute[75571]: iface.iscsi_ifacename = default
Nov 28 20:22:06 user nova-compute[75571]: iface.net_ifacename = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.ipaddress = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.prefix_len = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.hwaddress = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.transport_name = tcp
Nov 28 20:22:06 user nova-compute[75571]: iface.initiatorname = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.state = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.vlan_id = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.vlan_priority = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.vlan_state = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.iface_num = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.mtu = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.port = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.bootproto = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.subnet_mask = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.gateway = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.dhcp_alt_client_id = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.dhcp_dns = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.dhcp_learn_iqn = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.dhcp_vendor_id_state = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.dhcp_vendor_id = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.dhcp_slp_da = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.fragmentation = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.gratuitous_arp = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.incoming_forwarding = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.tos_state = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.tos = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.ttl = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.delayed_ack = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.tcp_nagle = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.tcp_wsf_state = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.tcp_wsf = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.tcp_timer_scale = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.tcp_timestamp = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.redirect = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.def_task_mgmt_timeout = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.header_digest = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.data_digest = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.immediate_data = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.initial_r2t = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.data_seq_inorder = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.data_pdu_inorder = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.erl = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.max_receive_data_len = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.first_burst_len = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.max_outstanding_r2t = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.max_burst_len = 0
Nov 28 20:22:06 user nova-compute[75571]: iface.chap_auth = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.bidi_chap = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.strict_login_compliance = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.discovery_auth = <empty>
Nov 28 20:22:06 user nova-compute[75571]: iface.discovery_logout = <empty>
Nov 28 20:22:06 user nova-compute[75571]: node.discovery_address = <empty>
Nov 28 20:22:06 user nova-compute[75571]: node.discovery_port = 0
Nov 28 20:22:06 user nova-compute[75571]: node.discovery_type = static
Nov 28 20:22:06 user nova-compute[75571]: node.session.initial_cmdsn = 0
Nov 28 20:22:06 user nova-compute[75571]: node.session.initial_login_retry_max = 8
Nov 28 20:22:06 user nova-compute[75571]: node.session.xmit_thread_priority = -20
Nov 28 20:22:06 user nova-compute[75571]: node.session.cmds_max = 128
Nov 28 20:22:06 user nova-compute[75571]: node.session.queue_depth = 32
Nov 28 20:22:06 user nova-compute[75571]: node.session.nr_sessions = 1
Nov 28 20:22:06 user nova-compute[75571]: node.session.auth.authmethod = CHAP
Nov 28 20:22:06 user nova-compute[75571]: node.session.auth.username = zKdOiMxA
Nov 28 20:22:06 user nova-compute[75571]: node.session.auth.password = ***
Nov 28 20:22:06 user nova-compute[75571]: node.session.auth.username_in = <empty>
Nov 28 20:22:06 user nova-compute[75571]: node.session.auth.password_in = <empty>
Nov 28 20:22:06 user nova-compute[75571]: node.session.auth.chap_algs = MD5
Nov 28 20:22:06 user nova-compute[75571]: node.session.timeo.replacement_timeout = 120
Nov 28 20:22:06 user nova-compute[75571]: node.session.err_timeo.abort_timeout = 15
Nov 28 20:22:06 user nova-compute[75571]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 20:22:06 user nova-compute[75571]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 20:22:06 user nova-compute[75571]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 20:22:06 user nova-compute[75571]: node.session.iscsi.FastAbort = Yes
Nov 28 20:22:06 user nova-compute[75571]: node.session.iscsi.InitialR2T = No
Nov 28 20:22:06 user nova-compute[75571]: node.session.iscsi.ImmediateData = Yes
Nov 28 20:22:06 user nova-compute[75571]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 20:22:06 user nova-compute[75571]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 20:22:06 user nova-compute[75571]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 20:22:06 user nova-compute[75571]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 20:22:06 user nova-compute[75571]: node.session.iscsi.MaxConnections = 1
Nov 28 20:22:06 user nova-compute[75571]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 20:22:06 user nova-compute[75571]: node.session.iscsi.ERL = 0
Nov 28 20:22:06 user nova-compute[75571]: node.session.scan = manual
Nov 28 20:22:06 user nova-compute[75571]: node.session.reopen_max = 0
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].address = 172.16.0.220
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].port = 3260
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].startup = manual
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].tcp.window_size = 524288
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].tcp.type_of_service = 0
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].timeo.logout_timeout = 15
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].timeo.login_timeout = 15
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].timeo.auth_timeout = 45
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].iscsi.DataDigest = None
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].iscsi.IFMarker = No
Nov 28 20:22:06 user nova-compute[75571]: node.conn[0].iscsi.OFMarker = No
Nov 28 20:22:06 user nova-compute[75571]: # END RECORD
Nov 28 20:22:06 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6397424-7366-49f7-866b-e1fa443cc1ca]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[103d6176-8fd9-404d-ba2b-e5c03232423d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKdOiMxA {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKdOiMxA" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7018bb-6b05-4fb2-b27a-8c069c552b9e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zKdOiMxA'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41ea5e6-b3e4-4923-94eb-302ab6afd71b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e817c1f2-83e8-43d6-8a91-f4a8c5d37b98]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:06 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:22:06 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:06 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:06 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:06 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:06 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:22:06 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:06 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:06 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:06 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.179s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] HCTL ('37', '0', '0', 0) found on session 36 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5595d81c-53b8-4fb4-9788-ba445b5aa1bb]: (4, ('0 0 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Searching for a device in session 36 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKdOiMxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.206s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] <== connect_volume: return (209ms) {'type': 'block', 'scsi_wwn': '26236366638306564', 'path': '/dev/sdf'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236366638306564', 'path': '/dev/sdf'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1017855203',display_name='tempest-ServerStableDeviceRescueTest-server-1017855203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1017855203',id=21,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYTiwvlcWoEsangDB2AZ9sHLwb27V6zeNEeQyWpqOj3c4cWFR+pVY0iquLeDfKp7vix8Thyhov7xyHfY/9+bwp0ql4HQc4hqo4O1gIedyQ6vayMqqQvIV8W2owXgQYlrg==',key_name='tempest-keypair-794763884',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7077abda0e884a0883f39e48e56af27e',ramdisk_id='',reservation_id='r-t8ozj8s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-45095974',owner_user_name='tempest-ServerStableDeviceRescueTest-45095974-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:20:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4045806241134f5580140b5049e33228',uuid=1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "vif_mac": "fa:16:3e:fc:63:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Converting VIF {"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "vif_mac": "fa:16:3e:fc:63:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:63:7a,bridge_name='br-int',has_traffic_filtering=True,id=1fbed4dc-8f66-4490-88f7-a0c4ae19fde9,network=Network(afa47bc5-6f66-41d1-9a82-74060d2f10c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fbed4dc-8f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.objects.instance [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lazy-loading 'pci_devices' on Instance uuid 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.objects.base [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Object Instance<1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:22:06 user nova-compute[75571]:   <uuid>1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc</uuid>
Nov 28 20:22:06 user nova-compute[75571]:   <name>instance-00000015</name>
Nov 28 20:22:06 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:22:06 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:22:06 user nova-compute[75571]:   <metadata>
Nov 28 20:22:06 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:22:06 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:22:06 user nova-compute[75571]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1017855203</nova:name>
Nov 28 20:22:06 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:22:06</nova:creationTime>
Nov 28 20:22:06 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:22:06 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:22:06 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:22:06 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:22:06 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:22:06 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:22:06 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:22:06 user nova-compute[75571]:       <nova:owner>
Nov 28 20:22:06 user nova-compute[75571]:         <nova:user uuid="4045806241134f5580140b5049e33228">tempest-ServerStableDeviceRescueTest-45095974-project-member</nova:user>
Nov 28 20:22:06 user nova-compute[75571]:         <nova:project uuid="7077abda0e884a0883f39e48e56af27e">tempest-ServerStableDeviceRescueTest-45095974</nova:project>
Nov 28 20:22:06 user nova-compute[75571]:       </nova:owner>
Nov 28 20:22:06 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:22:06 user nova-compute[75571]:       <nova:ports>
Nov 28 20:22:06 user nova-compute[75571]:         <nova:port uuid="1fbed4dc-8f66-4490-88f7-a0c4ae19fde9">
Nov 28 20:22:06 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 20:22:06 user nova-compute[75571]:         </nova:port>
Nov 28 20:22:06 user nova-compute[75571]:       </nova:ports>
Nov 28 20:22:06 user nova-compute[75571]:     </nova:instance>
Nov 28 20:22:06 user nova-compute[75571]:   </metadata>
Nov 28 20:22:06 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:22:06 user nova-compute[75571]:     <system>
Nov 28 20:22:06 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:22:06 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:22:06 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:22:06 user nova-compute[75571]:       <entry name="serial">1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc</entry>
Nov 28 20:22:06 user nova-compute[75571]:       <entry name="uuid">1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc</entry>
Nov 28 20:22:06 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:22:06 user nova-compute[75571]:     </system>
Nov 28 20:22:06 user nova-compute[75571]:   </sysinfo>
Nov 28 20:22:06 user nova-compute[75571]:   <os>
Nov 28 20:22:06 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:22:06 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:22:06 user nova-compute[75571]:   </os>
Nov 28 20:22:06 user nova-compute[75571]:   <features>
Nov 28 20:22:06 user nova-compute[75571]:     <acpi/>
Nov 28 20:22:06 user nova-compute[75571]:     <apic/>
Nov 28 20:22:06 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:22:06 user nova-compute[75571]:   </features>
Nov 28 20:22:06 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:22:06 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:22:06 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:22:06 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:22:06 user nova-compute[75571]:   </clock>
Nov 28 20:22:06 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:22:06 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:22:06 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:22:06 user nova-compute[75571]:   </cpu>
Nov 28 20:22:06 user nova-compute[75571]:   <devices>
Nov 28 20:22:06 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:22:06 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:22:06 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk"/>
Nov 28 20:22:06 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:22:06 user nova-compute[75571]:     </disk>
Nov 28 20:22:06 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:22:06 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:22:06 user nova-compute[75571]:       <source dev="/dev/sdf"/>
Nov 28 20:22:06 user nova-compute[75571]:       <target dev="vdb" bus="virtio"/>
Nov 28 20:22:06 user nova-compute[75571]:       <serial>e5a18686-4ce1-48a9-8657-5d9ca9a6f618</serial>
Nov 28 20:22:06 user nova-compute[75571]:     </disk>
Nov 28 20:22:06 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:22:06 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:22:06 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.rescue"/>
Nov 28 20:22:06 user nova-compute[75571]:       <target dev="vdc" bus="virtio"/>
Nov 28 20:22:06 user nova-compute[75571]:       <boot order="1"/>
Nov 28 20:22:06 user nova-compute[75571]:     </disk>
Nov 28 20:22:06 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:22:06 user nova-compute[75571]:       <mac address="fa:16:3e:fc:63:7a"/>
Nov 28 20:22:06 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:22:06 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:22:06 user nova-compute[75571]:       <target dev="tap1fbed4dc-8f"/>
Nov 28 20:22:06 user nova-compute[75571]:     </interface>
Nov 28 20:22:06 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:22:06 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/console.log" append="off"/>
Nov 28 20:22:06 user nova-compute[75571]:     </serial>
Nov 28 20:22:06 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:22:06 user nova-compute[75571]:     <video>
Nov 28 20:22:06 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:22:06 user nova-compute[75571]:     </video>
Nov 28 20:22:06 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:22:06 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:22:06 user nova-compute[75571]:     </rng>
Nov 28 20:22:06 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:22:06 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:22:06 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:22:06 user nova-compute[75571]:     </memballoon>
Nov 28 20:22:06 user nova-compute[75571]:   </devices>
Nov 28 20:22:06 user nova-compute[75571]: </domain>
Nov 28 20:22:06 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:22:06 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Instance destroyed successfully.
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] No VIF found with MAC fa:16:3e:fc:63:7a, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:22:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-7785fdd0-a179-4247-8cfc-9292d3d4cad7 req-038224ed-b1e1-4c23-a5b8-76e25eec9b46 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7785fdd0-a179-4247-8cfc-9292d3d4cad7 req-038224ed-b1e1-4c23-a5b8-76e25eec9b46 service nova] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7785fdd0-a179-4247-8cfc-9292d3d4cad7 req-038224ed-b1e1-4c23-a5b8-76e25eec9b46 service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7785fdd0-a179-4247-8cfc-9292d3d4cad7 req-038224ed-b1e1-4c23-a5b8-76e25eec9b46 service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-7785fdd0-a179-4247-8cfc-9292d3d4cad7 req-038224ed-b1e1-4c23-a5b8-76e25eec9b46 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] No waiting events found dispatching network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:22:08 user nova-compute[75571]: WARNING nova.compute.manager [req-7785fdd0-a179-4247-8cfc-9292d3d4cad7 req-038224ed-b1e1-4c23-a5b8-76e25eec9b46 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received unexpected event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance with vm_state active and task_state rescuing.
Nov 28 20:22:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:22:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:09 user nova-compute[75571]: DEBUG nova.objects.instance [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lazy-loading 'flavor' on Instance uuid 2f47c1e6-8450-4e8c-bfc7-99041345ab4f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:09 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Ignoring supplied device name: /dev/vdb
Nov 28 20:22:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.499s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:10 user nova-compute[75571]: INFO nova.compute.manager [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Attaching volume c4045789-f468-4f00-85df-81a587322427 to /dev/vdb
Nov 28 20:22:10 user nova-compute[75571]: DEBUG os_brick.utils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e86592-8191-41d6-931e-6496f8bb9748]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4bd823-59ed-4e63-938c-662dabc37da7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e55e834-96eb-4ab5-9105-eb977b0ef22d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[336f84f3-1a85-4e81-8189-97ec15ac120d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:22:10 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b0ba50-fde6-46ae-be11-d6f6cc87a986]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] No waiting events found dispatching network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:22:10 user nova-compute[75571]: WARNING nova.compute.manager [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received unexpected event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance with vm_state active and task_state rescuing.
Nov 28 20:22:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Received event network-changed-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Refreshing instance network info cache due to event network-changed-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] Acquiring lock "refresh_cache-2f47c1e6-8450-4e8c-bfc7-99041345ab4f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] Acquired lock "refresh_cache-2f47c1e6-8450-4e8c-bfc7-99041345ab4f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG nova.network.neutron [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Refreshing network info cache for port 0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG os_brick.utils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] <== get_connector_properties: return (770ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Updating existing volume attachment record: d1ff6167-c458-42c5-8e55-e4c3c2703dc0 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG nova.compute.manager [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:22:10 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:22:10 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:22:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=7721MB free_disk=25.088218688964844GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 86c31e96-70cf-45fd-9578-194706af2ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 40ac5386-d43f-443c-ac15-186b368728f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 313a065e-94f3-4435-97af-6a16de64ca7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 11c97ebd-b684-4c98-9f49-57d25ea0c81b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 93392110-c3c3-44ff-a046-2f11608106c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing inventories for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating ProviderTree inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing aggregate associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, aggregates: None {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing trait associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.network.neutron [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Updated VIF entry in instance network info cache for port 0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.network.neutron [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Updating instance_info_cache with network_info: [{"id": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "address": "fa:16:3e:e7:9f:a8", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2c8a4a-7c", "ovs_interfaceid": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] Releasing lock "refresh_cache-2f47c1e6-8450-4e8c-bfc7-99041345ab4f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.774s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75571) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 20:22:11 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:22:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:15 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 is timed out.
Nov 28 20:22:15 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Successfully detached device vdb from instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 from the live domain config.
Nov 28 20:22:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xeRfkFVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:22:15 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c1a8bc-85aa-4feb-9e2e-e2ddefd5674e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:22:15 user nova-compute[75571]: No targets found.
Nov 28 20:22:15 user nova-compute[75571]: iSNS:
Nov 28 20:22:15 user nova-compute[75571]: No targets found.
Nov 28 20:22:15 user nova-compute[75571]: STATIC:
Nov 28 20:22:15 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224
Nov 28 20:22:15 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:22:15 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:22:15 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8
Nov 28 20:22:15 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:22:15 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:22:15 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec
Nov 28 20:22:15 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:22:15 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:22:15 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618
Nov 28 20:22:15 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:22:15 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:22:15 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:22:15 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:22:15 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:22:15 user nova-compute[75571]: FIRMWARE:
Nov 28 20:22:15 user nova-compute[75571]: No targets found.
Nov 28 20:22:15 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:22:15 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:22:15 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4b3ca0-d5f3-4fde-bea6-ee10ed5db11c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bd827a-5815-44fb-8eec-573d09d73af9]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:15 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:22:15 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:15 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:15 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:15 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:15 user nova-compute[75571]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 (non-flash)
Nov 28 20:22:15 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:15 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:15 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:15 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f776814f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224'): ({'sde'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Removing single pathed devices sde {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03d7595-1a71-4d70-83ca-30bbb92d165c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9932f687-d173-4394-b04f-c76f65e379b2]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Flushing IO for device /dev/sde {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[85262188-e576-4b90-851a-88d14518c729]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[40004a4f-25e9-47f1-8a61-dffca97230c2]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] SCSI volumes sde have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b949b41-f193-454f-ad68-f8cd42e3dcaf]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab8b982-fb63-4dff-96c1-30b2fb9515e7]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224, portal: 172.16.0.220,3260]
Nov 28 20:22:16 user nova-compute[75571]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224, portal: 172.16.0.220,3260] successful.
Nov 28 20:22:16 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e915d297-00e2-402f-9c40-530a71954224 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[860a1d4a-b80c-4f2a-855e-0c7f7a9fa7dc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:22:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] <== disconnect_volume: return (347ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:22:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:22:16 user nova-compute[75571]: DEBUG nova.objects.instance [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lazy-loading 'flavor' on Instance uuid 0061bf04-e594-4e9c-aeb1-5a29bb299749 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.925s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLxubqva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:22:18 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:22:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:22:18 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:22:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:22:18 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[788ebb0f-3e5d-4bba-a1a8-7b8b685b5ac7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:22:18 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d866f279-c6dd-4a81-b19d-f07efb32c825]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427] added
Nov 28 20:22:18 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[727f64c7-69c4-46dc-aa02-e2abe3684794]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[638d0248-60e2-48cc-9a82-34aed4b4f28c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sLxubqva {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sLxubqva" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c85af7-c0ac-44c1-a9c3-f09e67ff3fea]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sLxubqva'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1d2394-b87f-4491-87ae-568ccd9ddff6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2037681-63f8-45e4-bb3e-52b7a283afc4]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:18 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:18 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:18 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:18 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:18 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:18 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:18 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:18 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:22:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8946c17b-1bd2-41d1-a602-41832e34b1b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427, portal: 172.16.0.220,3260]
Nov 28 20:22:19 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427, portal: 172.16.0.220,3260] successful.
Nov 28 20:22:19 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e627c62f-2a15-4f86-930a-4cdabe8c4e8f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6deac0a-5ced-4caa-9ea2-7c91433d44a4]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:19 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:19 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:19 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:19 user nova-compute[75571]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)
Nov 28 20:22:19 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:19 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:19 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:19 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:19 user nova-compute[75571]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)
Nov 28 20:22:19 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06ffe3c-475d-4a4a-a63a-eb2908166eed]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLxubqva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:22:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26535313466333933', 'path': '/dev/sde'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:22:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535313466333933', 'path': '/dev/sde'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:22:20 user nova-compute[75571]: DEBUG nova.objects.instance [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lazy-loading 'flavor' on Instance uuid 2f47c1e6-8450-4e8c-bfc7-99041345ab4f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:22:20 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:22:20 user nova-compute[75571]:   <source dev="/dev/sde"/>
Nov 28 20:22:20 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:22:20 user nova-compute[75571]:   <serial>c4045789-f468-4f00-85df-81a587322427</serial>
Nov 28 20:22:20 user nova-compute[75571]: </disk>
Nov 28 20:22:20 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:22:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:22:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:22:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] No VIF found with MAC fa:16:3e:e7:9f:a8, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:22:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.584s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:21 user nova-compute[75571]: INFO nova.compute.manager [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Rescuing
Nov 28 20:22:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:22:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquired lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:22:21 user nova-compute[75571]: DEBUG nova.network.neutron [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:22:22 user nova-compute[75571]: DEBUG nova.network.neutron [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Updating instance_info_cache with network_info: [{"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:22:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Releasing lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:22:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-6bb994c7-d70d-4763-a3ba-3cbbc9f9e320 req-0e6b0c30-7dc9-4acd-845c-7a7518daa502 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received event network-vif-unplugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:22:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6bb994c7-d70d-4763-a3ba-3cbbc9f9e320 req-0e6b0c30-7dc9-4acd-845c-7a7518daa502 service nova] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6bb994c7-d70d-4763-a3ba-3cbbc9f9e320 req-0e6b0c30-7dc9-4acd-845c-7a7518daa502 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6bb994c7-d70d-4763-a3ba-3cbbc9f9e320 req-0e6b0c30-7dc9-4acd-845c-7a7518daa502 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-6bb994c7-d70d-4763-a3ba-3cbbc9f9e320 req-0e6b0c30-7dc9-4acd-845c-7a7518daa502 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] No waiting events found dispatching network-vif-unplugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:22:23 user nova-compute[75571]: WARNING nova.compute.manager [req-6bb994c7-d70d-4763-a3ba-3cbbc9f9e320 req-0e6b0c30-7dc9-4acd-845c-7a7518daa502 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received unexpected event network-vif-unplugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance with vm_state active and task_state rescuing.
Nov 28 20:22:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:23 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Instance destroyed successfully.
Nov 28 20:22:23 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Attempting a stable device rescue
Nov 28 20:22:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75571) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 20:22:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Instance directory exists: not creating {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 20:22:23 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Creating image(s)
Nov 28 20:22:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "/opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "/opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "/opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:23 user nova-compute[75571]: DEBUG nova.objects.instance [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'trusted_certs' on Instance uuid 313a065e-94f3-4435-97af-6a16de64ca7c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "ee31cfe828ea1f3289d26f6a2449da8ba16b3df8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "ee31cfe828ea1f3289d26f6a2449da8ba16b3df8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee31cfe828ea1f3289d26f6a2449da8ba16b3df8.part --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:24 user nova-compute[75571]: DEBUG nova.objects.instance [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'flavor' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee31cfe828ea1f3289d26f6a2449da8ba16b3df8.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:24 user nova-compute[75571]: DEBUG nova.virt.images [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 1c3ba19f-034b-4575-988e-5ba1959e6b6e was qcow2, converting to raw {{(pid=75571) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 20:22:24 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:22:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee31cfe828ea1f3289d26f6a2449da8ba16b3df8.part /opt/stack/data/nova/instances/_base/ee31cfe828ea1f3289d26f6a2449da8ba16b3df8.converted {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:25 user nova-compute[75571]: INFO nova.compute.manager [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Attaching volume 61c58bb2-320d-4d0d-8e14-a985e77aa189 to /dev/vdb
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.utils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c88f303-109b-40c2-a5a5-cfdc92ac5bdb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee31cfe828ea1f3289d26f6a2449da8ba16b3df8.part /opt/stack/data/nova/instances/_base/ee31cfe828ea1f3289d26f6a2449da8ba16b3df8.converted" returned: 0 in 0.256s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee31cfe828ea1f3289d26f6a2449da8ba16b3df8.converted --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b27f162-6f69-489f-99db-d4c84c4dd42a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3de67d-edb6-4f71-908d-aa888632a209]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e75a185-78b4-44c6-a4da-75a513c425e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.compute.manager [req-80e63cfb-2c4e-4f5d-ad18-b43607319e03 req-586adf5c-de5b-4f10-a1d5-36471f39a59d service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-80e63cfb-2c4e-4f5d-ad18-b43607319e03 req-586adf5c-de5b-4f10-a1d5-36471f39a59d service nova] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-80e63cfb-2c4e-4f5d-ad18-b43607319e03 req-586adf5c-de5b-4f10-a1d5-36471f39a59d service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-80e63cfb-2c4e-4f5d-ad18-b43607319e03 req-586adf5c-de5b-4f10-a1d5-36471f39a59d service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.compute.manager [req-80e63cfb-2c4e-4f5d-ad18-b43607319e03 req-586adf5c-de5b-4f10-a1d5-36471f39a59d service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] No waiting events found dispatching network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:22:25 user nova-compute[75571]: WARNING nova.compute.manager [req-80e63cfb-2c4e-4f5d-ad18-b43607319e03 req-586adf5c-de5b-4f10-a1d5-36471f39a59d service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received unexpected event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance with vm_state active and task_state rescuing.
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:22:25 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9069675a-70e5-4d50-afa0-301b163971a3]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.utils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Updating existing volume attachment record: a2bed15c-3bc3-4bbb-b842-0df9dc602780 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee31cfe828ea1f3289d26f6a2449da8ba16b3df8.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "ee31cfe828ea1f3289d26f6a2449da8ba16b3df8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.601s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "ee31cfe828ea1f3289d26f6a2449da8ba16b3df8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "ee31cfe828ea1f3289d26f6a2449da8ba16b3df8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee31cfe828ea1f3289d26f6a2449da8ba16b3df8 --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee31cfe828ea1f3289d26f6a2449da8ba16b3df8 --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee31cfe828ea1f3289d26f6a2449da8ba16b3df8,backing_fmt=raw /opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/disk.rescue {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee31cfe828ea1f3289d26f6a2449da8ba16b3df8,backing_fmt=raw /opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/disk.rescue" returned: 0 in 0.047s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "ee31cfe828ea1f3289d26f6a2449da8ba16b3df8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.objects.instance [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'migration_context' on Instance uuid 313a065e-94f3-4435-97af-6a16de64ca7c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.objects.base [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Object Instance<313a065e-94f3-4435-97af-6a16de64ca7c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Start _get_guest_xml network_info=[{"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "vif_mac": "fa:16:3e:36:86:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1c3ba19f-034b-4575-988e-5ba1959e6b6e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcwTPVqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '313a065e-94f3-4435-97af-6a16de64ca7c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7e2c5b2-c554-44f7-8f54-f55ee81baf56', 'serial': 'a7e2c5b2-c554-44f7-8f54-f55ee81baf56'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'aab005a6-a964-4bd1-92f7-760c49c2a222', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.objects.instance [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'resources' on Instance uuid 313a065e-94f3-4435-97af-6a16de64ca7c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.objects.base [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Object Instance<313a065e-94f3-4435-97af-6a16de64ca7c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.objects.instance [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'numa_topology' on Instance uuid 313a065e-94f3-4435-97af-6a16de64ca7c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.objects.base [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Object Instance<313a065e-94f3-4435-97af-6a16de64ca7c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:22:25 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:22:25 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.objects.instance [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'vcpu_model' on Instance uuid 313a065e-94f3-4435-97af-6a16de64ca7c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.objects.base [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Object Instance<313a065e-94f3-4435-97af-6a16de64ca7c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcwTPVqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:22:25 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:22:25 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:22:25 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c4ff4f-ef05-4bc3-a042-03edf2e38364]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BcwTPVqo\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 20:22:25 user nova-compute[75571]: node.name = iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:22:25 user nova-compute[75571]: node.tpgt = -1
Nov 28 20:22:25 user nova-compute[75571]: node.startup = automatic
Nov 28 20:22:25 user nova-compute[75571]: node.leading_login = No
Nov 28 20:22:25 user nova-compute[75571]: iface.iscsi_ifacename = default
Nov 28 20:22:25 user nova-compute[75571]: iface.net_ifacename = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.ipaddress = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.prefix_len = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.hwaddress = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.transport_name = tcp
Nov 28 20:22:25 user nova-compute[75571]: iface.initiatorname = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.state = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.vlan_id = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.vlan_priority = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.vlan_state = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.iface_num = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.mtu = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.port = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.bootproto = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.subnet_mask = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.gateway = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.dhcp_alt_client_id = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.dhcp_dns = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.dhcp_learn_iqn = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.dhcp_vendor_id_state = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.dhcp_vendor_id = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.dhcp_slp_da = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.fragmentation = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.gratuitous_arp = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.incoming_forwarding = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.tos_state = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.tos = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.ttl = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.delayed_ack = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.tcp_nagle = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.tcp_wsf_state = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.tcp_wsf = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.tcp_timer_scale = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.tcp_timestamp = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.redirect = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.def_task_mgmt_timeout = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.header_digest = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.data_digest = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.immediate_data = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.initial_r2t = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.data_seq_inorder = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.data_pdu_inorder = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.erl = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.max_receive_data_len = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.first_burst_len = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.max_outstanding_r2t = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.max_burst_len = 0
Nov 28 20:22:25 user nova-compute[75571]: iface.chap_auth = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.bidi_chap = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.strict_login_compliance = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.discovery_auth = <empty>
Nov 28 20:22:25 user nova-compute[75571]: iface.discovery_logout = <empty>
Nov 28 20:22:25 user nova-compute[75571]: node.discovery_address = <empty>
Nov 28 20:22:25 user nova-compute[75571]: node.discovery_port = 0
Nov 28 20:22:25 user nova-compute[75571]: node.discovery_type = static
Nov 28 20:22:25 user nova-compute[75571]: node.session.initial_cmdsn = 0
Nov 28 20:22:25 user nova-compute[75571]: node.session.initial_login_retry_max = 8
Nov 28 20:22:25 user nova-compute[75571]: node.session.xmit_thread_priority = -20
Nov 28 20:22:25 user nova-compute[75571]: node.session.cmds_max = 128
Nov 28 20:22:25 user nova-compute[75571]: node.session.queue_depth = 32
Nov 28 20:22:25 user nova-compute[75571]: node.session.nr_sessions = 1
Nov 28 20:22:25 user nova-compute[75571]: node.session.auth.authmethod = CHAP
Nov 28 20:22:25 user nova-compute[75571]: node.session.auth.username = BcwTPVqo
Nov 28 20:22:25 user nova-compute[75571]: node.session.auth.password = ***
Nov 28 20:22:25 user nova-compute[75571]: node.session.auth.username_in = <empty>
Nov 28 20:22:25 user nova-compute[75571]: node.session.auth.password_in = <empty>
Nov 28 20:22:25 user nova-compute[75571]: node.session.auth.chap_algs = MD5
Nov 28 20:22:25 user nova-compute[75571]: node.session.timeo.replacement_timeout = 120
Nov 28 20:22:25 user nova-compute[75571]: node.session.err_timeo.abort_timeout = 15
Nov 28 20:22:25 user nova-compute[75571]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 20:22:25 user nova-compute[75571]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 20:22:25 user nova-compute[75571]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 20:22:25 user nova-compute[75571]: node.session.iscsi.FastAbort = Yes
Nov 28 20:22:25 user nova-compute[75571]: node.session.iscsi.InitialR2T = No
Nov 28 20:22:25 user nova-compute[75571]: node.session.iscsi.ImmediateData = Yes
Nov 28 20:22:25 user nova-compute[75571]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 20:22:25 user nova-compute[75571]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 20:22:25 user nova-compute[75571]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 20:22:25 user nova-compute[75571]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 20:22:25 user nova-compute[75571]: node.session.iscsi.MaxConnections = 1
Nov 28 20:22:25 user nova-compute[75571]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 20:22:25 user nova-compute[75571]: node.session.iscsi.ERL = 0
Nov 28 20:22:25 user nova-compute[75571]: node.session.scan = manual
Nov 28 20:22:25 user nova-compute[75571]: node.session.reopen_max = 0
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].address = 172.16.0.220
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].port = 3260
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].startup = manual
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].tcp.window_size = 524288
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].tcp.type_of_service = 0
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].timeo.logout_timeout = 15
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].timeo.login_timeout = 15
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].timeo.auth_timeout = 45
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].iscsi.DataDigest = None
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].iscsi.IFMarker = No
Nov 28 20:22:25 user nova-compute[75571]: node.conn[0].iscsi.OFMarker = No
Nov 28 20:22:25 user nova-compute[75571]: # END RECORD
Nov 28 20:22:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a384a884-d773-4d8c-8d6c-305516cd3798]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e288f458-53ec-4536-ad80-740c21780c8a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BcwTPVqo {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BcwTPVqo" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[043c5aa7-8577-4865-9eaa-17c1ee3ca7a0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BcwTPVqo'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94d1c2a-d045-4fbe-b832-5744b048db6a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e87bde2-332d-414b-a6c6-636cb3ffd489]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:25 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:25 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:25 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:25 user nova-compute[75571]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)
Nov 28 20:22:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:25 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:25 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:25 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:25 user nova-compute[75571]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)
Nov 28 20:22:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.169s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:22:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] HCTL ('35', '0', '0', 0) found on session 30 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb6143f-6dd3-4454-a2a7-2bb9f783a573]: (4, ('0 0 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching for a device in session 30 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcwTPVqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.199s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] <== connect_volume: return (200ms) {'type': 'block', 'scsi_wwn': '26133626661623336', 'path': '/dev/sdd'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133626661623336', 'path': '/dev/sdd'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-519855433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-519855433',id=27,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd03007966db45f48ae6c22ed6f84871',ramdisk_id='',reservation_id='r-akcqzo3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-468878',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-468878-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:20:49Z,user_data=None,user_id='007af37c9a914cd5863e486c041701be',uuid=313a065e-94f3-4435-97af-6a16de64ca7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "vif_mac": "fa:16:3e:36:86:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converting VIF {"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "vif_mac": "fa:16:3e:36:86:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=d8b8da62-7cf3-4b0d-81b0-181bc7f571bd,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b8da62-7c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG nova.objects.instance [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'pci_devices' on Instance uuid 313a065e-94f3-4435-97af-6a16de64ca7c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG nova.objects.base [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Object Instance<313a065e-94f3-4435-97af-6a16de64ca7c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:22:26 user nova-compute[75571]:   <uuid>313a065e-94f3-4435-97af-6a16de64ca7c</uuid>
Nov 28 20:22:26 user nova-compute[75571]:   <name>instance-0000001b</name>
Nov 28 20:22:26 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:22:26 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:22:26 user nova-compute[75571]:   <metadata>
Nov 28 20:22:26 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:22:26 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:22:26 user nova-compute[75571]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-519855433</nova:name>
Nov 28 20:22:26 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:22:25</nova:creationTime>
Nov 28 20:22:26 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:22:26 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:22:26 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:22:26 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:22:26 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:22:26 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:22:26 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:22:26 user nova-compute[75571]:       <nova:owner>
Nov 28 20:22:26 user nova-compute[75571]:         <nova:user uuid="007af37c9a914cd5863e486c041701be">tempest-ServerBootFromVolumeStableRescueTest-468878-project-member</nova:user>
Nov 28 20:22:26 user nova-compute[75571]:         <nova:project uuid="dd03007966db45f48ae6c22ed6f84871">tempest-ServerBootFromVolumeStableRescueTest-468878</nova:project>
Nov 28 20:22:26 user nova-compute[75571]:       </nova:owner>
Nov 28 20:22:26 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:22:26 user nova-compute[75571]:       <nova:ports>
Nov 28 20:22:26 user nova-compute[75571]:         <nova:port uuid="d8b8da62-7cf3-4b0d-81b0-181bc7f571bd">
Nov 28 20:22:26 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 20:22:26 user nova-compute[75571]:         </nova:port>
Nov 28 20:22:26 user nova-compute[75571]:       </nova:ports>
Nov 28 20:22:26 user nova-compute[75571]:     </nova:instance>
Nov 28 20:22:26 user nova-compute[75571]:   </metadata>
Nov 28 20:22:26 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:22:26 user nova-compute[75571]:     <system>
Nov 28 20:22:26 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:22:26 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:22:26 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:22:26 user nova-compute[75571]:       <entry name="serial">313a065e-94f3-4435-97af-6a16de64ca7c</entry>
Nov 28 20:22:26 user nova-compute[75571]:       <entry name="uuid">313a065e-94f3-4435-97af-6a16de64ca7c</entry>
Nov 28 20:22:26 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:22:26 user nova-compute[75571]:     </system>
Nov 28 20:22:26 user nova-compute[75571]:   </sysinfo>
Nov 28 20:22:26 user nova-compute[75571]:   <os>
Nov 28 20:22:26 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:22:26 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:22:26 user nova-compute[75571]:   </os>
Nov 28 20:22:26 user nova-compute[75571]:   <features>
Nov 28 20:22:26 user nova-compute[75571]:     <acpi/>
Nov 28 20:22:26 user nova-compute[75571]:     <apic/>
Nov 28 20:22:26 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:22:26 user nova-compute[75571]:   </features>
Nov 28 20:22:26 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:22:26 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:22:26 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:22:26 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:22:26 user nova-compute[75571]:   </clock>
Nov 28 20:22:26 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:22:26 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:22:26 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:22:26 user nova-compute[75571]:   </cpu>
Nov 28 20:22:26 user nova-compute[75571]:   <devices>
Nov 28 20:22:26 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:22:26 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:22:26 user nova-compute[75571]:       <source dev="/dev/sdd"/>
Nov 28 20:22:26 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:22:26 user nova-compute[75571]:       <serial>a7e2c5b2-c554-44f7-8f54-f55ee81baf56</serial>
Nov 28 20:22:26 user nova-compute[75571]:     </disk>
Nov 28 20:22:26 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:22:26 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:22:26 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/disk.rescue"/>
Nov 28 20:22:26 user nova-compute[75571]:       <target dev="vdb" bus="virtio"/>
Nov 28 20:22:26 user nova-compute[75571]:       <boot order="1"/>
Nov 28 20:22:26 user nova-compute[75571]:     </disk>
Nov 28 20:22:26 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:22:26 user nova-compute[75571]:       <mac address="fa:16:3e:36:86:6a"/>
Nov 28 20:22:26 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:22:26 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:22:26 user nova-compute[75571]:       <target dev="tapd8b8da62-7c"/>
Nov 28 20:22:26 user nova-compute[75571]:     </interface>
Nov 28 20:22:26 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:22:26 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/console.log" append="off"/>
Nov 28 20:22:26 user nova-compute[75571]:     </serial>
Nov 28 20:22:26 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:22:26 user nova-compute[75571]:     <video>
Nov 28 20:22:26 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:22:26 user nova-compute[75571]:     </video>
Nov 28 20:22:26 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:22:26 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:22:26 user nova-compute[75571]:     </rng>
Nov 28 20:22:26 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:22:26 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:22:26 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:22:26 user nova-compute[75571]:     </memballoon>
Nov 28 20:22:26 user nova-compute[75571]:   </devices>
Nov 28 20:22:26 user nova-compute[75571]: </domain>
Nov 28 20:22:26 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:22:26 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Instance destroyed successfully.
Nov 28 20:22:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:22:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] No VIF found with MAC fa:16:3e:36:86:6a, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:22:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-21d943c1-fe3d-46ad-87c9-77b0d5472504 req-1019549c-7753-42ed-965c-30c8599bcebb service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:22:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-21d943c1-fe3d-46ad-87c9-77b0d5472504 req-1019549c-7753-42ed-965c-30c8599bcebb service nova] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-21d943c1-fe3d-46ad-87c9-77b0d5472504 req-1019549c-7753-42ed-965c-30c8599bcebb service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-21d943c1-fe3d-46ad-87c9-77b0d5472504 req-1019549c-7753-42ed-965c-30c8599bcebb service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-21d943c1-fe3d-46ad-87c9-77b0d5472504 req-1019549c-7753-42ed-965c-30c8599bcebb service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] No waiting events found dispatching network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:22:27 user nova-compute[75571]: WARNING nova.compute.manager [req-21d943c1-fe3d-46ad-87c9-77b0d5472504 req-1019549c-7753-42ed-965c-30c8599bcebb service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received unexpected event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance with vm_state active and task_state rescuing.
Nov 28 20:22:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:29 user nova-compute[75571]: DEBUG nova.compute.manager [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:22:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-19ad7c4e-86d7-4c00-a598-0c66fd935818 req-d67520e4-e321-48ae-a8c0-6c62608cd53d service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:22:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-19ad7c4e-86d7-4c00-a598-0c66fd935818 req-d67520e4-e321-48ae-a8c0-6c62608cd53d service nova] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-19ad7c4e-86d7-4c00-a598-0c66fd935818 req-d67520e4-e321-48ae-a8c0-6c62608cd53d service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-19ad7c4e-86d7-4c00-a598-0c66fd935818 req-d67520e4-e321-48ae-a8c0-6c62608cd53d service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-19ad7c4e-86d7-4c00-a598-0c66fd935818 req-d67520e4-e321-48ae-a8c0-6c62608cd53d service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] No waiting events found dispatching network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:22:29 user nova-compute[75571]: WARNING nova.compute.manager [req-19ad7c4e-86d7-4c00-a598-0c66fd935818 req-d67520e4-e321-48ae-a8c0-6c62608cd53d service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received unexpected event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance with vm_state active and task_state rescuing.
Nov 28 20:22:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQVZdipY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:22:33 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:22:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:22:33 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:22:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:22:33 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[579bb80e-b433-46ad-9597-01ecd6ed2fed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:22:33 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5494792-f14d-4f74-a01e-ed354fa324fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189] added
Nov 28 20:22:33 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6b032a-0b23-4e0d-a6e4-1e33284448b7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c4669b-2cca-4d90-9a18-199d9b746ba0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oQVZdipY {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oQVZdipY" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2627fbb9-7068-4b0b-885e-6c56991335f2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oQVZdipY'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b26015d-5fef-4647-8524-c44860f9a436]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fa7653-1207-463c-8e84-c7c6d644e662]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:33 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:33 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:33 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:33 user nova-compute[75571]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)
Nov 28 20:22:33 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:33 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:33 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:33 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:33 user nova-compute[75571]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)
Nov 28 20:22:33 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:22:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dedbdf-90a4-440d-8595-dc084bc6db32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189, portal: 172.16.0.220,3260]
Nov 28 20:22:34 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189, portal: 172.16.0.220,3260] successful.
Nov 28 20:22:34 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9665fe8e-118a-498c-8c2c-5cb456348e2d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caba469-3970-4370-8a67-99d335355afa]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:34 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:34 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:34 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:34 user nova-compute[75571]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)
Nov 28 20:22:34 user nova-compute[75571]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 (non-flash)
Nov 28 20:22:34 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:34 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:34 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:34 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:34 user nova-compute[75571]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)
Nov 28 20:22:34 user nova-compute[75571]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 (non-flash)
Nov 28 20:22:34 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2609f263-9851-4c0d-b389-c754ac53a746]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQVZdipY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:22:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23434623765636435', 'path': '/dev/sdg'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:22:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434623765636435', 'path': '/dev/sdg'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:22:35 user nova-compute[75571]: DEBUG nova.objects.instance [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'flavor' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:22:35 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:22:35 user nova-compute[75571]:   <source dev="/dev/sdg"/>
Nov 28 20:22:35 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:22:35 user nova-compute[75571]:   <serial>61c58bb2-320d-4d0d-8e14-a985e77aa189</serial>
Nov 28 20:22:35 user nova-compute[75571]: </disk>
Nov 28 20:22:35 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:22:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:22:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:22:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] No VIF found with MAC fa:16:3e:94:a9:66, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:22:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.735s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:38 user nova-compute[75571]: INFO nova.compute.manager [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Detaching volume 61c58bb2-320d-4d0d-8e14-a985e77aa189
Nov 28 20:22:38 user nova-compute[75571]: INFO nova.virt.block_device [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Attempting to driver detach volume 61c58bb2-320d-4d0d-8e14-a985e77aa189 from mountpoint /dev/vdb
Nov 28 20:22:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Attempting to detach device vdb from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:22:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:22:38 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:22:38 user nova-compute[75571]:   <source dev="/dev/sdg"/>
Nov 28 20:22:38 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:22:38 user nova-compute[75571]:   <serial>61c58bb2-320d-4d0d-8e14-a985e77aa189</serial>
Nov 28 20:22:38 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:22:38 user nova-compute[75571]: </disk>
Nov 28 20:22:38 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:22:39 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Successfully detached device vdb from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the persistent domain config.
Nov 28 20:22:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:22:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:22:39 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:22:39 user nova-compute[75571]:   <source dev="/dev/sdg"/>
Nov 28 20:22:39 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:22:39 user nova-compute[75571]:   <serial>61c58bb2-320d-4d0d-8e14-a985e77aa189</serial>
Nov 28 20:22:39 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:22:39 user nova-compute[75571]: </disk>
Nov 28 20:22:39 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:22:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:22:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:40 user nova-compute[75571]: INFO nova.compute.manager [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Detaching volume c4045789-f468-4f00-85df-81a587322427
Nov 28 20:22:40 user nova-compute[75571]: INFO nova.virt.block_device [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Attempting to driver detach volume c4045789-f468-4f00-85df-81a587322427 from mountpoint /dev/vdb
Nov 28 20:22:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Attempting to detach device vdb from instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:22:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:22:40 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:22:40 user nova-compute[75571]:   <source dev="/dev/sde"/>
Nov 28 20:22:40 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:22:40 user nova-compute[75571]:   <serial>c4045789-f468-4f00-85df-81a587322427</serial>
Nov 28 20:22:40 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:22:40 user nova-compute[75571]: </disk>
Nov 28 20:22:40 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:22:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:40 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Successfully detached device vdb from instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f from the persistent domain config.
Nov 28 20:22:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:22:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:22:40 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:22:40 user nova-compute[75571]:   <source dev="/dev/sde"/>
Nov 28 20:22:40 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:22:40 user nova-compute[75571]:   <serial>c4045789-f468-4f00-85df-81a587322427</serial>
Nov 28 20:22:40 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:22:40 user nova-compute[75571]: </disk>
Nov 28 20:22:40 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:22:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:22:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "0061bf04-e594-4e9c-aeb1-5a29bb299749-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:45 user nova-compute[75571]: INFO nova.compute.manager [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Terminating instance
Nov 28 20:22:45 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:22:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-bde0455d-2c21-4d3a-9fe9-59cc2fdddb7a req-6d813f22-a75f-4033-80c8-51abc20ad29e service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Received event network-vif-unplugged-d90f48df-d39d-4f9e-b484-7cafb58c032d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:22:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bde0455d-2c21-4d3a-9fe9-59cc2fdddb7a req-6d813f22-a75f-4033-80c8-51abc20ad29e service nova] Acquiring lock "0061bf04-e594-4e9c-aeb1-5a29bb299749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bde0455d-2c21-4d3a-9fe9-59cc2fdddb7a req-6d813f22-a75f-4033-80c8-51abc20ad29e service nova] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bde0455d-2c21-4d3a-9fe9-59cc2fdddb7a req-6d813f22-a75f-4033-80c8-51abc20ad29e service nova] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-bde0455d-2c21-4d3a-9fe9-59cc2fdddb7a req-6d813f22-a75f-4033-80c8-51abc20ad29e service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] No waiting events found dispatching network-vif-unplugged-d90f48df-d39d-4f9e-b484-7cafb58c032d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:22:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-bde0455d-2c21-4d3a-9fe9-59cc2fdddb7a req-6d813f22-a75f-4033-80c8-51abc20ad29e service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Received event network-vif-unplugged-d90f48df-d39d-4f9e-b484-7cafb58c032d for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:22:46 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Instance destroyed successfully.
Nov 28 20:22:46 user nova-compute[75571]: DEBUG nova.objects.instance [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lazy-loading 'resources' on Instance uuid 0061bf04-e594-4e9c-aeb1-5a29bb299749 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:22:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-980991755',display_name='tempest-TestServerVolumeAttachmentScenario-server-980991755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-980991755',id=22,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJ6RJZRcy13eAf7NmGsUkRNJRh5VIZeh8ZBoDKubWzN8NQek5ymgNNtZ9BZ6I9MPo0LHKuylDgwk+TEMe1LEwks8Mm7vn/i95Rvj5pF5RMn2DpzEwA71rc1zhpzQCbWGw==',key_name='tempest-keypair-1886893260',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:18:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0b00222407b41f99d3b983afaeb6c5a',ramdisk_id='',reservation_id='r-qiy7tr83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-182534234',owner_user_name='tempest-TestServerVolumeAttachmentScenario-182534234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcac1e80fd41480b9250746018d93e2c',uuid=0061bf04-e594-4e9c-aeb1-5a29bb299749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "address": "fa:16:3e:08:e7:cd", "network": {"id": "0ea81c46-dc4e-497a-98de-313521fac370", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1733688335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b00222407b41f99d3b983afaeb6c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f48df-d3", "ovs_interfaceid": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:22:46 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Converting VIF {"id": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "address": "fa:16:3e:08:e7:cd", "network": {"id": "0ea81c46-dc4e-497a-98de-313521fac370", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1733688335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b00222407b41f99d3b983afaeb6c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f48df-d3", "ovs_interfaceid": "d90f48df-d39d-4f9e-b484-7cafb58c032d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:22:46 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:e7:cd,bridge_name='br-int',has_traffic_filtering=True,id=d90f48df-d39d-4f9e-b484-7cafb58c032d,network=Network(0ea81c46-dc4e-497a-98de-313521fac370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90f48df-d3') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:22:46 user nova-compute[75571]: DEBUG os_vif [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:e7:cd,bridge_name='br-int',has_traffic_filtering=True,id=d90f48df-d39d-4f9e-b484-7cafb58c032d,network=Network(0ea81c46-dc4e-497a-98de-313521fac370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90f48df-d3') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:22:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd90f48df-d3, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:22:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22122f9c-8876-47b8-8a5a-beaa6570fc86) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:22:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:46 user nova-compute[75571]: INFO os_vif [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:e7:cd,bridge_name='br-int',has_traffic_filtering=True,id=d90f48df-d39d-4f9e-b484-7cafb58c032d,network=Network(0ea81c46-dc4e-497a-98de-313521fac370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90f48df-d3')
Nov 28 20:22:46 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Deleting instance files /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749_del
Nov 28 20:22:46 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Deletion of /opt/stack/data/nova/instances/0061bf04-e594-4e9c-aeb1-5a29bb299749_del complete
Nov 28 20:22:46 user nova-compute[75571]: INFO nova.compute.manager [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 28 20:22:46 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:22:46 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:22:46 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:22:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:47 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:22:47 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Took 0.77 seconds to deallocate network for instance.
Nov 28 20:22:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-91411ca4-7d0e-4911-b946-0efadf0cb616 req-ecf7318f-acc5-470c-b2fa-693ffc4f4b4c service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Received event network-vif-deleted-d90f48df-d39d-4f9e-b484-7cafb58c032d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:22:47 user nova-compute[75571]: INFO nova.compute.manager [req-91411ca4-7d0e-4911-b946-0efadf0cb616 req-ecf7318f-acc5-470c-b2fa-693ffc4f4b4c service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Neutron deleted interface d90f48df-d39d-4f9e-b484-7cafb58c032d; detaching it from the instance and deleting it from the info cache
Nov 28 20:22:47 user nova-compute[75571]: DEBUG nova.network.neutron [req-91411ca4-7d0e-4911-b946-0efadf0cb616 req-ecf7318f-acc5-470c-b2fa-693ffc4f4b4c service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:22:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-91411ca4-7d0e-4911-b946-0efadf0cb616 req-ecf7318f-acc5-470c-b2fa-693ffc4f4b4c service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Detach interface failed, port_id=d90f48df-d39d-4f9e-b484-7cafb58c032d, reason: Instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:22:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:47 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:22:47 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:22:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:47 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Deleted allocations for instance 0061bf04-e594-4e9c-aeb1-5a29bb299749
Nov 28 20:22:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.252s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-cd59b5cb-eec0-4045-90e5-78df9cf24353 req-18344ab3-5baf-4a81-9fa8-48c1a17e55fe service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Received event network-vif-plugged-d90f48df-d39d-4f9e-b484-7cafb58c032d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:22:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cd59b5cb-eec0-4045-90e5-78df9cf24353 req-18344ab3-5baf-4a81-9fa8-48c1a17e55fe service nova] Acquiring lock "0061bf04-e594-4e9c-aeb1-5a29bb299749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:22:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cd59b5cb-eec0-4045-90e5-78df9cf24353 req-18344ab3-5baf-4a81-9fa8-48c1a17e55fe service nova] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:22:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cd59b5cb-eec0-4045-90e5-78df9cf24353 req-18344ab3-5baf-4a81-9fa8-48c1a17e55fe service nova] Lock "0061bf04-e594-4e9c-aeb1-5a29bb299749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:22:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-cd59b5cb-eec0-4045-90e5-78df9cf24353 req-18344ab3-5baf-4a81-9fa8-48c1a17e55fe service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] No waiting events found dispatching network-vif-plugged-d90f48df-d39d-4f9e-b484-7cafb58c032d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:22:47 user nova-compute[75571]: WARNING nova.compute.manager [req-cd59b5cb-eec0-4045-90e5-78df9cf24353 req-18344ab3-5baf-4a81-9fa8-48c1a17e55fe service nova] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Received unexpected event network-vif-plugged-d90f48df-d39d-4f9e-b484-7cafb58c032d for instance with vm_state deleted and task_state None.
Nov 28 20:22:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:22:59 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 86c31e96-70cf-45fd-9578-194706af2ad0 is timed out.
Nov 28 20:22:59 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Successfully detached device vdb from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the live domain config.
Nov 28 20:22:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQVZdipY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:22:59 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4732a3a-fdd4-425e-9d99-97c89e884477]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:22:59 user nova-compute[75571]: No targets found.
Nov 28 20:22:59 user nova-compute[75571]: iSNS:
Nov 28 20:22:59 user nova-compute[75571]: No targets found.
Nov 28 20:22:59 user nova-compute[75571]: STATIC:
Nov 28 20:22:59 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8
Nov 28 20:22:59 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:22:59 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:22:59 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427
Nov 28 20:22:59 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:22:59 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:22:59 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec
Nov 28 20:22:59 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:22:59 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:22:59 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618
Nov 28 20:22:59 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:22:59 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:22:59 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189
Nov 28 20:22:59 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:22:59 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:22:59 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:22:59 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:22:59 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:22:59 user nova-compute[75571]: FIRMWARE:
Nov 28 20:22:59 user nova-compute[75571]: No targets found.
Nov 28 20:22:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:22:59 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:22:59 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5b4ce8-a2bd-4899-b49b-588923a38859]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7034d93e-0af9-49f5-befa-7b98ff8a2fb9]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:59 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:59 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:59 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:59 user nova-compute[75571]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)
Nov 28 20:22:59 user nova-compute[75571]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 (non-flash)
Nov 28 20:22:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:22:59 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:22:59 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:22:59 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:22:59 user nova-compute[75571]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)
Nov 28 20:22:59 user nova-compute[75571]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 (non-flash)
Nov 28 20:22:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768567880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189'): ({'sdg'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Removing single pathed devices sdg {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67096f6-9786-44bc-9ac2-931583303b34]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaa1e82-8f37-4bbb-ae6d-48fddf345e64]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Flushing IO for device /dev/sdg {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47f212e-81af-495c-aaac-71e85b48ac9d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c992788f-2502-4c64-b899-7c81ed72a8d1]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] SCSI volumes sdg have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.050s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d2cd6c-9fa5-4f2d-ace2-5298e8b3f619]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f427f12-fd7a-4970-88e0-679f9eebd1e1]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189, portal: 172.16.0.220,3260]
Nov 28 20:22:59 user nova-compute[75571]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189, portal: 172.16.0.220,3260] successful.
Nov 28 20:22:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61c58bb2-320d-4d0d-8e14-a985e77aa189 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfa906a-7433-47e0-960c-a99907b0b88b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] <== disconnect_volume: return (357ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:22:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:23:00 user nova-compute[75571]: DEBUG nova.objects.instance [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'flavor' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:23:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.746s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:01 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f is timed out.
Nov 28 20:23:01 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Successfully detached device vdb from instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f from the live domain config.
Nov 28 20:23:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLxubqva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:23:01 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[df63ff3a-a994-46f1-9a1b-08d4216bf3cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:23:01 user nova-compute[75571]: No targets found.
Nov 28 20:23:01 user nova-compute[75571]: iSNS:
Nov 28 20:23:01 user nova-compute[75571]: No targets found.
Nov 28 20:23:01 user nova-compute[75571]: STATIC:
Nov 28 20:23:01 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8
Nov 28 20:23:01 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:23:01 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:23:01 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427
Nov 28 20:23:01 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:23:01 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:23:01 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec
Nov 28 20:23:01 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:23:01 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:23:01 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618
Nov 28 20:23:01 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:23:01 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:23:01 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:23:01 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:23:01 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:23:01 user nova-compute[75571]: FIRMWARE:
Nov 28 20:23:01 user nova-compute[75571]: No targets found.
Nov 28 20:23:01 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:23:01 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:23:01 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c1ee15-fd3d-4d8d-8b1e-ddc650368a12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be9e4e0-d26d-4293-952d-8174ece53cce]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:01 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:01 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:23:01 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:01 user nova-compute[75571]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)
Nov 28 20:23:01 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:01 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:01 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:23:01 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:01 user nova-compute[75571]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 (non-flash)
Nov 28 20:23:01 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f776878bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427'): ({'sde'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Removing single pathed devices sde {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f9f6d0-1485-49f6-911c-145e9510d3be]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad033402-3b62-49bf-93cd-e65ade2bd3cc]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Flushing IO for device /dev/sde {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8fa37f-b761-4838-af05-4e35637b7bf2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8e9cd0-6af9-449d-a812-3c1d8efc15d6]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] SCSI volumes sde have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[086790e2-6da3-4423-b6d9-9873cc4960ac]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[598c8840-16af-4403-9ad9-25a27cd96b8f]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427, portal: 172.16.0.220,3260]
Nov 28 20:23:01 user nova-compute[75571]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427, portal: 172.16.0.220,3260] successful.
Nov 28 20:23:01 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abe4e4d-eab5-4273-a506-1255499368ba]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] <== disconnect_volume: return (318ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:23:01 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG nova.objects.instance [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lazy-loading 'flavor' on Instance uuid 2f47c1e6-8450-4e8c-bfc7-99041345ab4f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.697s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.574s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:02 user nova-compute[75571]: INFO nova.compute.manager [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Terminating instance
Nov 28 20:23:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-b99ef5d6-1dea-43d6-963c-2fd353af42d9 req-1026fc83-455a-4296-946f-bc03067464a2 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Received event network-vif-unplugged-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b99ef5d6-1dea-43d6-963c-2fd353af42d9 req-1026fc83-455a-4296-946f-bc03067464a2 service nova] Acquiring lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b99ef5d6-1dea-43d6-963c-2fd353af42d9 req-1026fc83-455a-4296-946f-bc03067464a2 service nova] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b99ef5d6-1dea-43d6-963c-2fd353af42d9 req-1026fc83-455a-4296-946f-bc03067464a2 service nova] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-b99ef5d6-1dea-43d6-963c-2fd353af42d9 req-1026fc83-455a-4296-946f-bc03067464a2 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] No waiting events found dispatching network-vif-unplugged-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:23:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-b99ef5d6-1dea-43d6-963c-2fd353af42d9 req-1026fc83-455a-4296-946f-bc03067464a2 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Received event network-vif-unplugged-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:23:03 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Instance destroyed successfully.
Nov 28 20:23:03 user nova-compute[75571]: DEBUG nova.objects.instance [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lazy-loading 'resources' on Instance uuid 2f47c1e6-8450-4e8c-bfc7-99041345ab4f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1332545386',display_name='tempest-VolumesSnapshotTestJSON-instance-1332545386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1332545386',id=26,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEe+U0yATBZxQ9869JR+Ry2x+zXaAsyzCIkLVlxJuCzBwEDsBg6c7RuNJ8gA/Szm2NBEa0jvxejV7Y8Q4TuJC8bs5g+QCEs7wblJAv8NhiTw7iVdzrfIqdsDfMskYQkNvA==',key_name='tempest-keypair-1730482313',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548f7955f73e434cb014eeaeffa2824f',ramdisk_id='',reservation_id='r-dnn01gs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2135983630',owner_user_name='tempest-VolumesSnapshotTestJSON-2135983630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:20:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='740070b2e6434ca9a733cb932663572c',uuid=2f47c1e6-8450-4e8c-bfc7-99041345ab4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "address": "fa:16:3e:e7:9f:a8", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2c8a4a-7c", "ovs_interfaceid": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Converting VIF {"id": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "address": "fa:16:3e:e7:9f:a8", "network": {"id": "80eb1442-8e05-4d31-96b5-26df5f47f887", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79161895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548f7955f73e434cb014eeaeffa2824f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2c8a4a-7c", "ovs_interfaceid": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:9f:a8,bridge_name='br-int',has_traffic_filtering=True,id=0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf,network=Network(80eb1442-8e05-4d31-96b5-26df5f47f887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2c8a4a-7c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG os_vif [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:9f:a8,bridge_name='br-int',has_traffic_filtering=True,id=0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf,network=Network(80eb1442-8e05-4d31-96b5-26df5f47f887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2c8a4a-7c') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a2c8a4a-7c, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08661d33-2863-4cf2-9d65-5cd38c7ebae1) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:23:03 user nova-compute[75571]: INFO os_vif [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:9f:a8,bridge_name='br-int',has_traffic_filtering=True,id=0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf,network=Network(80eb1442-8e05-4d31-96b5-26df5f47f887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2c8a4a-7c')
Nov 28 20:23:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLxubqva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:23:03 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:23:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec980944-a471-4aa9-a137-ec7e1e954978]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:23:03 user nova-compute[75571]: No targets found.
Nov 28 20:23:03 user nova-compute[75571]: iSNS:
Nov 28 20:23:03 user nova-compute[75571]: No targets found.
Nov 28 20:23:03 user nova-compute[75571]: STATIC:
Nov 28 20:23:03 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8
Nov 28 20:23:03 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:23:03 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:23:03 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec
Nov 28 20:23:03 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:23:03 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:23:03 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618
Nov 28 20:23:03 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:23:03 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:23:03 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:23:03 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:23:03 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:23:03 user nova-compute[75571]: FIRMWARE:
Nov 28 20:23:03 user nova-compute[75571]: No targets found.
Nov 28 20:23:03 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:23:03 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:23:03 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4045789-f468-4f00-85df-81a587322427', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf636286-a3ae-4ae5-9236-b18e92ea9d00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5d9535-c95f-434b-bc7a-14a323d7e2d1]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:03 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:03 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:23:03 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:03 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:03 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:03 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:23:03 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:03 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f776878a3b0>, {}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Disconnecting from: [] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] <== disconnect_volume: return (70ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:23:03 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Deleting instance files /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f_del
Nov 28 20:23:03 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Deletion of /opt/stack/data/nova/instances/2f47c1e6-8450-4e8c-bfc7-99041345ab4f_del complete
Nov 28 20:23:03 user nova-compute[75571]: INFO nova.compute.manager [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 28 20:23:03 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:23:03 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Took 0.70 seconds to deallocate network for instance.
Nov 28 20:23:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-1902d0a4-a77c-4570-a969-b83b49cf17dc req-4915f781-7a4a-46d5-b4d6-536ce55113bf service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Received event network-vif-deleted-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:03 user nova-compute[75571]: WARNING nova.volume.cinder [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Attachment d1ff6167-c458-42c5-8e55-e4c3c2703dc0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d1ff6167-c458-42c5-8e55-e4c3c2703dc0. (HTTP 404) (Request-ID: req-58ea8f58-425b-4a1e-b1fe-a511a73a7709)
Nov 28 20:23:03 user nova-compute[75571]: INFO nova.compute.manager [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Took 0.03 seconds to detach 1 volumes for instance.
Nov 28 20:23:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:04 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:23:04 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:23:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:04 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Deleted allocations for instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f
Nov 28 20:23:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.295s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-bdbc319a-c078-4f49-bcfe-8b15ece28fa4 req-345896fc-0983-4cb5-a8c6-117e3ac6c793 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Received event network-vif-plugged-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bdbc319a-c078-4f49-bcfe-8b15ece28fa4 req-345896fc-0983-4cb5-a8c6-117e3ac6c793 service nova] Acquiring lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bdbc319a-c078-4f49-bcfe-8b15ece28fa4 req-345896fc-0983-4cb5-a8c6-117e3ac6c793 service nova] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bdbc319a-c078-4f49-bcfe-8b15ece28fa4 req-345896fc-0983-4cb5-a8c6-117e3ac6c793 service nova] Lock "2f47c1e6-8450-4e8c-bfc7-99041345ab4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-bdbc319a-c078-4f49-bcfe-8b15ece28fa4 req-345896fc-0983-4cb5-a8c6-117e3ac6c793 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] No waiting events found dispatching network-vif-plugged-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:23:04 user nova-compute[75571]: WARNING nova.compute.manager [req-bdbc319a-c078-4f49-bcfe-8b15ece28fa4 req-345896fc-0983-4cb5-a8c6-117e3ac6c793 service nova] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Received unexpected event network-vif-plugged-0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf for instance with vm_state deleted and task_state None.
Nov 28 20:23:04 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:23:04 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:23:04 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:23:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:23:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:23:05 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:23:05 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Updating instance_info_cache with network_info: [{"id": "fc196680-3f93-4710-b508-752c9aa39f18", "address": "fa:16:3e:44:80:a9", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc196680-3f", "ovs_interfaceid": "fc196680-3f93-4710-b508-752c9aa39f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:23:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:23:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:23:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:23:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:23:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:23:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:23:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:23:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:23:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:23:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:23:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:23:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:23:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:23:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:23:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:09 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:23:09 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:23:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=7582MB free_disk=25.011417388916016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:23:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:23:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:23:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 86c31e96-70cf-45fd-9578-194706af2ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:23:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 40ac5386-d43f-443c-ac15-186b368728f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:23:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:23:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 313a065e-94f3-4435-97af-6a16de64ca7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:23:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 11c97ebd-b684-4c98-9f49-57d25ea0c81b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:23:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 93392110-c3c3-44ff-a046-2f11608106c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:23:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:23:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:23:10 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:23:10 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:23:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:23:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:16 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:23:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:23:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:23:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:23:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:23:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:23:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG nova.objects.instance [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'flavor' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:32 user nova-compute[75571]: INFO nova.compute.manager [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Attaching volume 7e364a33-a5d7-4aab-a5e4-df5722cafbcc to /dev/vdb
Nov 28 20:23:32 user nova-compute[75571]: DEBUG os_brick.utils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8279e2-7dc1-4bba-994d-8e85ebfc9cb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f2ae3c-1fcd-4ffe-a654-f4d83f02b551]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ada92b-fa85-4f87-a23c-d20fa8b9d42c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b5db76-4699-4552-acd6-1ffef8250ead]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:23:32 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:23:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d397c0-30a3-4201-b219-59c71927f787]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG os_brick.utils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:23:32 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Updating existing volume attachment record: db4ca7d9-1077-4706-af62-ee8cc7f81fc9 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:23:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:35 user nova-compute[75571]: INFO nova.compute.manager [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Terminating instance
Nov 28 20:23:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-edf884b9-29a7-460f-9918-4d84002a9c83 req-13f382bb-e61f-458d-813e-ac8de1aa1e62 service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Received event network-vif-unplugged-7397580b-2855-4fab-b878-638f22ebbc53 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-edf884b9-29a7-460f-9918-4d84002a9c83 req-13f382bb-e61f-458d-813e-ac8de1aa1e62 service nova] Acquiring lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-edf884b9-29a7-460f-9918-4d84002a9c83 req-13f382bb-e61f-458d-813e-ac8de1aa1e62 service nova] Lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-edf884b9-29a7-460f-9918-4d84002a9c83 req-13f382bb-e61f-458d-813e-ac8de1aa1e62 service nova] Lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-edf884b9-29a7-460f-9918-4d84002a9c83 req-13f382bb-e61f-458d-813e-ac8de1aa1e62 service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] No waiting events found dispatching network-vif-unplugged-7397580b-2855-4fab-b878-638f22ebbc53 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-edf884b9-29a7-460f-9918-4d84002a9c83 req-13f382bb-e61f-458d-813e-ac8de1aa1e62 service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Received event network-vif-unplugged-7397580b-2855-4fab-b878-638f22ebbc53 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:23:35 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Instance destroyed successfully.
Nov 28 20:23:35 user nova-compute[75571]: DEBUG nova.objects.instance [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lazy-loading 'resources' on Instance uuid 11c97ebd-b684-4c98-9f49-57d25ea0c81b {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-135830086',display_name='tempest-ServersNegativeTestJSON-server-135830086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-135830086',id=28,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:21:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc33efd1bb7f49679e13621e8dd3449a',ramdisk_id='',reservation_id='r-3v4c56dq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-146088746',owner_user_name='tempest-ServersNegativeTestJSON-146088746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:21:52Z,user_data=None,user_id='24aa8ca42c7342fa91f5eab19b6c0c9b',uuid=11c97ebd-b684-4c98-9f49-57d25ea0c81b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7397580b-2855-4fab-b878-638f22ebbc53", "address": "fa:16:3e:82:47:6a", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7397580b-28", "ovs_interfaceid": "7397580b-2855-4fab-b878-638f22ebbc53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Converting VIF {"id": "7397580b-2855-4fab-b878-638f22ebbc53", "address": "fa:16:3e:82:47:6a", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7397580b-28", "ovs_interfaceid": "7397580b-2855-4fab-b878-638f22ebbc53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:47:6a,bridge_name='br-int',has_traffic_filtering=True,id=7397580b-2855-4fab-b878-638f22ebbc53,network=Network(b45a9bdc-c522-435b-8532-28ec9780b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7397580b-28') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG os_vif [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:47:6a,bridge_name='br-int',has_traffic_filtering=True,id=7397580b-2855-4fab-b878-638f22ebbc53,network=Network(b45a9bdc-c522-435b-8532-28ec9780b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7397580b-28') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7397580b-28, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37b767d9-13c2-4704-b634-7ad8c87bd927) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:23:35 user nova-compute[75571]: INFO os_vif [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:47:6a,bridge_name='br-int',has_traffic_filtering=True,id=7397580b-2855-4fab-b878-638f22ebbc53,network=Network(b45a9bdc-c522-435b-8532-28ec9780b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7397580b-28')
Nov 28 20:23:35 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Deleting instance files /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b_del
Nov 28 20:23:35 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Deletion of /opt/stack/data/nova/instances/11c97ebd-b684-4c98-9f49-57d25ea0c81b_del complete
Nov 28 20:23:35 user nova-compute[75571]: INFO nova.compute.manager [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 28 20:23:35 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:23:35 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:36 user nova-compute[75571]: INFO nova.compute.manager [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Unshelving
Nov 28 20:23:36 user nova-compute[75571]: INFO nova.virt.block_device [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Booting with volume eaa2b1ac-220a-42a8-99fd-893e37359fd9 at /dev/vda
Nov 28 20:23:36 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:23:36 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Took 0.53 seconds to deallocate network for instance.
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG os_brick.utils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f2342e-4c0d-4e2e-8bb8-a2f80d99ad81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2a18cb-d181-4b0c-896a-b98ac5569d70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[516e5741-e36d-454b-a0a1-d3fa3b771a6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[462b3066-70d0-403e-8609-e4ef710e7918]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:23:36 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[55adec65-6bdd-4b2f-885c-8a4925e43f18]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG os_brick.utils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updating existing volume attachment record: d5043967-df1f-4c3c-87a0-5c8f0aa66bdd {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:23:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:37 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Deleted allocations for instance 11c97ebd-b684-4c98-9f49-57d25ea0c81b
Nov 28 20:23:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.896s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-b7586180-7678-483b-83da-31a7bf331f6f req-2e7a382c-c000-40eb-9aef-68772f054c24 service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Received event network-vif-plugged-7397580b-2855-4fab-b878-638f22ebbc53 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b7586180-7678-483b-83da-31a7bf331f6f req-2e7a382c-c000-40eb-9aef-68772f054c24 service nova] Acquiring lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b7586180-7678-483b-83da-31a7bf331f6f req-2e7a382c-c000-40eb-9aef-68772f054c24 service nova] Lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b7586180-7678-483b-83da-31a7bf331f6f req-2e7a382c-c000-40eb-9aef-68772f054c24 service nova] Lock "11c97ebd-b684-4c98-9f49-57d25ea0c81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-b7586180-7678-483b-83da-31a7bf331f6f req-2e7a382c-c000-40eb-9aef-68772f054c24 service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] No waiting events found dispatching network-vif-plugged-7397580b-2855-4fab-b878-638f22ebbc53 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:23:37 user nova-compute[75571]: WARNING nova.compute.manager [req-b7586180-7678-483b-83da-31a7bf331f6f req-2e7a382c-c000-40eb-9aef-68772f054c24 service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Received unexpected event network-vif-plugged-7397580b-2855-4fab-b878-638f22ebbc53 for instance with vm_state deleted and task_state None.
Nov 28 20:23:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-b7586180-7678-483b-83da-31a7bf331f6f req-2e7a382c-c000-40eb-9aef-68772f054c24 service nova] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Received event network-vif-deleted-7397580b-2855-4fab-b878-638f22ebbc53 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-ff885c66-1ed2-4fa7-a571-d7e991669fc2 req-0c478121-fc84-4800-928b-9f31c751e4cd service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Received event network-changed-ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-ff885c66-1ed2-4fa7-a571-d7e991669fc2 req-0c478121-fc84-4800-928b-9f31c751e4cd service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Refreshing instance network info cache due to event network-changed-ba72889d-186f-4e53-893b-5509d0882a6a. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:23:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ff885c66-1ed2-4fa7-a571-d7e991669fc2 req-0c478121-fc84-4800-928b-9f31c751e4cd service nova] Acquiring lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:23:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ff885c66-1ed2-4fa7-a571-d7e991669fc2 req-0c478121-fc84-4800-928b-9f31c751e4cd service nova] Acquired lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:23:39 user nova-compute[75571]: DEBUG nova.network.neutron [req-ff885c66-1ed2-4fa7-a571-d7e991669fc2 req-0c478121-fc84-4800-928b-9f31c751e4cd service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Refreshing network info cache for port ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UICcXFKj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:23:40 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:23:40 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:23:40 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0762176-a1cb-400b-be5b-6195bc5d511c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:23:40 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d9e0f3-1004-4fa3-9b21-749643f2f563]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc] added
Nov 28 20:23:40 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8154d1e0-d8c5-429e-ab6b-83f4e6a5739e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d050f41d-f3c4-438a-bd34-bc17242e0c73]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UICcXFKj {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UICcXFKj" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba138a9-85e6-4abf-b8d6-9d3347c4520c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UICcXFKj'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca55a5a-9ff0-4c87-90cc-13812f7631f9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25adaac-f9e5-49b9-b35b-b13262f81bed]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:40 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:40 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:23:40 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:40 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:40 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:40 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:23:40 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:40 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe1392e-3a4a-46c9-a2c6-ac09c2284eae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc, portal: 172.16.0.220,3260]
Nov 28 20:23:40 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc, portal: 172.16.0.220,3260] successful.
Nov 28 20:23:40 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fd9285-075d-4f7d-8ad6-f95418efb476]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e86fb3-92da-45e4-99d7-be3913e4a61b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:40 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:40 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:23:40 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:40 user nova-compute[75571]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)
Nov 28 20:23:40 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:40 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:40 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:23:40 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:40 user nova-compute[75571]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)
Nov 28 20:23:40 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG nova.network.neutron [req-ff885c66-1ed2-4fa7-a571-d7e991669fc2 req-0c478121-fc84-4800-928b-9f31c751e4cd service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updated VIF entry in instance network info cache for port ba72889d-186f-4e53-893b-5509d0882a6a. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG nova.network.neutron [req-ff885c66-1ed2-4fa7-a571-d7e991669fc2 req-0c478121-fc84-4800-928b-9f31c751e4cd service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updating instance_info_cache with network_info: [{"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9780338b-0654-41a2-bee0-bb19ecac9e31]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UICcXFKj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ff885c66-1ed2-4fa7-a571-d7e991669fc2 req-0c478121-fc84-4800-928b-9f31c751e4cd service nova] Releasing lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:23:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.553s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:23:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] <== connect_volume: return (1556ms) {'type': 'block', 'scsi_wwn': '23561653337393935', 'path': '/dev/sde'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:23:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561653337393935', 'path': '/dev/sde'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:23:41 user nova-compute[75571]: DEBUG nova.objects.instance [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'flavor' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:23:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:23:41 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:23:41 user nova-compute[75571]:   <source dev="/dev/sde"/>
Nov 28 20:23:41 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:23:41 user nova-compute[75571]:   <serial>7e364a33-a5d7-4aab-a5e4-df5722cafbcc</serial>
Nov 28 20:23:41 user nova-compute[75571]: </disk>
Nov 28 20:23:41 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:23:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Stashing vm_state: active {{(pid=75571) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 20:23:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-f9dadff8-cb0d-4e6e-9213-70d4dca3d33d req-44338890-9457-40fd-9282-c42fd23ad3ab service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received event network-changed-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-f9dadff8-cb0d-4e6e-9213-70d4dca3d33d req-44338890-9457-40fd-9282-c42fd23ad3ab service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Refreshing instance network info cache due to event network-changed-45eabb36-f147-4900-b1dc-8b48e4141866. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:23:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f9dadff8-cb0d-4e6e-9213-70d4dca3d33d req-44338890-9457-40fd-9282-c42fd23ad3ab service nova] Acquiring lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:23:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f9dadff8-cb0d-4e6e-9213-70d4dca3d33d req-44338890-9457-40fd-9282-c42fd23ad3ab service nova] Acquired lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:23:41 user nova-compute[75571]: DEBUG nova.network.neutron [req-f9dadff8-cb0d-4e6e-9213-70d4dca3d33d req-44338890-9457-40fd-9282-c42fd23ad3ab service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Refreshing network info cache for port 45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:23:42 user nova-compute[75571]: INFO nova.compute.claims [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Claim successful on node user
Nov 28 20:23:42 user nova-compute[75571]: INFO nova.compute.resource_tracker [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Updating resource usage from migration 52387bd7-c123-444c-85c1-ea3dc0d14494
Nov 28 20:23:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] No VIF found with MAC fa:16:3e:94:a9:66, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.029s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG nova.network.neutron [req-f9dadff8-cb0d-4e6e-9213-70d4dca3d33d req-44338890-9457-40fd-9282-c42fd23ad3ab service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Updated VIF entry in instance network info cache for port 45eabb36-f147-4900-b1dc-8b48e4141866. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG nova.network.neutron [req-f9dadff8-cb0d-4e6e-9213-70d4dca3d33d req-44338890-9457-40fd-9282-c42fd23ad3ab service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Updating instance_info_cache with network_info: [{"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f9dadff8-cb0d-4e6e-9213-70d4dca3d33d req-44338890-9457-40fd-9282-c42fd23ad3ab service nova] Releasing lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.503s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:42 user nova-compute[75571]: INFO nova.compute.manager [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Migrating
Nov 28 20:23:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquired lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Updating instance_info_cache with network_info: [{"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:23:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Releasing lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Starting migrate_disk_and_power_off {{(pid=75571) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-ff618e56-238a-4520-bdd7-fb38a576ec0d req-bf3fdf26-b61d-4b32-843d-7bd92e853474 service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received event network-vif-unplugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ff618e56-238a-4520-bdd7-fb38a576ec0d req-bf3fdf26-b61d-4b32-843d-7bd92e853474 service nova] Acquiring lock "93392110-c3c3-44ff-a046-2f11608106c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ff618e56-238a-4520-bdd7-fb38a576ec0d req-bf3fdf26-b61d-4b32-843d-7bd92e853474 service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ff618e56-238a-4520-bdd7-fb38a576ec0d req-bf3fdf26-b61d-4b32-843d-7bd92e853474 service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-ff618e56-238a-4520-bdd7-fb38a576ec0d req-bf3fdf26-b61d-4b32-843d-7bd92e853474 service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] No waiting events found dispatching network-vif-unplugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:23:43 user nova-compute[75571]: WARNING nova.compute.manager [req-ff618e56-238a-4520-bdd7-fb38a576ec0d req-bf3fdf26-b61d-4b32-843d-7bd92e853474 service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received unexpected event network-vif-unplugged-45eabb36-f147-4900-b1dc-8b48e4141866 for instance with vm_state active and task_state resize_migrating.
Nov 28 20:23:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:43 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Instance destroyed successfully.
Nov 28 20:23:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1507891953',display_name='tempest-ServerActionsTestOtherA-server-1507891953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1507891953',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORLi9cBeKxwKZF2rkLIldgYbs91Se5SaovgAyOLlR1LAXkmJO85TwVIU01jacVfp8MokOP7s1wTMn2ItcMxD1z+b2y7pkirDp4yb/pOf68MDBPxyqhiOej8r0TiPf6AAg==',key_name='tempest-keypair-344088806',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:22:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a85595c9e1704e71903d25a65f5b696c',ramdisk_id='',reservation_id='r-0cgit2ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-390918760',owner_user_name='tempest-ServerActionsTestOtherA-390918760-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:23:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098319d33fa243f5a044cf3f3c9f983c',uuid=93392110-c3c3-44ff-a046-2f11608106c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-984729900-network", "vif_mac": "fa:16:3e:a9:a2:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converting VIF {"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-984729900-network", "vif_mac": "fa:16:3e:a9:a2:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:a2:04,bridge_name='br-int',has_traffic_filtering=True,id=45eabb36-f147-4900-b1dc-8b48e4141866,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eabb36-f1') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG os_vif [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:a2:04,bridge_name='br-int',has_traffic_filtering=True,id=45eabb36-f147-4900-b1dc-8b48e4141866,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eabb36-f1') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45eabb36-f1, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae595b55-23d6-4b9c-9052-be7d1afb7871) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:23:43 user nova-compute[75571]: INFO os_vif [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:a2:04,bridge_name='br-int',has_traffic_filtering=True,id=45eabb36-f147-4900-b1dc-8b48e4141866,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eabb36-f1')
Nov 28 20:23:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqDoeFXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:23:43 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:23:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[487b31b5-c86f-4024-a3ac-1a9af6e7b911]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:23:43 user nova-compute[75571]: No targets found.
Nov 28 20:23:43 user nova-compute[75571]: iSNS:
Nov 28 20:23:43 user nova-compute[75571]: No targets found.
Nov 28 20:23:43 user nova-compute[75571]: STATIC:
Nov 28 20:23:43 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc
Nov 28 20:23:43 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:23:43 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:23:43 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8
Nov 28 20:23:43 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:23:43 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:23:43 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec
Nov 28 20:23:43 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:23:43 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:23:43 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618
Nov 28 20:23:43 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:23:43 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:23:43 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:23:43 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:23:43 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:23:43 user nova-compute[75571]: FIRMWARE:
Nov 28 20:23:43 user nova-compute[75571]: No targets found.
Nov 28 20:23:43 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:23:43 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:23:43 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2398bad1-ac15-45f8-8b05-ec951d99b7ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f98becc-665b-4def-bb4f-6129403dbe00]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:43 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:43 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:23:43 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:43 user nova-compute[75571]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)
Nov 28 20:23:43 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:43 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:43 user nova-compute[75571]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:23:43 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:43 user nova-compute[75571]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)
Nov 28 20:23:43 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768564160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8'): ({'sdc'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Removing single pathed devices sdc {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:23:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.125s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d026d2-ca33-41b4-a6cf-dddf6540ef47]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b5d7e2-2a99-4d76-a825-13422328e078]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flushing IO for device /dev/sdc {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e95974e-2c54-4b6a-8ec8-460334ab962f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4653bd-107f-412c-a916-2e430bdaf89f]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4adf19d9', '/dev/disk/by-id/scsi-1SCST_BIO4adf19d9-2582687a82fe4316', '/dev/disk/by-id/scsi-23235383236383761') {{(pid=86013) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a85471-56ca-4969-a434-3aa77d5076fb]: (4, None) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8941b19-9ff5-4618-a90a-2b18f60cba24]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97a4930-dd03-4ef9-b7c0-e7c3e2e05315]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260]
Nov 28 20:23:44 user nova-compute[75571]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260] successful.
Nov 28 20:23:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9beedb-8b8a-4f99-bcae-7cf07f4fb608]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.498s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] <== disconnect_volume: return (499ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG nova.objects.instance [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lazy-loading 'pci_requests' on Instance uuid f95d416b-d3b7-4b16-adc7-83a06088e167 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG nova.objects.instance [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lazy-loading 'numa_topology' on Instance uuid f95d416b-d3b7-4b16-adc7-83a06088e167 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:23:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:23:44 user nova-compute[75571]: INFO nova.compute.claims [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Claim successful on node user
Nov 28 20:23:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:45 user nova-compute[75571]: INFO nova.compute.manager [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Detaching volume 7e364a33-a5d7-4aab-a5e4-df5722cafbcc
Nov 28 20:23:45 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:23:45 user nova-compute[75571]: INFO nova.virt.block_device [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Attempting to driver detach volume 7e364a33-a5d7-4aab-a5e4-df5722cafbcc from mountpoint /dev/vdb
Nov 28 20:23:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-ca98b179-80a2-4f71-9ec6-bbb2bf6455cf req-4963cb5d-b15a-43e5-a4a3-883d57bcf70c service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received event network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ca98b179-80a2-4f71-9ec6-bbb2bf6455cf req-4963cb5d-b15a-43e5-a4a3-883d57bcf70c service nova] Acquiring lock "93392110-c3c3-44ff-a046-2f11608106c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ca98b179-80a2-4f71-9ec6-bbb2bf6455cf req-4963cb5d-b15a-43e5-a4a3-883d57bcf70c service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ca98b179-80a2-4f71-9ec6-bbb2bf6455cf req-4963cb5d-b15a-43e5-a4a3-883d57bcf70c service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-ca98b179-80a2-4f71-9ec6-bbb2bf6455cf req-4963cb5d-b15a-43e5-a4a3-883d57bcf70c service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] No waiting events found dispatching network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:23:45 user nova-compute[75571]: WARNING nova.compute.manager [req-ca98b179-80a2-4f71-9ec6-bbb2bf6455cf req-4963cb5d-b15a-43e5-a4a3-883d57bcf70c service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received unexpected event network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 for instance with vm_state active and task_state resize_migrating.
Nov 28 20:23:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Attempting to detach device vdb from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:23:45 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:23:45 user nova-compute[75571]:   <source dev="/dev/sde"/>
Nov 28 20:23:45 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:23:45 user nova-compute[75571]:   <serial>7e364a33-a5d7-4aab-a5e4-df5722cafbcc</serial>
Nov 28 20:23:45 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:23:45 user nova-compute[75571]: </disk>
Nov 28 20:23:45 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:23:45 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Successfully detached device vdb from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the persistent domain config.
Nov 28 20:23:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:23:45 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:23:45 user nova-compute[75571]:   <source dev="/dev/sde"/>
Nov 28 20:23:45 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:23:45 user nova-compute[75571]:   <serial>7e364a33-a5d7-4aab-a5e4-df5722cafbcc</serial>
Nov 28 20:23:45 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:23:45 user nova-compute[75571]: </disk>
Nov 28 20:23:45 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:23:45 user nova-compute[75571]: INFO nova.network.neutron [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updating port 4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG nova.network.neutron [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Port 45eabb36-f147-4900-b1dc-8b48e4141866 binding to destination host user is already ACTIVE {{(pid=75571) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "93392110-c3c3-44ff-a046-2f11608106c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquired lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG nova.network.neutron [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:23:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquired lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Updating instance_info_cache with network_info: [{"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-407e39db-d5c6-4654-8002-159a3b66b9d0 req-c49d1387-0983-4194-b4a4-4394286c7a14 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-changed-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-407e39db-d5c6-4654-8002-159a3b66b9d0 req-c49d1387-0983-4194-b4a4-4394286c7a14 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Refreshing instance network info cache due to event network-changed-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-407e39db-d5c6-4654-8002-159a3b66b9d0 req-c49d1387-0983-4194-b4a4-4394286c7a14 service nova] Acquiring lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Releasing lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG os_brick.utils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0ca6f9-c73d-4428-b302-eb3debf3d817]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f78604-22c1-425a-b098-d8a519922f1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7cd7f8-f4d2-40ee-9536-c78500322d09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3975ac6-7b45-4c48-be0e-19e15c215cbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:23:46 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f229f0-7380-45cb-9609-27549d2bb509]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG os_brick.utils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updating instance_info_cache with network_info: [{"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Releasing lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:23:46 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Creating image(s)
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Ensure instance console log exists: /opt/stack/data/nova/instances/f95d416b-d3b7-4b16-adc7-83a06088e167/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Start _get_guest_xml network_info=[{"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhaHYKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f95d416b-d3b7-4b16-adc7-83a06088e167', 'attached_at': '', 'detached_at': '', 'volume_id': 'eaa2b1ac-220a-42a8-99fd-893e37359fd9', 'serial': 'eaa2b1ac-220a-42a8-99fd-893e37359fd9'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'd5043967-df1f-4c3c-87a0-5c8f0aa66bdd', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-407e39db-d5c6-4654-8002-159a3b66b9d0 req-c49d1387-0983-4194-b4a4-4394286c7a14 service nova] Acquired lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.network.neutron [req-407e39db-d5c6-4654-8002-159a3b66b9d0 req-c49d1387-0983-4194-b4a4-4394286c7a14 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Refreshing network info cache for port 4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:23:46 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:23:46 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:23:46 user nova-compute[75571]: DEBUG nova.objects.instance [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lazy-loading 'vcpu_model' on Instance uuid f95d416b-d3b7-4b16-adc7-83a06088e167 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG nova.objects.base [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Object Instance<f95d416b-d3b7-4b16-adc7-83a06088e167> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhaHYKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:23:47 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:23:47 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:23:47 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e6098c-c883-476f-88ff-10ae809892fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:23:47 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2476cd3-d39e-4fad-9982-86c5b9652373]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9] added
Nov 28 20:23:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb69cbf-3ddc-4518-8723-98144d437001]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d9edb7-775f-43a1-8f0a-d12a3321818d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oVhaHYKk {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oVhaHYKk" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b53241a-11e7-41cd-8d7d-78a1e13ce084]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oVhaHYKk'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca9c8b5-6219-42ca-92dc-7ddbde359aef]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c2d229-bd28-4463-8c5d-adf802ab8c42]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:47 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:47 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:47 user nova-compute[75571]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)
Nov 28 20:23:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:47 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:47 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:47 user nova-compute[75571]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)
Nov 28 20:23:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d213e2-ef06-4f41-bcbe-1ee096851f7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260]
Nov 28 20:23:47 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260] successful.
Nov 28 20:23:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2bd933-7e05-4437-8020-f3e41d7078ea]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f5a54a-8c7f-4ddf-98d6-01e9419148dd]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:47 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:47 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:47 user nova-compute[75571]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)
Nov 28 20:23:47 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:23:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:47 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:47 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:47 user nova-compute[75571]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)
Nov 28 20:23:47 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:23:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[680401cf-b4aa-4e09-8152-d86ee467b915]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhaHYKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG nova.network.neutron [req-407e39db-d5c6-4654-8002-159a3b66b9d0 req-c49d1387-0983-4194-b4a4-4394286c7a14 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updated VIF entry in instance network info cache for port 4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG nova.network.neutron [req-407e39db-d5c6-4654-8002-159a3b66b9d0 req-c49d1387-0983-4194-b4a4-4394286c7a14 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updating instance_info_cache with network_info: [{"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:23:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-407e39db-d5c6-4654-8002-159a3b66b9d0 req-c49d1387-0983-4194-b4a4-4394286c7a14 service nova] Releasing lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26636633632386330', 'path': '/dev/sdc'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636633632386330', 'path': '/dev/sdc'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1766072383',display_name='tempest-TestShelveInstance-server-1766072383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1766072383',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-752726007',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:20:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8bcf01c7a7d24806a2ffe82ec75c8a51',ramdisk_id='',reservation_id='r-6nppqoc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1960669737',owner_user_name='tempest-TestShelveInstance-1960669737-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:23:36Z,user_data=None,user_id='ca4e178401f940438a766a048076af93',uuid=f95d416b-d3b7-4b16-adc7-83a06088e167,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Converting VIF {"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:2e:14,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f,network=Network(559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6a23-8c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG nova.objects.instance [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lazy-loading 'pci_devices' on Instance uuid f95d416b-d3b7-4b16-adc7-83a06088e167 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG nova.objects.base [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Object Instance<f95d416b-d3b7-4b16-adc7-83a06088e167> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:23:48 user nova-compute[75571]:   <uuid>f95d416b-d3b7-4b16-adc7-83a06088e167</uuid>
Nov 28 20:23:48 user nova-compute[75571]:   <name>instance-00000018</name>
Nov 28 20:23:48 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:23:48 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:23:48 user nova-compute[75571]:   <metadata>
Nov 28 20:23:48 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:23:48 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:23:48 user nova-compute[75571]:       <nova:name>tempest-TestShelveInstance-server-1766072383</nova:name>
Nov 28 20:23:48 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:23:46</nova:creationTime>
Nov 28 20:23:48 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:23:48 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:23:48 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:23:48 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:23:48 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:23:48 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:23:48 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:23:48 user nova-compute[75571]:       <nova:owner>
Nov 28 20:23:48 user nova-compute[75571]:         <nova:user uuid="ca4e178401f940438a766a048076af93">tempest-TestShelveInstance-1960669737-project-member</nova:user>
Nov 28 20:23:48 user nova-compute[75571]:         <nova:project uuid="8bcf01c7a7d24806a2ffe82ec75c8a51">tempest-TestShelveInstance-1960669737</nova:project>
Nov 28 20:23:48 user nova-compute[75571]:       </nova:owner>
Nov 28 20:23:48 user nova-compute[75571]:       <nova:ports>
Nov 28 20:23:48 user nova-compute[75571]:         <nova:port uuid="4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f">
Nov 28 20:23:48 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 20:23:48 user nova-compute[75571]:         </nova:port>
Nov 28 20:23:48 user nova-compute[75571]:       </nova:ports>
Nov 28 20:23:48 user nova-compute[75571]:     </nova:instance>
Nov 28 20:23:48 user nova-compute[75571]:   </metadata>
Nov 28 20:23:48 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:23:48 user nova-compute[75571]:     <system>
Nov 28 20:23:48 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:23:48 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:23:48 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:23:48 user nova-compute[75571]:       <entry name="serial">f95d416b-d3b7-4b16-adc7-83a06088e167</entry>
Nov 28 20:23:48 user nova-compute[75571]:       <entry name="uuid">f95d416b-d3b7-4b16-adc7-83a06088e167</entry>
Nov 28 20:23:48 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:23:48 user nova-compute[75571]:     </system>
Nov 28 20:23:48 user nova-compute[75571]:   </sysinfo>
Nov 28 20:23:48 user nova-compute[75571]:   <os>
Nov 28 20:23:48 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:23:48 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:23:48 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:23:48 user nova-compute[75571]:   </os>
Nov 28 20:23:48 user nova-compute[75571]:   <features>
Nov 28 20:23:48 user nova-compute[75571]:     <acpi/>
Nov 28 20:23:48 user nova-compute[75571]:     <apic/>
Nov 28 20:23:48 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:23:48 user nova-compute[75571]:   </features>
Nov 28 20:23:48 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:23:48 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:23:48 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:23:48 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:23:48 user nova-compute[75571]:   </clock>
Nov 28 20:23:48 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:23:48 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:23:48 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:23:48 user nova-compute[75571]:   </cpu>
Nov 28 20:23:48 user nova-compute[75571]:   <devices>
Nov 28 20:23:48 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:23:48 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:23:48 user nova-compute[75571]:       <source dev="/dev/sdc"/>
Nov 28 20:23:48 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:23:48 user nova-compute[75571]:       <serial>eaa2b1ac-220a-42a8-99fd-893e37359fd9</serial>
Nov 28 20:23:48 user nova-compute[75571]:     </disk>
Nov 28 20:23:48 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:23:48 user nova-compute[75571]:       <mac address="fa:16:3e:2d:2e:14"/>
Nov 28 20:23:48 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:23:48 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:23:48 user nova-compute[75571]:       <target dev="tap4f3e6a23-8c"/>
Nov 28 20:23:48 user nova-compute[75571]:     </interface>
Nov 28 20:23:48 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:23:48 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/f95d416b-d3b7-4b16-adc7-83a06088e167/console.log" append="off"/>
Nov 28 20:23:48 user nova-compute[75571]:     </serial>
Nov 28 20:23:48 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:23:48 user nova-compute[75571]:     <video>
Nov 28 20:23:48 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:23:48 user nova-compute[75571]:     </video>
Nov 28 20:23:48 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:23:48 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:23:48 user nova-compute[75571]:     </rng>
Nov 28 20:23:48 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:23:48 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:23:48 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:23:48 user nova-compute[75571]:     </memballoon>
Nov 28 20:23:48 user nova-compute[75571]:   </devices>
Nov 28 20:23:48 user nova-compute[75571]: </domain>
Nov 28 20:23:48 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1766072383',display_name='tempest-TestShelveInstance-server-1766072383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1766072383',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-752726007',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:20:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8bcf01c7a7d24806a2ffe82ec75c8a51',ramdisk_id='',reservation_id='r-6nppqoc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1960669737',owner_user_name='tempest-TestShelveInstance-1960669737-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:23:36Z,user_data=None,user_id='ca4e178401f940438a766a048076af93',uuid=f95d416b-d3b7-4b16-adc7-83a06088e167,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Converting VIF {"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:2e:14,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f,network=Network(559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6a23-8c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG os_vif [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:2e:14,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f,network=Network(559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6a23-8c') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae60e7eb-b17d-5de4-ad60-5e007b92109b', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f3e6a23-8c, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f3e6a23-8c, col_values=(('qos', UUID('398eb57f-280b-46f2-81fe-f20b180a80b8')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f3e6a23-8c, col_values=(('external_ids', {'iface-id': '4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:2e:14', 'vm-uuid': 'f95d416b-d3b7-4b16-adc7-83a06088e167'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:48 user nova-compute[75571]: INFO os_vif [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:2e:14,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f,network=Network(559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6a23-8c')
Nov 28 20:23:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:23:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] No VIF found with MAC fa:16:3e:2d:2e:14, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:23:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:50 user nova-compute[75571]: DEBUG nova.compute.manager [req-1f8c6034-d5f4-4398-8231-0744d7865468 req-d91a55b7-d78d-4359-9c9d-caa49e147f72 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1f8c6034-d5f4-4398-8231-0744d7865468 req-d91a55b7-d78d-4359-9c9d-caa49e147f72 service nova] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1f8c6034-d5f4-4398-8231-0744d7865468 req-d91a55b7-d78d-4359-9c9d-caa49e147f72 service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1f8c6034-d5f4-4398-8231-0744d7865468 req-d91a55b7-d78d-4359-9c9d-caa49e147f72 service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:50 user nova-compute[75571]: DEBUG nova.compute.manager [req-1f8c6034-d5f4-4398-8231-0744d7865468 req-d91a55b7-d78d-4359-9c9d-caa49e147f72 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] No waiting events found dispatching network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:23:50 user nova-compute[75571]: WARNING nova.compute.manager [req-1f8c6034-d5f4-4398-8231-0744d7865468 req-d91a55b7-d78d-4359-9c9d-caa49e147f72 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received unexpected event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 20:23:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:52 user nova-compute[75571]: DEBUG nova.compute.manager [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:23:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:23:52 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Instance spawned successfully.
Nov 28 20:23:52 user nova-compute[75571]: DEBUG nova.compute.manager [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:23:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.279s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:52 user nova-compute[75571]: DEBUG nova.compute.manager [req-ab5b75d1-4ca5-4ab4-8f13-40962e7b39c9 req-b076b82b-3759-4abe-8497-af952ae2ccec service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ab5b75d1-4ca5-4ab4-8f13-40962e7b39c9 req-b076b82b-3759-4abe-8497-af952ae2ccec service nova] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ab5b75d1-4ca5-4ab4-8f13-40962e7b39c9 req-b076b82b-3759-4abe-8497-af952ae2ccec service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ab5b75d1-4ca5-4ab4-8f13-40962e7b39c9 req-b076b82b-3759-4abe-8497-af952ae2ccec service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:52 user nova-compute[75571]: DEBUG nova.compute.manager [req-ab5b75d1-4ca5-4ab4-8f13-40962e7b39c9 req-b076b82b-3759-4abe-8497-af952ae2ccec service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] No waiting events found dispatching network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:23:52 user nova-compute[75571]: WARNING nova.compute.manager [req-ab5b75d1-4ca5-4ab4-8f13-40962e7b39c9 req-b076b82b-3759-4abe-8497-af952ae2ccec service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received unexpected event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance with vm_state active and task_state None.
Nov 28 20:23:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:53 user nova-compute[75571]: INFO nova.compute.manager [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Unrescuing
Nov 28 20:23:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:23:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquired lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:23:53 user nova-compute[75571]: DEBUG nova.network.neutron [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:23:54 user nova-compute[75571]: DEBUG nova.network.neutron [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updating instance_info_cache with network_info: [{"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:23:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Releasing lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:23:54 user nova-compute[75571]: DEBUG nova.objects.instance [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lazy-loading 'flavor' on Instance uuid 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:23:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:54 user nova-compute[75571]: DEBUG nova.compute.manager [req-819ea0fa-4ec5-42af-875e-af7d497c4990 req-fd8c72a8-ea56-449b-8df0-45ec501c64cf service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-vif-unplugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-819ea0fa-4ec5-42af-875e-af7d497c4990 req-fd8c72a8-ea56-449b-8df0-45ec501c64cf service nova] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-819ea0fa-4ec5-42af-875e-af7d497c4990 req-fd8c72a8-ea56-449b-8df0-45ec501c64cf service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-819ea0fa-4ec5-42af-875e-af7d497c4990 req-fd8c72a8-ea56-449b-8df0-45ec501c64cf service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:54 user nova-compute[75571]: DEBUG nova.compute.manager [req-819ea0fa-4ec5-42af-875e-af7d497c4990 req-fd8c72a8-ea56-449b-8df0-45ec501c64cf service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] No waiting events found dispatching network-vif-unplugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:23:54 user nova-compute[75571]: WARNING nova.compute.manager [req-819ea0fa-4ec5-42af-875e-af7d497c4990 req-fd8c72a8-ea56-449b-8df0-45ec501c64cf service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received unexpected event network-vif-unplugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-d21a67b5-2204-466d-af9e-18dee6532abf req-cf6bcc69-02ea-4afe-9cd1-d67a9a146279 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-changed-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-d21a67b5-2204-466d-af9e-18dee6532abf req-cf6bcc69-02ea-4afe-9cd1-d67a9a146279 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Refreshing instance network info cache due to event network-changed-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d21a67b5-2204-466d-af9e-18dee6532abf req-cf6bcc69-02ea-4afe-9cd1-d67a9a146279 service nova] Acquiring lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d21a67b5-2204-466d-af9e-18dee6532abf req-cf6bcc69-02ea-4afe-9cd1-d67a9a146279 service nova] Acquired lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.network.neutron [req-d21a67b5-2204-466d-af9e-18dee6532abf req-cf6bcc69-02ea-4afe-9cd1-d67a9a146279 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Refreshing network info cache for port 1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:23:55 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Instance destroyed successfully.
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Starting finish_migration {{(pid=75571) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Instance directory exists: not creating {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 20:23:55 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Creating image(s)
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Ensure instance console log exists: /opt/stack/data/nova/instances/93392110-c3c3-44ff-a046-2f11608106c3/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Start _get_guest_xml network_info=[{"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-984729900-network", "vif_mac": "fa:16:3e:a9:a2:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqDoeFXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '93392110-c3c3-44ff-a046-2f11608106c3', 'attached_at': '2023-11-28T20:23:55.000000', 'detached_at': '', 'volume_id': '12945667-6430-4669-b816-315eefdfd6f8', 'serial': '12945667-6430-4669-b816-315eefdfd6f8'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'cf2e9713-195f-4bb4-a89c-90e89e25d497', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:23:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:23:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqDoeFXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:23:55 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:23:55 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:23:55 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef03f939-d1c1-4d23-ac36-5484239d07f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:23:55 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e5fa7b-c7f5-4eee-b94e-43ff91cc97fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8] added
Nov 28 20:23:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d89ca8-dd3e-428b-9990-ed0297c7273c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dfdb0b-d4be-4af0-8065-30e9b6fb4ba8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SqDoeFXN {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SqDoeFXN" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b9fffa-5152-46b9-8b04-0b11cd03a758]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SqDoeFXN'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4813f8-b17d-4733-b056-a2d674b2f0ef]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d548c8c-6bdd-419f-82a2-7821930c3f69]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:23:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:23:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.network.neutron [req-d21a67b5-2204-466d-af9e-18dee6532abf req-cf6bcc69-02ea-4afe-9cd1-d67a9a146279 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updated VIF entry in instance network info cache for port 1fbed4dc-8f66-4490-88f7-a0c4ae19fde9. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG nova.network.neutron [req-d21a67b5-2204-466d-af9e-18dee6532abf req-cf6bcc69-02ea-4afe-9cd1-d67a9a146279 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updating instance_info_cache with network_info: [{"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d21a67b5-2204-466d-af9e-18dee6532abf req-cf6bcc69-02ea-4afe-9cd1-d67a9a146279 service nova] Releasing lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ce34b9-6681-4e15-986d-7f662a12e9c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260]
Nov 28 20:23:55 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260] successful.
Nov 28 20:23:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e28d55-0826-4629-a447-4a5b7ff64dc3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec73cfa0-f53f-4417-b488-8c05614b609e]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:23:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:23:55 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:23:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd9de88-e42e-4c33-baff-7927de0aab55]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:23:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqDoeFXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG nova.compute.manager [req-75d76905-3c4f-43af-a6ba-7281d73dabb1 req-3928dd06-a517-48fa-8bad-bb5a7429fa25 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-75d76905-3c4f-43af-a6ba-7281d73dabb1 req-3928dd06-a517-48fa-8bad-bb5a7429fa25 service nova] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-75d76905-3c4f-43af-a6ba-7281d73dabb1 req-3928dd06-a517-48fa-8bad-bb5a7429fa25 service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-75d76905-3c4f-43af-a6ba-7281d73dabb1 req-3928dd06-a517-48fa-8bad-bb5a7429fa25 service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG nova.compute.manager [req-75d76905-3c4f-43af-a6ba-7281d73dabb1 req-3928dd06-a517-48fa-8bad-bb5a7429fa25 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] No waiting events found dispatching network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:23:56 user nova-compute[75571]: WARNING nova.compute.manager [req-75d76905-3c4f-43af-a6ba-7281d73dabb1 req-3928dd06-a517-48fa-8bad-bb5a7429fa25 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received unexpected event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:23:56 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23235383236383761', 'path': '/dev/sdg'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235383236383761', 'path': '/dev/sdg'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1507891953',display_name='tempest-ServerActionsTestOtherA-server-1507891953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1507891953',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORLi9cBeKxwKZF2rkLIldgYbs91Se5SaovgAyOLlR1LAXkmJO85TwVIU01jacVfp8MokOP7s1wTMn2ItcMxD1z+b2y7pkirDp4yb/pOf68MDBPxyqhiOej8r0TiPf6AAg==',key_name='tempest-keypair-344088806',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:22:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a85595c9e1704e71903d25a65f5b696c',ramdisk_id='',reservation_id='r-0cgit2ur',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-390918760',owner_user_name='tempest-ServerActionsTestOtherA-390918760-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:23:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098319d33fa243f5a044cf3f3c9f983c',uuid=93392110-c3c3-44ff-a046-2f11608106c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-984729900-network", "vif_mac": "fa:16:3e:a9:a2:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converting VIF {"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-984729900-network", "vif_mac": "fa:16:3e:a9:a2:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:a2:04,bridge_name='br-int',has_traffic_filtering=True,id=45eabb36-f147-4900-b1dc-8b48e4141866,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eabb36-f1') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:23:56 user nova-compute[75571]:   <uuid>93392110-c3c3-44ff-a046-2f11608106c3</uuid>
Nov 28 20:23:56 user nova-compute[75571]:   <name>instance-0000001d</name>
Nov 28 20:23:56 user nova-compute[75571]:   <memory>2097152</memory>
Nov 28 20:23:56 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:23:56 user nova-compute[75571]:   <metadata>
Nov 28 20:23:56 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:23:56 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:23:56 user nova-compute[75571]:       <nova:name>tempest-ServerActionsTestOtherA-server-1507891953</nova:name>
Nov 28 20:23:56 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:23:55</nova:creationTime>
Nov 28 20:23:56 user nova-compute[75571]:       <nova:flavor name="m1.small">
Nov 28 20:23:56 user nova-compute[75571]:         <nova:memory>2048</nova:memory>
Nov 28 20:23:56 user nova-compute[75571]:         <nova:disk>20</nova:disk>
Nov 28 20:23:56 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:23:56 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:23:56 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:23:56 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:23:56 user nova-compute[75571]:       <nova:owner>
Nov 28 20:23:56 user nova-compute[75571]:         <nova:user uuid="098319d33fa243f5a044cf3f3c9f983c">tempest-ServerActionsTestOtherA-390918760-project-member</nova:user>
Nov 28 20:23:56 user nova-compute[75571]:         <nova:project uuid="a85595c9e1704e71903d25a65f5b696c">tempest-ServerActionsTestOtherA-390918760</nova:project>
Nov 28 20:23:56 user nova-compute[75571]:       </nova:owner>
Nov 28 20:23:56 user nova-compute[75571]:       <nova:ports>
Nov 28 20:23:56 user nova-compute[75571]:         <nova:port uuid="45eabb36-f147-4900-b1dc-8b48e4141866">
Nov 28 20:23:56 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 20:23:56 user nova-compute[75571]:         </nova:port>
Nov 28 20:23:56 user nova-compute[75571]:       </nova:ports>
Nov 28 20:23:56 user nova-compute[75571]:     </nova:instance>
Nov 28 20:23:56 user nova-compute[75571]:   </metadata>
Nov 28 20:23:56 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:23:56 user nova-compute[75571]:     <system>
Nov 28 20:23:56 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:23:56 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:23:56 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:23:56 user nova-compute[75571]:       <entry name="serial">93392110-c3c3-44ff-a046-2f11608106c3</entry>
Nov 28 20:23:56 user nova-compute[75571]:       <entry name="uuid">93392110-c3c3-44ff-a046-2f11608106c3</entry>
Nov 28 20:23:56 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:23:56 user nova-compute[75571]:     </system>
Nov 28 20:23:56 user nova-compute[75571]:   </sysinfo>
Nov 28 20:23:56 user nova-compute[75571]:   <os>
Nov 28 20:23:56 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:23:56 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:23:56 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:23:56 user nova-compute[75571]:   </os>
Nov 28 20:23:56 user nova-compute[75571]:   <features>
Nov 28 20:23:56 user nova-compute[75571]:     <acpi/>
Nov 28 20:23:56 user nova-compute[75571]:     <apic/>
Nov 28 20:23:56 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:23:56 user nova-compute[75571]:   </features>
Nov 28 20:23:56 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:23:56 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:23:56 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:23:56 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:23:56 user nova-compute[75571]:   </clock>
Nov 28 20:23:56 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:23:56 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:23:56 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:23:56 user nova-compute[75571]:   </cpu>
Nov 28 20:23:56 user nova-compute[75571]:   <devices>
Nov 28 20:23:56 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:23:56 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:23:56 user nova-compute[75571]:       <source dev="/dev/sdg"/>
Nov 28 20:23:56 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:23:56 user nova-compute[75571]:       <serial>12945667-6430-4669-b816-315eefdfd6f8</serial>
Nov 28 20:23:56 user nova-compute[75571]:     </disk>
Nov 28 20:23:56 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:23:56 user nova-compute[75571]:       <mac address="fa:16:3e:a9:a2:04"/>
Nov 28 20:23:56 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:23:56 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:23:56 user nova-compute[75571]:       <target dev="tap45eabb36-f1"/>
Nov 28 20:23:56 user nova-compute[75571]:     </interface>
Nov 28 20:23:56 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:23:56 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/93392110-c3c3-44ff-a046-2f11608106c3/console.log" append="off"/>
Nov 28 20:23:56 user nova-compute[75571]:     </serial>
Nov 28 20:23:56 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:23:56 user nova-compute[75571]:     <video>
Nov 28 20:23:56 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:23:56 user nova-compute[75571]:     </video>
Nov 28 20:23:56 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:23:56 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:23:56 user nova-compute[75571]:     </rng>
Nov 28 20:23:56 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:23:56 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:23:56 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:23:56 user nova-compute[75571]:     </memballoon>
Nov 28 20:23:56 user nova-compute[75571]:   </devices>
Nov 28 20:23:56 user nova-compute[75571]: </domain>
Nov 28 20:23:56 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1507891953',display_name='tempest-ServerActionsTestOtherA-server-1507891953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1507891953',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORLi9cBeKxwKZF2rkLIldgYbs91Se5SaovgAyOLlR1LAXkmJO85TwVIU01jacVfp8MokOP7s1wTMn2ItcMxD1z+b2y7pkirDp4yb/pOf68MDBPxyqhiOej8r0TiPf6AAg==',key_name='tempest-keypair-344088806',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:22:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a85595c9e1704e71903d25a65f5b696c',ramdisk_id='',reservation_id='r-0cgit2ur',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-390918760',owner_user_name='tempest-ServerActionsTestOtherA-390918760-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:23:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098319d33fa243f5a044cf3f3c9f983c',uuid=93392110-c3c3-44ff-a046-2f11608106c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-984729900-network", "vif_mac": "fa:16:3e:a9:a2:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converting VIF {"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-984729900-network", "vif_mac": "fa:16:3e:a9:a2:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:a2:04,bridge_name='br-int',has_traffic_filtering=True,id=45eabb36-f147-4900-b1dc-8b48e4141866,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eabb36-f1') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG os_vif [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:a2:04,bridge_name='br-int',has_traffic_filtering=True,id=45eabb36-f147-4900-b1dc-8b48e4141866,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eabb36-f1') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3964d909-7af9-5c44-9158-726a6b916756', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45eabb36-f1, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45eabb36-f1, col_values=(('qos', UUID('76780923-092e-4b01-896c-cb30ca682080')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45eabb36-f1, col_values=(('external_ids', {'iface-id': '45eabb36-f147-4900-b1dc-8b48e4141866', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:a2:04', 'vm-uuid': '93392110-c3c3-44ff-a046-2f11608106c3'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:23:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:56 user nova-compute[75571]: INFO os_vif [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:a2:04,bridge_name='br-int',has_traffic_filtering=True,id=45eabb36-f147-4900-b1dc-8b48e4141866,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eabb36-f1')
Nov 28 20:23:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:23:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] No VIF found with MAC fa:16:3e:a9:a2:04, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:23:57 user nova-compute[75571]: DEBUG nova.compute.manager [req-c78732a8-66df-4785-8ef8-5611ab4de37b req-e9918a5f-f998-4e67-90f1-49713263145b service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-changed-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:57 user nova-compute[75571]: DEBUG nova.compute.manager [req-c78732a8-66df-4785-8ef8-5611ab4de37b req-e9918a5f-f998-4e67-90f1-49713263145b service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Refreshing instance network info cache due to event network-changed-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:23:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c78732a8-66df-4785-8ef8-5611ab4de37b req-e9918a5f-f998-4e67-90f1-49713263145b service nova] Acquiring lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:23:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c78732a8-66df-4785-8ef8-5611ab4de37b req-e9918a5f-f998-4e67-90f1-49713263145b service nova] Acquired lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:23:57 user nova-compute[75571]: DEBUG nova.network.neutron [req-c78732a8-66df-4785-8ef8-5611ab4de37b req-e9918a5f-f998-4e67-90f1-49713263145b service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Refreshing network info cache for port 1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:23:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:57 user nova-compute[75571]: DEBUG nova.network.neutron [req-c78732a8-66df-4785-8ef8-5611ab4de37b req-e9918a5f-f998-4e67-90f1-49713263145b service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updated VIF entry in instance network info cache for port 1fbed4dc-8f66-4490-88f7-a0c4ae19fde9. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:23:57 user nova-compute[75571]: DEBUG nova.network.neutron [req-c78732a8-66df-4785-8ef8-5611ab4de37b req-e9918a5f-f998-4e67-90f1-49713263145b service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updating instance_info_cache with network_info: [{"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:23:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c78732a8-66df-4785-8ef8-5611ab4de37b req-e9918a5f-f998-4e67-90f1-49713263145b service nova] Releasing lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:23:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:58 user nova-compute[75571]: DEBUG nova.compute.manager [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:58 user nova-compute[75571]: DEBUG nova.compute.manager [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] No waiting events found dispatching network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:23:58 user nova-compute[75571]: WARNING nova.compute.manager [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received unexpected event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:23:58 user nova-compute[75571]: DEBUG nova.compute.manager [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:58 user nova-compute[75571]: DEBUG nova.compute.manager [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] No waiting events found dispatching network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:23:58 user nova-compute[75571]: WARNING nova.compute.manager [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received unexpected event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:23:59 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:23:59 user nova-compute[75571]: DEBUG nova.compute.manager [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received event network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] Acquiring lock "93392110-c3c3-44ff-a046-2f11608106c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:59 user nova-compute[75571]: DEBUG nova.compute.manager [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] No waiting events found dispatching network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:23:59 user nova-compute[75571]: WARNING nova.compute.manager [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received unexpected event network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 for instance with vm_state active and task_state resize_finish.
Nov 28 20:23:59 user nova-compute[75571]: DEBUG nova.compute.manager [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received event network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:23:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] Acquiring lock "93392110-c3c3-44ff-a046-2f11608106c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:23:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:23:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:23:59 user nova-compute[75571]: DEBUG nova.compute.manager [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] No waiting events found dispatching network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:23:59 user nova-compute[75571]: WARNING nova.compute.manager [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received unexpected event network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 for instance with vm_state active and task_state resize_finish.
Nov 28 20:23:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:23:59 user nova-compute[75571]: DEBUG nova.compute.manager [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:24:00 user nova-compute[75571]: DEBUG nova.compute.manager [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:24:00 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Instance running successfully.
Nov 28 20:24:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Failed to set time: agent not configured {{(pid=75571) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 20:24:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] finish_migration finished successfully. {{(pid=75571) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 20:24:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:24:03 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:24:03 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:24:03 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:24:04 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:24:04 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:24:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:24:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:24:04 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:24:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:04 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updating instance_info_cache with network_info: [{"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:24:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:24:04 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:24:04 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:24:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:24:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:24:05 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 86c31e96-70cf-45fd-9578-194706af2ad0 is timed out.
Nov 28 20:24:05 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Successfully detached device vdb from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the live domain config.
Nov 28 20:24:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:24:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UICcXFKj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:24:05 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:24:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:24:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:24:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bcc360-d5d0-4eab-9cfd-09ce8cd8d09a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:24:06 user nova-compute[75571]: No targets found.
Nov 28 20:24:06 user nova-compute[75571]: iSNS:
Nov 28 20:24:06 user nova-compute[75571]: No targets found.
Nov 28 20:24:06 user nova-compute[75571]: STATIC:
Nov 28 20:24:06 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9
Nov 28 20:24:06 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:06 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:06 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc
Nov 28 20:24:06 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:06 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:06 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8
Nov 28 20:24:06 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:06 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:06 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec
Nov 28 20:24:06 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:06 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:06 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618
Nov 28 20:24:06 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:06 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:06 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:24:06 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:06 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:06 user nova-compute[75571]: FIRMWARE:
Nov 28 20:24:06 user nova-compute[75571]: No targets found.
Nov 28 20:24:06 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:24:06 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:24:06 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[539f07d7-c754-4014-905d-d1d639b1d047]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb87e0f-12f2-4a33-a4de-0b88cf58d4a8]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:24:06 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:24:06 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:24:06 user nova-compute[75571]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)
Nov 28 20:24:06 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:24:06 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:24:06 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:24:06 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:24:06 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:24:06 user nova-compute[75571]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc (non-flash)
Nov 28 20:24:06 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:24:06 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:24:06 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768789b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc'): ({'sde'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Removing single pathed devices sde {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67e8bca-e993-4b66-98fb-6a2717e0291b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ae55b1-2224-4b0d-9d20-5b7c20f46ea0]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Flushing IO for device /dev/sde {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af0e9e6-c375-443e-8808-e490887c71b8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bffec3-3081-4a8b-8de8-2f48a314c08e]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] SCSI volumes sde have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb9d571-9c82-4b5d-8c0c-9275e3534622]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59fd0a5-5797-4f5b-810e-c844792e9d11]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc, portal: 172.16.0.220,3260]
Nov 28 20:24:06 user nova-compute[75571]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc, portal: 172.16.0.220,3260] successful.
Nov 28 20:24:06 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e364a33-a5d7-4aab-a5e4-df5722cafbcc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3b8850-4ca5-4397-9b8b-20d5b1f3d2ba]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] <== disconnect_volume: return (392ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:24:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:07 user nova-compute[75571]: DEBUG nova.objects.instance [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'flavor' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:24:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.232s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:24:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:24:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:09 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:24:09 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=7917MB free_disk=25.027023315429688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Applying migration context for instance 93392110-c3c3-44ff-a046-2f11608106c3 as it has an incoming, in-progress migration 52387bd7-c123-444c-85c1-ea3dc0d14494. Migration status is finished {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 20:24:09 user nova-compute[75571]: INFO nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Updating resource usage from migration 52387bd7-c123-444c-85c1-ea3dc0d14494
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 86c31e96-70cf-45fd-9578-194706af2ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 40ac5386-d43f-443c-ac15-186b368728f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 313a065e-94f3-4435-97af-6a16de64ca7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance f95d416b-d3b7-4b16-adc7-83a06088e167 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Migration 52387bd7-c123-444c-85c1-ea3dc0d14494 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 93392110-c3c3-44ff-a046-2f11608106c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:24:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:24:10 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:24:10 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:24:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:24:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "40ac5386-d43f-443c-ac15-186b368728f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:11 user nova-compute[75571]: INFO nova.compute.manager [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Terminating instance
Nov 28 20:24:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG nova.compute.manager [req-5ca6fd9d-86b0-4da7-ad4b-ea4930c0f5be req-a2e7a7b9-67cb-425d-8750-b95d332f8d4c service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-vif-unplugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5ca6fd9d-86b0-4da7-ad4b-ea4930c0f5be req-a2e7a7b9-67cb-425d-8750-b95d332f8d4c service nova] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5ca6fd9d-86b0-4da7-ad4b-ea4930c0f5be req-a2e7a7b9-67cb-425d-8750-b95d332f8d4c service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5ca6fd9d-86b0-4da7-ad4b-ea4930c0f5be req-a2e7a7b9-67cb-425d-8750-b95d332f8d4c service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG nova.compute.manager [req-5ca6fd9d-86b0-4da7-ad4b-ea4930c0f5be req-a2e7a7b9-67cb-425d-8750-b95d332f8d4c service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] No waiting events found dispatching network-vif-unplugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:24:11 user nova-compute[75571]: DEBUG nova.compute.manager [req-5ca6fd9d-86b0-4da7-ad4b-ea4930c0f5be req-a2e7a7b9-67cb-425d-8750-b95d332f8d4c service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-vif-unplugged-38a389ab-f2f2-413a-85e1-b40415fc156c for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:24:12 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Instance destroyed successfully.
Nov 28 20:24:12 user nova-compute[75571]: DEBUG nova.objects.instance [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lazy-loading 'resources' on Instance uuid 40ac5386-d43f-443c-ac15-186b368728f8 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:24:12 user nova-compute[75571]: INFO nova.compute.manager [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Unrescuing
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquired lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:15:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2039159279',display_name='tempest-ServerActionsTestOtherB-server-2039159279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2039159279',id=17,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGleHnng/iZf+pKcaRfN4ki3/kKcZ1lAUwQTncf758ioT4v9Nu4+2KyDgP5bUFKo8JEMegAuoMjbKaD/3O2Xdr1tfYfEaBfckP1a0BpsnLhWEjCdte2x0agDjBhSwM7chQ==',key_name='tempest-keypair-1179232993',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:21:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8895df748b4644e9bad362ea318e04c7',ramdisk_id='',reservation_id='r-dfynuxpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1446981498',owner_user_name='tempest-ServerActionsTestOtherB-1446981498-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:21:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ffae0c69e0c40e0917cf412e7757616',uuid=40ac5386-d43f-443c-ac15-186b368728f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converting VIF {"id": "38a389ab-f2f2-413a-85e1-b40415fc156c", "address": "fa:16:3e:68:de:09", "network": {"id": "56875171-7787-4f2e-901e-cfe332991835", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1134666504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8895df748b4644e9bad362ea318e04c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a389ab-f2", "ovs_interfaceid": "38a389ab-f2f2-413a-85e1-b40415fc156c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_vif [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38a389ab-f2, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9a5931c-488e-4d3d-a4c0-72fd45c869a9) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:24:12 user nova-compute[75571]: INFO os_vif [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:de:09,bridge_name='br-int',has_traffic_filtering=True,id=38a389ab-f2f2-413a-85e1-b40415fc156c,network=Network(56875171-7787-4f2e-901e-cfe332991835),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a389ab-f2')
Nov 28 20:24:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRGlTqEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:24:12 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3229b9a2-f2f6-48bf-8f26-19f12756dbda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:24:12 user nova-compute[75571]: No targets found.
Nov 28 20:24:12 user nova-compute[75571]: iSNS:
Nov 28 20:24:12 user nova-compute[75571]: No targets found.
Nov 28 20:24:12 user nova-compute[75571]: STATIC:
Nov 28 20:24:12 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9
Nov 28 20:24:12 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:12 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:12 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8
Nov 28 20:24:12 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:12 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:12 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec
Nov 28 20:24:12 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:12 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:12 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618
Nov 28 20:24:12 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:12 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:12 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:24:12 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:12 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:12 user nova-compute[75571]: FIRMWARE:
Nov 28 20:24:12 user nova-compute[75571]: No targets found.
Nov 28 20:24:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:24:12 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:24:12 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbad3d06-4ea7-4f37-9aca-a966e9fa4edf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[153a5c4d-423f-4bcb-9723-9d4a160a585c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:24:12 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:24:12 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:24:12 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:24:12 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:24:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:24:12 user nova-compute[75571]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec (non-flash)
Nov 28 20:24:12 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:24:12 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:24:12 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:24:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768505870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b4e408-94c8-4848-b703-ddc09b13af72]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad9c939-4135-489c-b76d-ab513698d4e9]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a16d87d-ed53-4f17-8150-0510d037214d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[44afda25-f197-4993-8075-613a580c9572]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a79ebd-26cd-4e1e-af9f-dac1d3f15823]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ad78e5-0a7e-4093-b6e6-5e16e964c457]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260]
Nov 28 20:24:12 user nova-compute[75571]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec, portal: 172.16.0.220,3260] successful.
Nov 28 20:24:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f18bcc-3456-4d6b-a070-51c3de9d32ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bf91ba-79b1-4203-9435-288ffedda8f6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] <== disconnect_volume: return (332ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:24:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:24:12 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Deleting instance files /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8_del
Nov 28 20:24:12 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Deletion of /opt/stack/data/nova/instances/40ac5386-d43f-443c-ac15-186b368728f8_del complete
Nov 28 20:24:13 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Updating instance_info_cache with network_info: [{"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:24:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Releasing lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:24:13 user nova-compute[75571]: DEBUG nova.objects.instance [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'flavor' on Instance uuid 313a065e-94f3-4435-97af-6a16de64ca7c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:24:13 user nova-compute[75571]: INFO nova.compute.manager [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 28 20:24:13 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:24:13 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:24:13 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:24:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:13 user nova-compute[75571]: DEBUG nova.compute.manager [req-9f5791b6-3d4e-4373-bea1-b1226510804d req-b0b534d7-eeea-4340-ac74-d88b8b3ecd48 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received event network-vif-unplugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:24:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9f5791b6-3d4e-4373-bea1-b1226510804d req-b0b534d7-eeea-4340-ac74-d88b8b3ecd48 service nova] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9f5791b6-3d4e-4373-bea1-b1226510804d req-b0b534d7-eeea-4340-ac74-d88b8b3ecd48 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9f5791b6-3d4e-4373-bea1-b1226510804d req-b0b534d7-eeea-4340-ac74-d88b8b3ecd48 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:13 user nova-compute[75571]: DEBUG nova.compute.manager [req-9f5791b6-3d4e-4373-bea1-b1226510804d req-b0b534d7-eeea-4340-ac74-d88b8b3ecd48 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] No waiting events found dispatching network-vif-unplugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:24:13 user nova-compute[75571]: WARNING nova.compute.manager [req-9f5791b6-3d4e-4373-bea1-b1226510804d req-b0b534d7-eeea-4340-ac74-d88b8b3ecd48 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received unexpected event network-vif-unplugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:24:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:13 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Instance destroyed successfully.
Nov 28 20:24:13 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:24:13 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Took 0.87 seconds to deallocate network for instance.
Nov 28 20:24:13 user nova-compute[75571]: DEBUG nova.compute.manager [req-58b17bb0-b198-4d67-b157-74bf632f06c5 req-5f6c51c2-1f77-4856-8bb6-280ffe131633 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-vif-deleted-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:24:13 user nova-compute[75571]: INFO nova.compute.manager [req-58b17bb0-b198-4d67-b157-74bf632f06c5 req-5f6c51c2-1f77-4856-8bb6-280ffe131633 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Neutron deleted interface 38a389ab-f2f2-413a-85e1-b40415fc156c; detaching it from the instance and deleting it from the info cache
Nov 28 20:24:13 user nova-compute[75571]: DEBUG nova.network.neutron [req-58b17bb0-b198-4d67-b157-74bf632f06c5 req-5f6c51c2-1f77-4856-8bb6-280ffe131633 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:24:13 user nova-compute[75571]: DEBUG nova.compute.manager [req-58b17bb0-b198-4d67-b157-74bf632f06c5 req-5f6c51c2-1f77-4856-8bb6-280ffe131633 service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Detach interface failed, port_id=38a389ab-f2f2-413a-85e1-b40415fc156c, reason: Instance 40ac5386-d43f-443c-ac15-186b368728f8 could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:24:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-a6b103db-3230-466e-a3ce-dc879c76be16 req-00744936-8934-4f09-87e8-00b6bd78790b service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:24:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a6b103db-3230-466e-a3ce-dc879c76be16 req-00744936-8934-4f09-87e8-00b6bd78790b service nova] Acquiring lock "40ac5386-d43f-443c-ac15-186b368728f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a6b103db-3230-466e-a3ce-dc879c76be16 req-00744936-8934-4f09-87e8-00b6bd78790b service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a6b103db-3230-466e-a3ce-dc879c76be16 req-00744936-8934-4f09-87e8-00b6bd78790b service nova] Lock "40ac5386-d43f-443c-ac15-186b368728f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-a6b103db-3230-466e-a3ce-dc879c76be16 req-00744936-8934-4f09-87e8-00b6bd78790b service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] No waiting events found dispatching network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:24:14 user nova-compute[75571]: WARNING nova.compute.manager [req-a6b103db-3230-466e-a3ce-dc879c76be16 req-00744936-8934-4f09-87e8-00b6bd78790b service nova] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Received unexpected event network-vif-plugged-38a389ab-f2f2-413a-85e1-b40415fc156c for instance with vm_state active and task_state deleting.
Nov 28 20:24:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:14 user nova-compute[75571]: INFO nova.compute.manager [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Took 0.98 seconds to detach 1 volumes for instance.
Nov 28 20:24:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-cde9e5b9-3cef-4310-b360-192d228c3c8b req-0d85dfc9-c211-41b6-8f5a-07369715f714 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:24:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cde9e5b9-3cef-4310-b360-192d228c3c8b req-0d85dfc9-c211-41b6-8f5a-07369715f714 service nova] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cde9e5b9-3cef-4310-b360-192d228c3c8b req-0d85dfc9-c211-41b6-8f5a-07369715f714 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cde9e5b9-3cef-4310-b360-192d228c3c8b req-0d85dfc9-c211-41b6-8f5a-07369715f714 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-cde9e5b9-3cef-4310-b360-192d228c3c8b req-0d85dfc9-c211-41b6-8f5a-07369715f714 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] No waiting events found dispatching network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:24:15 user nova-compute[75571]: WARNING nova.compute.manager [req-cde9e5b9-3cef-4310-b360-192d228c3c8b req-0d85dfc9-c211-41b6-8f5a-07369715f714 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received unexpected event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:24:15 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:24:15 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:24:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.480s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:15 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Deleted allocations for instance 40ac5386-d43f-443c-ac15-186b368728f8
Nov 28 20:24:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "40ac5386-d43f-443c-ac15-186b368728f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.077s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:24:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:24:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] No waiting events found dispatching network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:24:17 user nova-compute[75571]: WARNING nova.compute.manager [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received unexpected event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:24:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:24:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] No waiting events found dispatching network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:24:17 user nova-compute[75571]: WARNING nova.compute.manager [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received unexpected event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:24:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:26 user nova-compute[75571]: INFO nova.compute.manager [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Detaching volume e5a18686-4ce1-48a9-8657-5d9ca9a6f618
Nov 28 20:24:26 user nova-compute[75571]: INFO nova.virt.block_device [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Attempting to driver detach volume e5a18686-4ce1-48a9-8657-5d9ca9a6f618 from mountpoint /dev/vdb
Nov 28 20:24:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Attempting to detach device vdb from instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:24:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:24:26 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:24:26 user nova-compute[75571]:   <source dev="/dev/sdf"/>
Nov 28 20:24:26 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:24:26 user nova-compute[75571]:   <serial>e5a18686-4ce1-48a9-8657-5d9ca9a6f618</serial>
Nov 28 20:24:26 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:24:26 user nova-compute[75571]: </disk>
Nov 28 20:24:26 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:24:26 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Successfully detached device vdb from instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc from the persistent domain config.
Nov 28 20:24:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:24:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:24:26 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:24:26 user nova-compute[75571]:   <source dev="/dev/sdf"/>
Nov 28 20:24:26 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:24:26 user nova-compute[75571]:   <serial>e5a18686-4ce1-48a9-8657-5d9ca9a6f618</serial>
Nov 28 20:24:26 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:24:26 user nova-compute[75571]: </disk>
Nov 28 20:24:26 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:24:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:24:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG nova.objects.instance [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'flavor' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:38 user nova-compute[75571]: INFO nova.compute.manager [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Attaching volume c1962081-a05e-49fb-a05e-9c37e208e4ff to /dev/vdb
Nov 28 20:24:38 user nova-compute[75571]: DEBUG os_brick.utils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8a9853-85bb-42b9-8a20-d9a302c09aed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3970cb3-fbc6-4c03-8896-99c3a22e903c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66dccc6-b0ab-47c6-96ca-5bee18ce594f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[90716478-17c1-4088-b05d-bf437ed6399a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:24:38 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f540e4-362d-4892-9eb6-20d8360d0d75]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG os_brick.utils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Updating existing volume attachment record: 11c0a28b-76dc-427c-ad11-e3ad83934cff {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:38 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:24:38 user nova-compute[75571]: INFO nova.compute.claims [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Claim successful on node user
Nov 28 20:24:39 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:24:39 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:24:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:24:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:24:39 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:24:39 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:24:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:24:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:39 user nova-compute[75571]: DEBUG nova.policy [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:24:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:24:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:24:39 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Creating image(s)
Nov 28 20:24:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "/opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "/opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "6f4ebe798e4958ec92f88731555389ead5db7792" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "6f4ebe798e4958ec92f88731555389ead5db7792" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792.part --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Successfully created port: f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG nova.virt.images [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] b593e02e-c19a-4aca-a243-304aa450f095 was qcow2, converting to raw {{(pid=75571) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792.part /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792.converted {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792.part /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792.converted" returned: 0 in 0.378s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792.converted --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "6f4ebe798e4958ec92f88731555389ead5db7792" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.170s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792 --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Successfully updated port: f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquired lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792 --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "6f4ebe798e4958ec92f88731555389ead5db7792" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "6f4ebe798e4958ec92f88731555389ead5db7792" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792 --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-aeea475d-929d-47e1-a38f-caba47638cf2 req-87fa940c-d68f-4cce-bf74-cc3c8f5818a7 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received event network-changed-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-aeea475d-929d-47e1-a38f-caba47638cf2 req-87fa940c-d68f-4cce-bf74-cc3c8f5818a7 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Refreshing instance network info cache due to event network-changed-f496e45a-10e5-489c-bec3-3788ecad173c. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:24:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-aeea475d-929d-47e1-a38f-caba47638cf2 req-87fa940c-d68f-4cce-bf74-cc3c8f5818a7 service nova] Acquiring lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792 --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792,backing_fmt=raw /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792,backing_fmt=raw /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk 1073741824" returned: 0 in 0.049s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "6f4ebe798e4958ec92f88731555389ead5db7792" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792 --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Updating instance_info_cache with network_info: [{"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792 --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Releasing lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Instance network_info: |[{"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-aeea475d-929d-47e1-a38f-caba47638cf2 req-87fa940c-d68f-4cce-bf74-cc3c8f5818a7 service nova] Acquired lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.network.neutron [req-aeea475d-929d-47e1-a38f-caba47638cf2 req-87fa940c-d68f-4cce-bf74-cc3c8f5818a7 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Refreshing network info cache for port f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Cannot resize image /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Ensure instance console log exists: /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Start _get_guest_xml network_info=[{"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:24:36Z,direct_url=<?>,disk_format='qcow2',id=b593e02e-c19a-4aca-a243-304aa450f095,min_disk=0,min_ram=0,name='tempest-scenario-img--537487222',owner='4fb173b085164da1b53412e2948fbdfe',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:24:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'b593e02e-c19a-4aca-a243-304aa450f095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:24:41 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:24:41 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:24:36Z,direct_url=<?>,disk_format='qcow2',id=b593e02e-c19a-4aca-a243-304aa450f095,min_disk=0,min_ram=0,name='tempest-scenario-img--537487222',owner='4fb173b085164da1b53412e2948fbdfe',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:24:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1371290012',display_name='tempest-TestMinimumBasicScenario-server-1371290012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1371290012',id=30,image_ref='b593e02e-c19a-4aca-a243-304aa450f095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOwoMBR4cnJDatR+jEGAoE1++DF00x1L3tAHFh+2yRDgkQBY4IPkD5ygZ01Zy4k93InMKpeftJSTa2JLsnlu1pFbf2YVD4gZrxRSbUCScLWZKcNGiSbU5NXz8hrSEW1+w==',key_name='tempest-TestMinimumBasicScenario-149674416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fb173b085164da1b53412e2948fbdfe',ramdisk_id='',reservation_id='r-h3jercbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b593e02e-c19a-4aca-a243-304aa450f095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1412958496',owner_user_name='tempest-TestMinimumBasicScenario-1412958496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:24:39Z,user_data=None,user_id='6722115f609e44ccad60d00c89a04ddb',uuid=fe1fe030-1a1e-49c9-97e8-6e9840d4908d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converting VIF {"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:26:b0,bridge_name='br-int',has_traffic_filtering=True,id=f496e45a-10e5-489c-bec3-3788ecad173c,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496e45a-10') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.objects.instance [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'pci_devices' on Instance uuid fe1fe030-1a1e-49c9-97e8-6e9840d4908d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:24:41 user nova-compute[75571]:   <uuid>fe1fe030-1a1e-49c9-97e8-6e9840d4908d</uuid>
Nov 28 20:24:41 user nova-compute[75571]:   <name>instance-0000001e</name>
Nov 28 20:24:41 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:24:41 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:24:41 user nova-compute[75571]:   <metadata>
Nov 28 20:24:41 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:24:41 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:24:41 user nova-compute[75571]:       <nova:name>tempest-TestMinimumBasicScenario-server-1371290012</nova:name>
Nov 28 20:24:41 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:24:41</nova:creationTime>
Nov 28 20:24:41 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:24:41 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:24:41 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:24:41 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:24:41 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:24:41 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:24:41 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:24:41 user nova-compute[75571]:       <nova:owner>
Nov 28 20:24:41 user nova-compute[75571]:         <nova:user uuid="6722115f609e44ccad60d00c89a04ddb">tempest-TestMinimumBasicScenario-1412958496-project-member</nova:user>
Nov 28 20:24:41 user nova-compute[75571]:         <nova:project uuid="4fb173b085164da1b53412e2948fbdfe">tempest-TestMinimumBasicScenario-1412958496</nova:project>
Nov 28 20:24:41 user nova-compute[75571]:       </nova:owner>
Nov 28 20:24:41 user nova-compute[75571]:       <nova:root type="image" uuid="b593e02e-c19a-4aca-a243-304aa450f095"/>
Nov 28 20:24:41 user nova-compute[75571]:       <nova:ports>
Nov 28 20:24:41 user nova-compute[75571]:         <nova:port uuid="f496e45a-10e5-489c-bec3-3788ecad173c">
Nov 28 20:24:41 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 20:24:41 user nova-compute[75571]:         </nova:port>
Nov 28 20:24:41 user nova-compute[75571]:       </nova:ports>
Nov 28 20:24:41 user nova-compute[75571]:     </nova:instance>
Nov 28 20:24:41 user nova-compute[75571]:   </metadata>
Nov 28 20:24:41 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:24:41 user nova-compute[75571]:     <system>
Nov 28 20:24:41 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:24:41 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:24:41 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:24:41 user nova-compute[75571]:       <entry name="serial">fe1fe030-1a1e-49c9-97e8-6e9840d4908d</entry>
Nov 28 20:24:41 user nova-compute[75571]:       <entry name="uuid">fe1fe030-1a1e-49c9-97e8-6e9840d4908d</entry>
Nov 28 20:24:41 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:24:41 user nova-compute[75571]:     </system>
Nov 28 20:24:41 user nova-compute[75571]:   </sysinfo>
Nov 28 20:24:41 user nova-compute[75571]:   <os>
Nov 28 20:24:41 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:24:41 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:24:41 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:24:41 user nova-compute[75571]:   </os>
Nov 28 20:24:41 user nova-compute[75571]:   <features>
Nov 28 20:24:41 user nova-compute[75571]:     <acpi/>
Nov 28 20:24:41 user nova-compute[75571]:     <apic/>
Nov 28 20:24:41 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:24:41 user nova-compute[75571]:   </features>
Nov 28 20:24:41 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:24:41 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:24:41 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:24:41 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:24:41 user nova-compute[75571]:   </clock>
Nov 28 20:24:41 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:24:41 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:24:41 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:24:41 user nova-compute[75571]:   </cpu>
Nov 28 20:24:41 user nova-compute[75571]:   <devices>
Nov 28 20:24:41 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:24:41 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:24:41 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk"/>
Nov 28 20:24:41 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:24:41 user nova-compute[75571]:     </disk>
Nov 28 20:24:41 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:24:41 user nova-compute[75571]:       <mac address="fa:16:3e:87:26:b0"/>
Nov 28 20:24:41 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:24:41 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:24:41 user nova-compute[75571]:       <target dev="tapf496e45a-10"/>
Nov 28 20:24:41 user nova-compute[75571]:     </interface>
Nov 28 20:24:41 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:24:41 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/console.log" append="off"/>
Nov 28 20:24:41 user nova-compute[75571]:     </serial>
Nov 28 20:24:41 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:24:41 user nova-compute[75571]:     <video>
Nov 28 20:24:41 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:24:41 user nova-compute[75571]:     </video>
Nov 28 20:24:41 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:24:41 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:24:41 user nova-compute[75571]:     </rng>
Nov 28 20:24:41 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:24:41 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:24:41 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:24:41 user nova-compute[75571]:     </memballoon>
Nov 28 20:24:41 user nova-compute[75571]:   </devices>
Nov 28 20:24:41 user nova-compute[75571]: </domain>
Nov 28 20:24:41 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1371290012',display_name='tempest-TestMinimumBasicScenario-server-1371290012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1371290012',id=30,image_ref='b593e02e-c19a-4aca-a243-304aa450f095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOwoMBR4cnJDatR+jEGAoE1++DF00x1L3tAHFh+2yRDgkQBY4IPkD5ygZ01Zy4k93InMKpeftJSTa2JLsnlu1pFbf2YVD4gZrxRSbUCScLWZKcNGiSbU5NXz8hrSEW1+w==',key_name='tempest-TestMinimumBasicScenario-149674416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fb173b085164da1b53412e2948fbdfe',ramdisk_id='',reservation_id='r-h3jercbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b593e02e-c19a-4aca-a243-304aa450f095',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1412958496',owner_user_name='tempest-TestMinimumBasicScenario-1412958496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:24:39Z,user_data=None,user_id='6722115f609e44ccad60d00c89a04ddb',uuid=fe1fe030-1a1e-49c9-97e8-6e9840d4908d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converting VIF {"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:26:b0,bridge_name='br-int',has_traffic_filtering=True,id=f496e45a-10e5-489c-bec3-3788ecad173c,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496e45a-10') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG os_vif [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:26:b0,bridge_name='br-int',has_traffic_filtering=True,id=f496e45a-10e5-489c-bec3-3788ecad173c,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496e45a-10') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '236f8c4e-5b5a-5f70-b2f7-11c8b7eeefa6', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf496e45a-10, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf496e45a-10, col_values=(('qos', UUID('713e5482-8a0c-44a1-950f-af0d16520f60')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf496e45a-10, col_values=(('external_ids', {'iface-id': 'f496e45a-10e5-489c-bec3-3788ecad173c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:26:b0', 'vm-uuid': 'fe1fe030-1a1e-49c9-97e8-6e9840d4908d'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:41 user nova-compute[75571]: INFO os_vif [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:26:b0,bridge_name='br-int',has_traffic_filtering=True,id=f496e45a-10e5-489c-bec3-3788ecad173c,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496e45a-10')
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] No VIF found with MAC fa:16:3e:87:26:b0, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.network.neutron [req-aeea475d-929d-47e1-a38f-caba47638cf2 req-87fa940c-d68f-4cce-bf74-cc3c8f5818a7 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Updated VIF entry in instance network info cache for port f496e45a-10e5-489c-bec3-3788ecad173c. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG nova.network.neutron [req-aeea475d-929d-47e1-a38f-caba47638cf2 req-87fa940c-d68f-4cce-bf74-cc3c8f5818a7 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Updating instance_info_cache with network_info: [{"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:24:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-aeea475d-929d-47e1-a38f-caba47638cf2 req-87fa940c-d68f-4cce-bf74-cc3c8f5818a7 service nova] Releasing lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:24:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-e35d52fe-4e9b-4394-be1f-2bbbe3ade875 req-9591a62a-e88a-41e0-a5e1-7dec71cba720 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received event network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:24:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e35d52fe-4e9b-4394-be1f-2bbbe3ade875 req-9591a62a-e88a-41e0-a5e1-7dec71cba720 service nova] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e35d52fe-4e9b-4394-be1f-2bbbe3ade875 req-9591a62a-e88a-41e0-a5e1-7dec71cba720 service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e35d52fe-4e9b-4394-be1f-2bbbe3ade875 req-9591a62a-e88a-41e0-a5e1-7dec71cba720 service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-e35d52fe-4e9b-4394-be1f-2bbbe3ade875 req-9591a62a-e88a-41e0-a5e1-7dec71cba720 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] No waiting events found dispatching network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:24:43 user nova-compute[75571]: WARNING nova.compute.manager [req-e35d52fe-4e9b-4394-be1f-2bbbe3ade875 req-9591a62a-e88a-41e0-a5e1-7dec71cba720 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received unexpected event network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c for instance with vm_state building and task_state spawning.
Nov 28 20:24:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:45 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:24:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:24:45 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Instance spawned successfully.
Nov 28 20:24:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:24:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:24:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:24:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:24:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:24:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:24:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:24:45 user nova-compute[75571]: INFO nova.compute.manager [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 28 20:24:45 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:24:45 user nova-compute[75571]: INFO nova.compute.manager [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Took 6.56 seconds to build instance.
Nov 28 20:24:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.679s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-a99e4be5-bd2f-4cb8-9d35-6a8e7bec4e44 req-adc76fd5-6d28-4c19-80c3-c3d2961b74c9 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received event network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:24:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a99e4be5-bd2f-4cb8-9d35-6a8e7bec4e44 req-adc76fd5-6d28-4c19-80c3-c3d2961b74c9 service nova] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a99e4be5-bd2f-4cb8-9d35-6a8e7bec4e44 req-adc76fd5-6d28-4c19-80c3-c3d2961b74c9 service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a99e4be5-bd2f-4cb8-9d35-6a8e7bec4e44 req-adc76fd5-6d28-4c19-80c3-c3d2961b74c9 service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-a99e4be5-bd2f-4cb8-9d35-6a8e7bec4e44 req-adc76fd5-6d28-4c19-80c3-c3d2961b74c9 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] No waiting events found dispatching network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:24:45 user nova-compute[75571]: WARNING nova.compute.manager [req-a99e4be5-bd2f-4cb8-9d35-6a8e7bec4e44 req-adc76fd5-6d28-4c19-80c3-c3d2961b74c9 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received unexpected event network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c for instance with vm_state active and task_state None.
Nov 28 20:24:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NeulsEbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:24:46 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:24:46 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:24:46 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7659e7-85be-4fb4-9390-4bd6a66617da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:24:46 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f686b1-8922-4d4a-aba6-280b2f50909e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff] added
Nov 28 20:24:46 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4afc858-f28e-4850-bef2-5d7bf509e42d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4af3ee-24b5-4bb9-908f-eabfd54f7496]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NeulsEbi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NeulsEbi" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ede21e9-130a-43d4-a8c6-341dbd0030cc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NeulsEbi'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac0236a-27b3-483a-97d7-ee75e32adf47]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2513424c-248a-49f1-9519-205d3092c34f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[454551b1-dfce-42da-ba80-87c604485c6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff, portal: 172.16.0.220,3260]
Nov 28 20:24:46 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff, portal: 172.16.0.220,3260] successful.
Nov 28 20:24:46 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9255e7f-13d7-4caa-bbcb-78766b667f4c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44c9f2b-3c40-41b1-8559-1c753d03bc7a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff (non-flash)
Nov 28 20:24:46 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:24:46 user nova-compute[75571]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff (non-flash)
Nov 28 20:24:46 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0b44ef-b996-49e3-b8cf-5e982a364970]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:24:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:47 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc is timed out.
Nov 28 20:24:47 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Successfully detached device vdb from instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc from the live domain config.
Nov 28 20:24:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKdOiMxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:24:47 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NeulsEbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23233386362663364', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233386362663364', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.085s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG nova.objects.instance [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'flavor' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[513f4d24-d5fd-454c-99e5-c3cf81f6104e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:24:47 user nova-compute[75571]: No targets found.
Nov 28 20:24:47 user nova-compute[75571]: iSNS:
Nov 28 20:24:47 user nova-compute[75571]: No targets found.
Nov 28 20:24:47 user nova-compute[75571]: STATIC:
Nov 28 20:24:47 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff
Nov 28 20:24:47 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:47 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:47 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9
Nov 28 20:24:47 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:47 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:47 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8
Nov 28 20:24:47 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:47 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:47 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618
Nov 28 20:24:47 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:47 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:47 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:24:47 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:24:47 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:24:47 user nova-compute[75571]: FIRMWARE:
Nov 28 20:24:47 user nova-compute[75571]: No targets found.
Nov 28 20:24:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:24:47 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:24:47 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:24:47 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:24:47 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:24:47 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:24:47 user nova-compute[75571]:   <serial>c1962081-a05e-49fb-a05e-9c37e208e4ff</serial>
Nov 28 20:24:47 user nova-compute[75571]: </disk>
Nov 28 20:24:47 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b289cd0-5ddd-453d-8810-61107610cbb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0253deb4-3689-4fab-a42d-0a90d077648b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:24:47 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:24:47 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:24:47 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:24:47 user nova-compute[75571]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff (non-flash)
Nov 28 20:24:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:24:47 user nova-compute[75571]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 (non-flash)
Nov 28 20:24:47 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:24:47 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:24:47 user nova-compute[75571]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff (non-flash)
Nov 28 20:24:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77682f44c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618'): ({'sdf'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Removing single pathed devices sdf {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98416be-e119-4167-be72-24e9d319ceba]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9c7053-fef9-4244-930f-6a713ad42c00]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Flushing IO for device /dev/sdf {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8276c6-4d6c-498c-a877-dfbefd40209b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4f9051-14ce-4f62-8e79-1180ec54cfd4]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] SCSI volumes sdf have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed673df-8c21-4f52-86e0-a2b8ea133a2c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fba5845-55ad-4c00-b116-9942bd96bd46]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618, portal: 172.16.0.220,3260]
Nov 28 20:24:47 user nova-compute[75571]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618, portal: 172.16.0.220,3260] successful.
Nov 28 20:24:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5a18686-4ce1-48a9-8657-5d9ca9a6f618 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c777ece1-f6ed-4c6a-a2f1-13e705b554a5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] <== disconnect_volume: return (415ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:24:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] No VIF found with MAC fa:16:3e:94:a9:66, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:24:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.449s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:48 user nova-compute[75571]: DEBUG nova.objects.instance [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lazy-loading 'flavor' on Instance uuid 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:24:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.836s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:24:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:24:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:24:49 user nova-compute[75571]: INFO nova.compute.manager [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Detaching volume c1962081-a05e-49fb-a05e-9c37e208e4ff
Nov 28 20:24:49 user nova-compute[75571]: INFO nova.virt.block_device [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Attempting to driver detach volume c1962081-a05e-49fb-a05e-9c37e208e4ff from mountpoint /dev/vdb
Nov 28 20:24:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Attempting to detach device vdb from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:24:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:24:49 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:24:49 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:24:49 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:24:49 user nova-compute[75571]:   <serial>c1962081-a05e-49fb-a05e-9c37e208e4ff</serial>
Nov 28 20:24:49 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:24:49 user nova-compute[75571]: </disk>
Nov 28 20:24:49 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:24:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Successfully detached device vdb from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the persistent domain config.
Nov 28 20:24:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:24:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:24:49 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:24:49 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:24:49 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:24:49 user nova-compute[75571]:   <serial>c1962081-a05e-49fb-a05e-9c37e208e4ff</serial>
Nov 28 20:24:49 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:24:49 user nova-compute[75571]: </disk>
Nov 28 20:24:49 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:24:50 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:24:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:24:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:04 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:25:04 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:25:04 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:25:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:25:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:25:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:25:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:25:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:25:06 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:25:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-86c31e96-70cf-45fd-9578-194706af2ad0" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:25:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-86c31e96-70cf-45fd-9578-194706af2ad0" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:25:06 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:25:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:06 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Updating instance_info_cache with network_info: [{"id": "524df3be-b94b-462e-89c0-57ffa9878bd1", "address": "fa:16:3e:94:a9:66", "network": {"id": "ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-242564008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee4056e8f34a4e8da54592d28d7a75a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524df3be-b9", "ovs_interfaceid": "524df3be-b94b-462e-89c0-57ffa9878bd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:25:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-86c31e96-70cf-45fd-9578-194706af2ad0" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:25:06 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:25:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:25:07 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:25:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:25:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:25:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:25:07 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:25:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:25:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:25:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:10 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:25:10 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=7810MB free_disk=24.963237762451172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Applying migration context for instance 93392110-c3c3-44ff-a046-2f11608106c3 as it has an incoming, in-progress migration 52387bd7-c123-444c-85c1-ea3dc0d14494. Migration status is finished {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 20:25:10 user nova-compute[75571]: INFO nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Updating resource usage from migration 52387bd7-c123-444c-85c1-ea3dc0d14494
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 86c31e96-70cf-45fd-9578-194706af2ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 313a065e-94f3-4435-97af-6a16de64ca7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance f95d416b-d3b7-4b16-adc7-83a06088e167 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Migration 52387bd7-c123-444c-85c1-ea3dc0d14494 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 93392110-c3c3-44ff-a046-2f11608106c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:25:10 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 86c31e96-70cf-45fd-9578-194706af2ad0 is timed out.
Nov 28 20:25:10 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Successfully detached device vdb from instance 86c31e96-70cf-45fd-9578-194706af2ad0 from the live domain config.
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NeulsEbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:25:10 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e96bc8-31a6-4397-abae-ce04dc6425d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:25:10 user nova-compute[75571]: No targets found.
Nov 28 20:25:10 user nova-compute[75571]: iSNS:
Nov 28 20:25:10 user nova-compute[75571]: No targets found.
Nov 28 20:25:10 user nova-compute[75571]: STATIC:
Nov 28 20:25:10 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff
Nov 28 20:25:10 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:25:10 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:25:10 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9
Nov 28 20:25:10 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:25:10 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:25:10 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8
Nov 28 20:25:10 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:25:10 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:25:10 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:25:10 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:25:10 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:25:10 user nova-compute[75571]: FIRMWARE:
Nov 28 20:25:10 user nova-compute[75571]: No targets found.
Nov 28 20:25:10 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:25:10 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:25:10 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c8ea10-ecf8-4954-882a-5fb50f170ef4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eb4d3d-eb50-4730-8706-b8256e3230fb]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:25:10 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:25:10 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:25:10 user nova-compute[75571]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff (non-flash)
Nov 28 20:25:10 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:25:10 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:25:10 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:25:10 user nova-compute[75571]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff (non-flash)
Nov 28 20:25:10 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77687b8160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[19284755-b915-48c4-b8e1-ba6b2f4267a9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd08a37-e111-4918-838e-98f5f20c82b6]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e994fcb-b52a-45d9-8d1d-372c9bb7f16f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[35eec52a-f98b-4ebf-8acb-87039dadc139]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcdd398-c009-487d-a455-90baa5817dbc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4286c646-1fe1-412d-a587-6c09e2d9ed85]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff, portal: 172.16.0.220,3260]
Nov 28 20:25:10 user nova-compute[75571]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff, portal: 172.16.0.220,3260] successful.
Nov 28 20:25:10 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1962081-a05e-49fb-a05e-9c37e208e4ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdfaa02-6718-4a0e-9712-3beda61938a8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] <== disconnect_volume: return (347ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:25:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:25:11 user nova-compute[75571]: DEBUG nova.objects.instance [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'flavor' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:25:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.756s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:25:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:25:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:25:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:25:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:25:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:25:17 user nova-compute[75571]: INFO nova.compute.manager [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Terminating instance
Nov 28 20:25:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:25:17 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:25:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-b4835930-3018-4da5-8fb0-ab94fee121a7 req-62aab8d9-5107-4eef-97a1-89c2bc400819 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-vif-unplugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:25:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b4835930-3018-4da5-8fb0-ab94fee121a7 req-62aab8d9-5107-4eef-97a1-89c2bc400819 service nova] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:25:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b4835930-3018-4da5-8fb0-ab94fee121a7 req-62aab8d9-5107-4eef-97a1-89c2bc400819 service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:25:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b4835930-3018-4da5-8fb0-ab94fee121a7 req-62aab8d9-5107-4eef-97a1-89c2bc400819 service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:25:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-b4835930-3018-4da5-8fb0-ab94fee121a7 req-62aab8d9-5107-4eef-97a1-89c2bc400819 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] No waiting events found dispatching network-vif-unplugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:25:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-b4835930-3018-4da5-8fb0-ab94fee121a7 req-62aab8d9-5107-4eef-97a1-89c2bc400819 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-vif-unplugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Instance destroyed successfully.
Nov 28 20:25:18 user nova-compute[75571]: DEBUG nova.objects.instance [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lazy-loading 'resources' on Instance uuid 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1017855203',display_name='tempest-ServerStableDeviceRescueTest-server-1017855203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1017855203',id=21,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYTiwvlcWoEsangDB2AZ9sHLwb27V6zeNEeQyWpqOj3c4cWFR+pVY0iquLeDfKp7vix8Thyhov7xyHfY/9+bwp0ql4HQc4hqo4O1gIedyQ6vayMqqQvIV8W2owXgQYlrg==',key_name='tempest-keypair-794763884',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:22:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7077abda0e884a0883f39e48e56af27e',ramdisk_id='',reservation_id='r-t8ozj8s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-45095974',owner_user_name='tempest-ServerStableDeviceRescueTest-45095974-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:24:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4045806241134f5580140b5049e33228',uuid=1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Converting VIF {"id": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "address": "fa:16:3e:fc:63:7a", "network": {"id": "afa47bc5-6f66-41d1-9a82-74060d2f10c4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-702318877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7077abda0e884a0883f39e48e56af27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbed4dc-8f", "ovs_interfaceid": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:63:7a,bridge_name='br-int',has_traffic_filtering=True,id=1fbed4dc-8f66-4490-88f7-a0c4ae19fde9,network=Network(afa47bc5-6f66-41d1-9a82-74060d2f10c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fbed4dc-8f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG os_vif [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:63:7a,bridge_name='br-int',has_traffic_filtering=True,id=1fbed4dc-8f66-4490-88f7-a0c4ae19fde9,network=Network(afa47bc5-6f66-41d1-9a82-74060d2f10c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fbed4dc-8f') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fbed4dc-8f, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11275943-eb4c-45f6-b2a4-8a6aac939b08) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:18 user nova-compute[75571]: INFO os_vif [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:63:7a,bridge_name='br-int',has_traffic_filtering=True,id=1fbed4dc-8f66-4490-88f7-a0c4ae19fde9,network=Network(afa47bc5-6f66-41d1-9a82-74060d2f10c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fbed4dc-8f')
Nov 28 20:25:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Deleting instance files /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc_del
Nov 28 20:25:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Deletion of /opt/stack/data/nova/instances/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc_del complete
Nov 28 20:25:18 user nova-compute[75571]: INFO nova.compute.manager [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 28 20:25:18 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:25:18 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:25:19 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:25:19 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Took 0.67 seconds to deallocate network for instance.
Nov 28 20:25:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-551ff33a-ea2b-4aed-b00b-2478151abc55 req-dfab85a9-aaa8-4692-881b-150935590116 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-vif-deleted-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:25:19 user nova-compute[75571]: INFO nova.compute.manager [req-551ff33a-ea2b-4aed-b00b-2478151abc55 req-dfab85a9-aaa8-4692-881b-150935590116 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Neutron deleted interface 1fbed4dc-8f66-4490-88f7-a0c4ae19fde9; detaching it from the instance and deleting it from the info cache
Nov 28 20:25:19 user nova-compute[75571]: DEBUG nova.network.neutron [req-551ff33a-ea2b-4aed-b00b-2478151abc55 req-dfab85a9-aaa8-4692-881b-150935590116 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:25:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-551ff33a-ea2b-4aed-b00b-2478151abc55 req-dfab85a9-aaa8-4692-881b-150935590116 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Detach interface failed, port_id=1fbed4dc-8f66-4490-88f7-a0c4ae19fde9, reason: Instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:25:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:25:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:25:19 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:25:19 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:25:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:25:19 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Deleted allocations for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc
Nov 28 20:25:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.243s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:25:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-1c6b45f5-34d2-41d3-bb87-398d99400863 req-9cc71d2c-dc04-4560-b312-0ee5380a7ce0 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:25:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1c6b45f5-34d2-41d3-bb87-398d99400863 req-9cc71d2c-dc04-4560-b312-0ee5380a7ce0 service nova] Acquiring lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:25:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1c6b45f5-34d2-41d3-bb87-398d99400863 req-9cc71d2c-dc04-4560-b312-0ee5380a7ce0 service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:25:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1c6b45f5-34d2-41d3-bb87-398d99400863 req-9cc71d2c-dc04-4560-b312-0ee5380a7ce0 service nova] Lock "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:25:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-1c6b45f5-34d2-41d3-bb87-398d99400863 req-9cc71d2c-dc04-4560-b312-0ee5380a7ce0 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] No waiting events found dispatching network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:25:19 user nova-compute[75571]: WARNING nova.compute.manager [req-1c6b45f5-34d2-41d3-bb87-398d99400863 req-9cc71d2c-dc04-4560-b312-0ee5380a7ce0 service nova] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Received unexpected event network-vif-plugged-1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance with vm_state deleted and task_state None.
Nov 28 20:25:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-2aee2350-e82a-4b7c-8c22-3cf53435ad75 req-994c0cf7-dd25-43f2-89c3-e511abfe68d7 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-changed-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:25:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-2aee2350-e82a-4b7c-8c22-3cf53435ad75 req-994c0cf7-dd25-43f2-89c3-e511abfe68d7 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Refreshing instance network info cache due to event network-changed-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:25:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2aee2350-e82a-4b7c-8c22-3cf53435ad75 req-994c0cf7-dd25-43f2-89c3-e511abfe68d7 service nova] Acquiring lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:25:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2aee2350-e82a-4b7c-8c22-3cf53435ad75 req-994c0cf7-dd25-43f2-89c3-e511abfe68d7 service nova] Acquired lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:25:27 user nova-compute[75571]: DEBUG nova.network.neutron [req-2aee2350-e82a-4b7c-8c22-3cf53435ad75 req-994c0cf7-dd25-43f2-89c3-e511abfe68d7 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Refreshing network info cache for port 4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:25:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:25:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:25:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:25:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:25:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:25:27 user nova-compute[75571]: INFO nova.compute.manager [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Terminating instance
Nov 28 20:25:27 user nova-compute[75571]: DEBUG nova.compute.manager [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:25:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:28 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Instance destroyed successfully.
Nov 28 20:25:28 user nova-compute[75571]: DEBUG nova.objects.instance [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lazy-loading 'resources' on Instance uuid f95d416b-d3b7-4b16-adc7-83a06088e167 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1766072383',display_name='tempest-TestShelveInstance-server-1766072383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1766072383',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmRcrC+xEv9eq37KyVT3MN4g49xlT+tn2VHmIKI8IcmxomxVAiv7jCoA2CnKkM7knNVo8lhq5y0km1V+3OkdmA2AikbyaTLdfflHbz5DT3b54IbjGqVSR4M2T2o8iHZcQ==',key_name='tempest-TestShelveInstance-752726007',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bcf01c7a7d24806a2ffe82ec75c8a51',ramdisk_id='',reservation_id='r-6nppqoc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1960669737',owner_user_name='tempest-TestShelveInstance-1960669737-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:23:53Z,user_data=None,user_id='ca4e178401f940438a766a048076af93',uuid=f95d416b-d3b7-4b16-adc7-83a06088e167,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Converting VIF {"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:2e:14,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f,network=Network(559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6a23-8c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_vif [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:2e:14,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f,network=Network(559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6a23-8c') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f3e6a23-8c, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=398eb57f-280b-46f2-81fe-f20b180a80b8) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:25:28 user nova-compute[75571]: INFO os_vif [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:2e:14,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f,network=Network(559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6a23-8c')
Nov 28 20:25:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVhaHYKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:25:28 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2221c34-7648-4256-8fe7-ed68c49a2708]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:25:28 user nova-compute[75571]: No targets found.
Nov 28 20:25:28 user nova-compute[75571]: iSNS:
Nov 28 20:25:28 user nova-compute[75571]: No targets found.
Nov 28 20:25:28 user nova-compute[75571]: STATIC:
Nov 28 20:25:28 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9
Nov 28 20:25:28 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:25:28 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:25:28 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8
Nov 28 20:25:28 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:25:28 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:25:28 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:25:28 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:25:28 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:25:28 user nova-compute[75571]: FIRMWARE:
Nov 28 20:25:28 user nova-compute[75571]: No targets found.
Nov 28 20:25:28 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:25:28 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:25:28 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac24956-3ced-47da-bfc1-c1d9d723f058]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fb7528-92d3-400c-89b3-452b42fc24be]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:25:28 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:25:28 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:25:28 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:25:28 user nova-compute[75571]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 (non-flash)
Nov 28 20:25:28 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:25:28 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f776814d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9'): ({'sdc'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Removing single pathed devices sdc {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG nova.network.neutron [req-2aee2350-e82a-4b7c-8c22-3cf53435ad75 req-994c0cf7-dd25-43f2-89c3-e511abfe68d7 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updated VIF entry in instance network info cache for port 4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG nova.network.neutron [req-2aee2350-e82a-4b7c-8c22-3cf53435ad75 req-994c0cf7-dd25-43f2-89c3-e511abfe68d7 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updating instance_info_cache with network_info: [{"id": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "address": "fa:16:3e:2d:2e:14", "network": {"id": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-909551077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcf01c7a7d24806a2ffe82ec75c8a51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6a23-8c", "ovs_interfaceid": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8128cf-3c42-4b85-9067-48e95099589f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2aee2350-e82a-4b7c-8c22-3cf53435ad75 req-994c0cf7-dd25-43f2-89c3-e511abfe68d7 service nova] Releasing lock "refresh_cache-f95d416b-d3b7-4b16-adc7-83a06088e167" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[77777901-9518-4b39-8e77-35bc66f68a7e]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Flushing IO for device /dev/sdc {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5839663e-ce0f-4c42-9b14-4fee925d99cc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.065s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee10bd8e-5c82-4570-8782-447b79b80f30]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_fa686a6b', '/dev/disk/by-id/scsi-1SCST_BIOfa686a6b-f6c628c01c9e1fcc', '/dev/disk/by-id/scsi-26636633632386330') {{(pid=86013) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[113277bb-b58c-44f2-a15a-792210e639e5]: (4, None) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5da3e9-40b7-4409-987e-6935753b9aca]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e530c5-4bea-44a3-b40b-2de2de8fb1c6]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260]
Nov 28 20:25:28 user nova-compute[75571]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9, portal: 172.16.0.220,3260] successful.
Nov 28 20:25:28 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa2b1ac-220a-42a8-99fd-893e37359fd9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2699999-ce53-4429-8e48-d52b53c259ad]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] <== disconnect_volume: return (397ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:25:28 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Deleting instance files /opt/stack/data/nova/instances/f95d416b-d3b7-4b16-adc7-83a06088e167_del
Nov 28 20:25:28 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Deletion of /opt/stack/data/nova/instances/f95d416b-d3b7-4b16-adc7-83a06088e167_del complete
Nov 28 20:25:28 user nova-compute[75571]: INFO nova.compute.manager [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 28 20:25:28 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:25:28 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:25:29 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:25:29 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Took 0.53 seconds to deallocate network for instance.
Nov 28 20:25:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-vif-unplugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:25:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:25:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:25:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:25:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] No waiting events found dispatching network-vif-unplugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:25:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-vif-unplugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:25:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:25:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] Acquiring lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:25:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:25:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:25:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] No waiting events found dispatching network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:25:29 user nova-compute[75571]: WARNING nova.compute.manager [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received unexpected event network-vif-plugged-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance with vm_state active and task_state deleting.
Nov 28 20:25:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Received event network-vif-deleted-4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:25:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:29 user nova-compute[75571]: INFO nova.compute.manager [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Took 0.75 seconds to detach 1 volumes for instance.
Nov 28 20:25:29 user nova-compute[75571]: DEBUG nova.compute.manager [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Deleting volume: eaa2b1ac-220a-42a8-99fd-893e37359fd9 {{(pid=75571) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 20:25:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:25:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:25:30 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:25:30 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:25:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:25:30 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Deleted allocations for instance f95d416b-d3b7-4b16-adc7-83a06088e167
Nov 28 20:25:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "f95d416b-d3b7-4b16-adc7-83a06088e167" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.149s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:25:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "93392110-c3c3-44ff-a046-2f11608106c3" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:25:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "93392110-c3c3-44ff-a046-2f11608106c3" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:25:31 user nova-compute[75571]: DEBUG nova.compute.manager [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Going to confirm migration 2 {{(pid=75571) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 28 20:25:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:25:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquired lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:25:32 user nova-compute[75571]: DEBUG nova.network.neutron [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:25:32 user nova-compute[75571]: DEBUG nova.objects.instance [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lazy-loading 'info_cache' on Instance uuid 93392110-c3c3-44ff-a046-2f11608106c3 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:25:32 user nova-compute[75571]: DEBUG nova.network.neutron [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Updating instance_info_cache with network_info: [{"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:25:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Releasing lock "refresh_cache-93392110-c3c3-44ff-a046-2f11608106c3" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:25:32 user nova-compute[75571]: DEBUG nova.objects.instance [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lazy-loading 'migration_context' on Instance uuid 93392110-c3c3-44ff-a046-2f11608106c3 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:25:32 user nova-compute[75571]: DEBUG nova.objects.base [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Object Instance<93392110-c3c3-44ff-a046-2f11608106c3> lazy-loaded attributes: info_cache,migration_context {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:25:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:25:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:25:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:33 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:25:33 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:25:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.393s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:25:33 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Deleted allocation for migration 52387bd7-c123-444c-85c1-ea3dc0d14494
Nov 28 20:25:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "93392110-c3c3-44ff-a046-2f11608106c3" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.963s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:25:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:25:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:25:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:26:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "e6f2a651-b10a-45f4-8f94-6a4426654a86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:04 user nova-compute[75571]: DEBUG nova.compute.manager [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:26:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:04 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:26:04 user nova-compute[75571]: INFO nova.compute.claims [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Claim successful on node user
Nov 28 20:26:05 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG nova.network.neutron [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:26:05 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:26:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG nova.policy [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:26:05 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Creating image(s)
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "/opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "/opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.209s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk 1073741824" returned: 0 in 0.046s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:05 user nova-compute[75571]: DEBUG nova.network.neutron [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Successfully created port: 18a58452-a51f-448e-86d4-d6bdf0ec46cd {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Cannot resize image /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Ensure instance console log exists: /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Updating instance_info_cache with network_info: [{"id": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "address": "fa:16:3e:36:90:f8", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585ae662-b7", "ovs_interfaceid": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG nova.network.neutron [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Successfully updated port: 18a58452-a51f-448e-86d4-d6bdf0ec46cd {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "refresh_cache-e6f2a651-b10a-45f4-8f94-6a4426654a86" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquired lock "refresh_cache-e6f2a651-b10a-45f4-8f94-6a4426654a86" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG nova.network.neutron [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-0cb3807f-c433-485c-812a-35c21c4990b7 req-c883d17f-50e0-4afa-ac87-4aea3bf27b81 service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Received event network-changed-18a58452-a51f-448e-86d4-d6bdf0ec46cd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-0cb3807f-c433-485c-812a-35c21c4990b7 req-c883d17f-50e0-4afa-ac87-4aea3bf27b81 service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Refreshing instance network info cache due to event network-changed-18a58452-a51f-448e-86d4-d6bdf0ec46cd. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0cb3807f-c433-485c-812a-35c21c4990b7 req-c883d17f-50e0-4afa-ac87-4aea3bf27b81 service nova] Acquiring lock "refresh_cache-e6f2a651-b10a-45f4-8f94-6a4426654a86" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:26:06 user nova-compute[75571]: DEBUG nova.network.neutron [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.network.neutron [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Updating instance_info_cache with network_info: [{"id": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "address": "fa:16:3e:ba:24:79", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a58452-a5", "ovs_interfaceid": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Releasing lock "refresh_cache-e6f2a651-b10a-45f4-8f94-6a4426654a86" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.compute.manager [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Instance network_info: |[{"id": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "address": "fa:16:3e:ba:24:79", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a58452-a5", "ovs_interfaceid": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0cb3807f-c433-485c-812a-35c21c4990b7 req-c883d17f-50e0-4afa-ac87-4aea3bf27b81 service nova] Acquired lock "refresh_cache-e6f2a651-b10a-45f4-8f94-6a4426654a86" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.network.neutron [req-0cb3807f-c433-485c-812a-35c21c4990b7 req-c883d17f-50e0-4afa-ac87-4aea3bf27b81 service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Refreshing network info cache for port 18a58452-a51f-448e-86d4-d6bdf0ec46cd {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Start _get_guest_xml network_info=[{"id": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "address": "fa:16:3e:ba:24:79", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a58452-a5", "ovs_interfaceid": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:26:07 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:26:07 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-364538158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-364538158',id=31,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd03007966db45f48ae6c22ed6f84871',ramdisk_id='',reservation_id='r-xc01l5mq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-468878',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-468878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:26:05Z,user_data=None,user_id='007af37c9a914cd5863e486c041701be',uuid=e6f2a651-b10a-45f4-8f94-6a4426654a86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "address": "fa:16:3e:ba:24:79", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a58452-a5", "ovs_interfaceid": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converting VIF {"id": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "address": "fa:16:3e:ba:24:79", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a58452-a5", "ovs_interfaceid": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:24:79,bridge_name='br-int',has_traffic_filtering=True,id=18a58452-a51f-448e-86d4-d6bdf0ec46cd,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a58452-a5') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.objects.instance [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'pci_devices' on Instance uuid e6f2a651-b10a-45f4-8f94-6a4426654a86 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:26:07 user nova-compute[75571]:   <uuid>e6f2a651-b10a-45f4-8f94-6a4426654a86</uuid>
Nov 28 20:26:07 user nova-compute[75571]:   <name>instance-0000001f</name>
Nov 28 20:26:07 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:26:07 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:26:07 user nova-compute[75571]:   <metadata>
Nov 28 20:26:07 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:26:07 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:26:07 user nova-compute[75571]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-364538158</nova:name>
Nov 28 20:26:07 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:26:07</nova:creationTime>
Nov 28 20:26:07 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:26:07 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:26:07 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:26:07 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:26:07 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:26:07 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:26:07 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:26:07 user nova-compute[75571]:       <nova:owner>
Nov 28 20:26:07 user nova-compute[75571]:         <nova:user uuid="007af37c9a914cd5863e486c041701be">tempest-ServerBootFromVolumeStableRescueTest-468878-project-member</nova:user>
Nov 28 20:26:07 user nova-compute[75571]:         <nova:project uuid="dd03007966db45f48ae6c22ed6f84871">tempest-ServerBootFromVolumeStableRescueTest-468878</nova:project>
Nov 28 20:26:07 user nova-compute[75571]:       </nova:owner>
Nov 28 20:26:07 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:26:07 user nova-compute[75571]:       <nova:ports>
Nov 28 20:26:07 user nova-compute[75571]:         <nova:port uuid="18a58452-a51f-448e-86d4-d6bdf0ec46cd">
Nov 28 20:26:07 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 20:26:07 user nova-compute[75571]:         </nova:port>
Nov 28 20:26:07 user nova-compute[75571]:       </nova:ports>
Nov 28 20:26:07 user nova-compute[75571]:     </nova:instance>
Nov 28 20:26:07 user nova-compute[75571]:   </metadata>
Nov 28 20:26:07 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:26:07 user nova-compute[75571]:     <system>
Nov 28 20:26:07 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:26:07 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:26:07 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:26:07 user nova-compute[75571]:       <entry name="serial">e6f2a651-b10a-45f4-8f94-6a4426654a86</entry>
Nov 28 20:26:07 user nova-compute[75571]:       <entry name="uuid">e6f2a651-b10a-45f4-8f94-6a4426654a86</entry>
Nov 28 20:26:07 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:26:07 user nova-compute[75571]:     </system>
Nov 28 20:26:07 user nova-compute[75571]:   </sysinfo>
Nov 28 20:26:07 user nova-compute[75571]:   <os>
Nov 28 20:26:07 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:26:07 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:26:07 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:26:07 user nova-compute[75571]:   </os>
Nov 28 20:26:07 user nova-compute[75571]:   <features>
Nov 28 20:26:07 user nova-compute[75571]:     <acpi/>
Nov 28 20:26:07 user nova-compute[75571]:     <apic/>
Nov 28 20:26:07 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:26:07 user nova-compute[75571]:   </features>
Nov 28 20:26:07 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:26:07 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:26:07 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:26:07 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:26:07 user nova-compute[75571]:   </clock>
Nov 28 20:26:07 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:26:07 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:26:07 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:26:07 user nova-compute[75571]:   </cpu>
Nov 28 20:26:07 user nova-compute[75571]:   <devices>
Nov 28 20:26:07 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:26:07 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:26:07 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk"/>
Nov 28 20:26:07 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:26:07 user nova-compute[75571]:     </disk>
Nov 28 20:26:07 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:26:07 user nova-compute[75571]:       <mac address="fa:16:3e:ba:24:79"/>
Nov 28 20:26:07 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:26:07 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:26:07 user nova-compute[75571]:       <target dev="tap18a58452-a5"/>
Nov 28 20:26:07 user nova-compute[75571]:     </interface>
Nov 28 20:26:07 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:26:07 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/console.log" append="off"/>
Nov 28 20:26:07 user nova-compute[75571]:     </serial>
Nov 28 20:26:07 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:26:07 user nova-compute[75571]:     <video>
Nov 28 20:26:07 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:26:07 user nova-compute[75571]:     </video>
Nov 28 20:26:07 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:26:07 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:26:07 user nova-compute[75571]:     </rng>
Nov 28 20:26:07 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:26:07 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:26:07 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:26:07 user nova-compute[75571]:     </memballoon>
Nov 28 20:26:07 user nova-compute[75571]:   </devices>
Nov 28 20:26:07 user nova-compute[75571]: </domain>
Nov 28 20:26:07 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-364538158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-364538158',id=31,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd03007966db45f48ae6c22ed6f84871',ramdisk_id='',reservation_id='r-xc01l5mq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-468878',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-468878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:26:05Z,user_data=None,user_id='007af37c9a914cd5863e486c041701be',uuid=e6f2a651-b10a-45f4-8f94-6a4426654a86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "address": "fa:16:3e:ba:24:79", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a58452-a5", "ovs_interfaceid": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converting VIF {"id": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "address": "fa:16:3e:ba:24:79", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a58452-a5", "ovs_interfaceid": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:24:79,bridge_name='br-int',has_traffic_filtering=True,id=18a58452-a51f-448e-86d4-d6bdf0ec46cd,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a58452-a5') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG os_vif [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:24:79,bridge_name='br-int',has_traffic_filtering=True,id=18a58452-a51f-448e-86d4-d6bdf0ec46cd,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a58452-a5') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23cb0503-540c-562f-9934-24dbab20e426', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18a58452-a5, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18a58452-a5, col_values=(('qos', UUID('c98eddb8-80ec-4167-89d6-6431e16ff51d')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18a58452-a5, col_values=(('external_ids', {'iface-id': '18a58452-a51f-448e-86d4-d6bdf0ec46cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:24:79', 'vm-uuid': 'e6f2a651-b10a-45f4-8f94-6a4426654a86'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:07 user nova-compute[75571]: INFO os_vif [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:24:79,bridge_name='br-int',has_traffic_filtering=True,id=18a58452-a51f-448e-86d4-d6bdf0ec46cd,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a58452-a5')
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] No VIF found with MAC fa:16:3e:ba:24:79, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.network.neutron [req-0cb3807f-c433-485c-812a-35c21c4990b7 req-c883d17f-50e0-4afa-ac87-4aea3bf27b81 service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Updated VIF entry in instance network info cache for port 18a58452-a51f-448e-86d4-d6bdf0ec46cd. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG nova.network.neutron [req-0cb3807f-c433-485c-812a-35c21c4990b7 req-c883d17f-50e0-4afa-ac87-4aea3bf27b81 service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Updating instance_info_cache with network_info: [{"id": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "address": "fa:16:3e:ba:24:79", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a58452-a5", "ovs_interfaceid": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:26:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0cb3807f-c433-485c-812a-35c21c4990b7 req-c883d17f-50e0-4afa-ac87-4aea3bf27b81 service nova] Releasing lock "refresh_cache-e6f2a651-b10a-45f4-8f94-6a4426654a86" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-b1850d9c-e045-4c25-9986-611784569fd5 req-30667cca-38fe-44fa-9f6c-b2c025c864fe service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Received event network-vif-plugged-18a58452-a51f-448e-86d4-d6bdf0ec46cd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b1850d9c-e045-4c25-9986-611784569fd5 req-30667cca-38fe-44fa-9f6c-b2c025c864fe service nova] Acquiring lock "e6f2a651-b10a-45f4-8f94-6a4426654a86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b1850d9c-e045-4c25-9986-611784569fd5 req-30667cca-38fe-44fa-9f6c-b2c025c864fe service nova] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b1850d9c-e045-4c25-9986-611784569fd5 req-30667cca-38fe-44fa-9f6c-b2c025c864fe service nova] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-b1850d9c-e045-4c25-9986-611784569fd5 req-30667cca-38fe-44fa-9f6c-b2c025c864fe service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] No waiting events found dispatching network-vif-plugged-18a58452-a51f-448e-86d4-d6bdf0ec46cd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:26:08 user nova-compute[75571]: WARNING nova.compute.manager [req-b1850d9c-e045-4c25-9986-611784569fd5 req-30667cca-38fe-44fa-9f6c-b2c025c864fe service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Received unexpected event network-vif-plugged-18a58452-a51f-448e-86d4-d6bdf0ec46cd for instance with vm_state building and task_state spawning.
Nov 28 20:26:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:08 user nova-compute[75571]: INFO nova.compute.manager [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Terminating instance
Nov 28 20:26:08 user nova-compute[75571]: DEBUG nova.compute.manager [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-7e109a59-e72a-41b5-80dd-7fc1795e67b8 req-88443627-19e4-4d54-8be6-79fd9ff5ae80 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Received event network-vif-unplugged-524df3be-b94b-462e-89c0-57ffa9878bd1 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7e109a59-e72a-41b5-80dd-7fc1795e67b8 req-88443627-19e4-4d54-8be6-79fd9ff5ae80 service nova] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7e109a59-e72a-41b5-80dd-7fc1795e67b8 req-88443627-19e4-4d54-8be6-79fd9ff5ae80 service nova] Lock "86c31e96-70cf-45fd-9578-194706af2ad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7e109a59-e72a-41b5-80dd-7fc1795e67b8 req-88443627-19e4-4d54-8be6-79fd9ff5ae80 service nova] Lock "86c31e96-70cf-45fd-9578-194706af2ad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-7e109a59-e72a-41b5-80dd-7fc1795e67b8 req-88443627-19e4-4d54-8be6-79fd9ff5ae80 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] No waiting events found dispatching network-vif-unplugged-524df3be-b94b-462e-89c0-57ffa9878bd1 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-7e109a59-e72a-41b5-80dd-7fc1795e67b8 req-88443627-19e4-4d54-8be6-79fd9ff5ae80 service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Received event network-vif-unplugged-524df3be-b94b-462e-89c0-57ffa9878bd1 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:09 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Instance destroyed successfully.
Nov 28 20:26:09 user nova-compute[75571]: DEBUG nova.objects.instance [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'resources' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1119065400',display_name='tempest-SnapshotDataIntegrityTests-server-1119065400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1119065400',id=23,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGh0OvPNUnw0HlK5G584yN+gpnf86YMaudmoj1ZhKVFwAinhV6vAO9CJeiE48YExnyL1P7BzKCVI1GwObgP7Q4v0iy8rjQmkoZJJgf8xiwgR6GgkTRhAfEFVt2LCndxirA==',key_name='tempest-keypair-2062785846',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:19:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee4056e8f34a4e8da54592d28d7a75a1',ramdisk_id='',reservation_id='r-w57gfsl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1740984498',owner_user_name='tempest-SnapshotDataIntegrityTests-1740984498-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:19:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270de3ab19964431afa20c767af7b23c',uuid=86c31e96-70cf-45fd-9578-194706af2ad0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "524df3be-b94b-462e-89c0-57ffa9878bd1", "address": "fa:16:3e:94:a9:66", "network": {"id": "ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-242564008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee4056e8f34a4e8da54592d28d7a75a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524df3be-b9", "ovs_interfaceid": "524df3be-b94b-462e-89c0-57ffa9878bd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Converting VIF {"id": "524df3be-b94b-462e-89c0-57ffa9878bd1", "address": "fa:16:3e:94:a9:66", "network": {"id": "ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-242564008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee4056e8f34a4e8da54592d28d7a75a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524df3be-b9", "ovs_interfaceid": "524df3be-b94b-462e-89c0-57ffa9878bd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:a9:66,bridge_name='br-int',has_traffic_filtering=True,id=524df3be-b94b-462e-89c0-57ffa9878bd1,network=Network(ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524df3be-b9') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG os_vif [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:a9:66,bridge_name='br-int',has_traffic_filtering=True,id=524df3be-b94b-462e-89c0-57ffa9878bd1,network=Network(ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524df3be-b9') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap524df3be-b9, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6158981d-ff43-44d4-aadd-ce4b29893698) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:09 user nova-compute[75571]: INFO os_vif [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:a9:66,bridge_name='br-int',has_traffic_filtering=True,id=524df3be-b94b-462e-89c0-57ffa9878bd1,network=Network(ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524df3be-b9')
Nov 28 20:26:09 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Deleting instance files /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0_del
Nov 28 20:26:09 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Deletion of /opt/stack/data/nova/instances/86c31e96-70cf-45fd-9578-194706af2ad0_del complete
Nov 28 20:26:09 user nova-compute[75571]: INFO nova.compute.manager [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 28 20:26:09 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:26:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:10 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Error from libvirt while getting description of instance-00000017: [Error Code 42] Domain not found: no domain with matching uuid '86c31e96-70cf-45fd-9578-194706af2ad0' (instance-00000017): libvirt.libvirtError: Domain not found: no domain with matching uuid '86c31e96-70cf-45fd-9578-194706af2ad0' (instance-00000017)
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:26:10 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Took 0.70 seconds to deallocate network for instance.
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-7aa050e6-5af4-41ac-8c0f-f4b4bd5e23ce req-76343e9e-f0ff-46ae-93ae-c463765115cc service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Received event network-vif-deleted-524df3be-b94b-462e-89c0-57ffa9878bd1 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:26:10 user nova-compute[75571]: INFO nova.compute.manager [req-7aa050e6-5af4-41ac-8c0f-f4b4bd5e23ce req-76343e9e-f0ff-46ae-93ae-c463765115cc service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Neutron deleted interface 524df3be-b94b-462e-89c0-57ffa9878bd1; detaching it from the instance and deleting it from the info cache
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.network.neutron [req-7aa050e6-5af4-41ac-8c0f-f4b4bd5e23ce req-76343e9e-f0ff-46ae-93ae-c463765115cc service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-7aa050e6-5af4-41ac-8c0f-f4b4bd5e23ce req-76343e9e-f0ff-46ae-93ae-c463765115cc service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Detach interface failed, port_id=524df3be-b94b-462e-89c0-57ffa9878bd1, reason: Instance 86c31e96-70cf-45fd-9578-194706af2ad0 could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.compute.manager [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-a447953e-691f-45b5-a5e4-dbf12a036742 req-5aedb900-da61-43a0-9450-202701cd8d53 service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Received event network-vif-plugged-18a58452-a51f-448e-86d4-d6bdf0ec46cd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a447953e-691f-45b5-a5e4-dbf12a036742 req-5aedb900-da61-43a0-9450-202701cd8d53 service nova] Acquiring lock "e6f2a651-b10a-45f4-8f94-6a4426654a86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a447953e-691f-45b5-a5e4-dbf12a036742 req-5aedb900-da61-43a0-9450-202701cd8d53 service nova] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a447953e-691f-45b5-a5e4-dbf12a036742 req-5aedb900-da61-43a0-9450-202701cd8d53 service nova] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-a447953e-691f-45b5-a5e4-dbf12a036742 req-5aedb900-da61-43a0-9450-202701cd8d53 service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] No waiting events found dispatching network-vif-plugged-18a58452-a51f-448e-86d4-d6bdf0ec46cd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:26:10 user nova-compute[75571]: WARNING nova.compute.manager [req-a447953e-691f-45b5-a5e4-dbf12a036742 req-5aedb900-da61-43a0-9450-202701cd8d53 service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Received unexpected event network-vif-plugged-18a58452-a51f-448e-86d4-d6bdf0ec46cd for instance with vm_state building and task_state spawning.
Nov 28 20:26:10 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Instance spawned successfully.
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:10 user nova-compute[75571]: INFO nova.compute.manager [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 28 20:26:10 user nova-compute[75571]: DEBUG nova.compute.manager [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:26:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:10 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Deleted allocations for instance 86c31e96-70cf-45fd-9578-194706af2ad0
Nov 28 20:26:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:26:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "86c31e96-70cf-45fd-9578-194706af2ad0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.210s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:11 user nova-compute[75571]: INFO nova.compute.manager [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Took 6.37 seconds to build instance.
Nov 28 20:26:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.477s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:11 user nova-compute[75571]: DEBUG nova.compute.manager [req-5335eb8e-7073-448f-bc54-94742bc880bb req-35175bd3-8ffb-4c3f-b901-65629cbc4d7a service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Received event network-vif-plugged-524df3be-b94b-462e-89c0-57ffa9878bd1 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:26:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5335eb8e-7073-448f-bc54-94742bc880bb req-35175bd3-8ffb-4c3f-b901-65629cbc4d7a service nova] Acquiring lock "86c31e96-70cf-45fd-9578-194706af2ad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5335eb8e-7073-448f-bc54-94742bc880bb req-35175bd3-8ffb-4c3f-b901-65629cbc4d7a service nova] Lock "86c31e96-70cf-45fd-9578-194706af2ad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5335eb8e-7073-448f-bc54-94742bc880bb req-35175bd3-8ffb-4c3f-b901-65629cbc4d7a service nova] Lock "86c31e96-70cf-45fd-9578-194706af2ad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:11 user nova-compute[75571]: DEBUG nova.compute.manager [req-5335eb8e-7073-448f-bc54-94742bc880bb req-35175bd3-8ffb-4c3f-b901-65629cbc4d7a service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] No waiting events found dispatching network-vif-plugged-524df3be-b94b-462e-89c0-57ffa9878bd1 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:26:11 user nova-compute[75571]: WARNING nova.compute.manager [req-5335eb8e-7073-448f-bc54-94742bc880bb req-35175bd3-8ffb-4c3f-b901-65629cbc4d7a service nova] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Received unexpected event network-vif-plugged-524df3be-b94b-462e-89c0-57ffa9878bd1 for instance with vm_state deleted and task_state None.
Nov 28 20:26:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:12 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:26:12 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:26:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8238MB free_disk=25.076725006103516GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:26:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:26:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:26:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:26:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 313a065e-94f3-4435-97af-6a16de64ca7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:26:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 93392110-c3c3-44ff-a046-2f11608106c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:26:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:26:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e6f2a651-b10a-45f4-8f94-6a4426654a86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:26:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:26:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:26:12 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:26:12 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:26:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:26:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:26:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:26:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:26:26 user nova-compute[75571]: INFO nova.compute.claims [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Claim successful on node user
Nov 28 20:26:26 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:26:26 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:26:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:26:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:26:26 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:26:26 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:26:27 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG nova.policy [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:26:27 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Creating image(s)
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "/opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "/opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "/opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk 1073741824" returned: 0 in 0.059s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.209s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Successfully created port: 23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Cannot resize image /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Ensure instance console log exists: /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:28 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Successfully updated port: 23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:26:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:26:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquired lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:26:28 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:26:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-3b8de463-dc79-41df-9ee0-f3890eb44204 req-760d7ebc-b468-4002-8cc5-207055931402 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-changed-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:26:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-3b8de463-dc79-41df-9ee0-f3890eb44204 req-760d7ebc-b468-4002-8cc5-207055931402 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Refreshing instance network info cache due to event network-changed-23e84680-3abf-49b8-9750-1a0a3cd8b4cb. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:26:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3b8de463-dc79-41df-9ee0-f3890eb44204 req-760d7ebc-b468-4002-8cc5-207055931402 service nova] Acquiring lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:26:28 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Updating instance_info_cache with network_info: [{"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Releasing lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Instance network_info: |[{"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3b8de463-dc79-41df-9ee0-f3890eb44204 req-760d7ebc-b468-4002-8cc5-207055931402 service nova] Acquired lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.network.neutron [req-3b8de463-dc79-41df-9ee0-f3890eb44204 req-760d7ebc-b468-4002-8cc5-207055931402 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Refreshing network info cache for port 23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Start _get_guest_xml network_info=[{"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:26:29 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:26:29 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:26:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-599565098',display_name='tempest-AttachVolumeTestJSON-server-599565098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-599565098',id=32,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3XwsjqlLJC+H5W8+kliU+liUVxsmiGlirVM1hB3Xvq2TAMksvSwoTdDPqxJDLnMy/epsE7znWc/yERpeFqyVO3BqmqmL465Jtof0GPEtberkTrsDvfTVDra8QzBI4sQ==',key_name='tempest-keypair-1076987994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7d489de217644979c5888d97158a800',ramdisk_id='',reservation_id='r-8ipm7twc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-187128538',owner_user_name='tempest-AttachVolumeTestJSON-187128538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:26:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d653c87883374ab59768ce28b2b9adfc',uuid=636a8f00-7685-4c1b-9404-cf16359dd08a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converting VIF {"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.objects.instance [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'pci_devices' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:26:29 user nova-compute[75571]:   <uuid>636a8f00-7685-4c1b-9404-cf16359dd08a</uuid>
Nov 28 20:26:29 user nova-compute[75571]:   <name>instance-00000020</name>
Nov 28 20:26:29 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:26:29 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:26:29 user nova-compute[75571]:   <metadata>
Nov 28 20:26:29 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:26:29 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:26:29 user nova-compute[75571]:       <nova:name>tempest-AttachVolumeTestJSON-server-599565098</nova:name>
Nov 28 20:26:29 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:26:29</nova:creationTime>
Nov 28 20:26:29 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:26:29 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:26:29 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:26:29 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:26:29 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:26:29 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:26:29 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:26:29 user nova-compute[75571]:       <nova:owner>
Nov 28 20:26:29 user nova-compute[75571]:         <nova:user uuid="d653c87883374ab59768ce28b2b9adfc">tempest-AttachVolumeTestJSON-187128538-project-member</nova:user>
Nov 28 20:26:29 user nova-compute[75571]:         <nova:project uuid="a7d489de217644979c5888d97158a800">tempest-AttachVolumeTestJSON-187128538</nova:project>
Nov 28 20:26:29 user nova-compute[75571]:       </nova:owner>
Nov 28 20:26:29 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:26:29 user nova-compute[75571]:       <nova:ports>
Nov 28 20:26:29 user nova-compute[75571]:         <nova:port uuid="23e84680-3abf-49b8-9750-1a0a3cd8b4cb">
Nov 28 20:26:29 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 20:26:29 user nova-compute[75571]:         </nova:port>
Nov 28 20:26:29 user nova-compute[75571]:       </nova:ports>
Nov 28 20:26:29 user nova-compute[75571]:     </nova:instance>
Nov 28 20:26:29 user nova-compute[75571]:   </metadata>
Nov 28 20:26:29 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:26:29 user nova-compute[75571]:     <system>
Nov 28 20:26:29 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:26:29 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:26:29 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:26:29 user nova-compute[75571]:       <entry name="serial">636a8f00-7685-4c1b-9404-cf16359dd08a</entry>
Nov 28 20:26:29 user nova-compute[75571]:       <entry name="uuid">636a8f00-7685-4c1b-9404-cf16359dd08a</entry>
Nov 28 20:26:29 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:26:29 user nova-compute[75571]:     </system>
Nov 28 20:26:29 user nova-compute[75571]:   </sysinfo>
Nov 28 20:26:29 user nova-compute[75571]:   <os>
Nov 28 20:26:29 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:26:29 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:26:29 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:26:29 user nova-compute[75571]:   </os>
Nov 28 20:26:29 user nova-compute[75571]:   <features>
Nov 28 20:26:29 user nova-compute[75571]:     <acpi/>
Nov 28 20:26:29 user nova-compute[75571]:     <apic/>
Nov 28 20:26:29 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:26:29 user nova-compute[75571]:   </features>
Nov 28 20:26:29 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:26:29 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:26:29 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:26:29 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:26:29 user nova-compute[75571]:   </clock>
Nov 28 20:26:29 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:26:29 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:26:29 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:26:29 user nova-compute[75571]:   </cpu>
Nov 28 20:26:29 user nova-compute[75571]:   <devices>
Nov 28 20:26:29 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:26:29 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:26:29 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk"/>
Nov 28 20:26:29 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:26:29 user nova-compute[75571]:     </disk>
Nov 28 20:26:29 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:26:29 user nova-compute[75571]:       <mac address="fa:16:3e:b0:53:96"/>
Nov 28 20:26:29 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:26:29 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:26:29 user nova-compute[75571]:       <target dev="tap23e84680-3a"/>
Nov 28 20:26:29 user nova-compute[75571]:     </interface>
Nov 28 20:26:29 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:26:29 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/console.log" append="off"/>
Nov 28 20:26:29 user nova-compute[75571]:     </serial>
Nov 28 20:26:29 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:26:29 user nova-compute[75571]:     <video>
Nov 28 20:26:29 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:26:29 user nova-compute[75571]:     </video>
Nov 28 20:26:29 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:26:29 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:26:29 user nova-compute[75571]:     </rng>
Nov 28 20:26:29 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:26:29 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:26:29 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:26:29 user nova-compute[75571]:     </memballoon>
Nov 28 20:26:29 user nova-compute[75571]:   </devices>
Nov 28 20:26:29 user nova-compute[75571]: </domain>
Nov 28 20:26:29 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:26:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-599565098',display_name='tempest-AttachVolumeTestJSON-server-599565098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-599565098',id=32,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3XwsjqlLJC+H5W8+kliU+liUVxsmiGlirVM1hB3Xvq2TAMksvSwoTdDPqxJDLnMy/epsE7znWc/yERpeFqyVO3BqmqmL465Jtof0GPEtberkTrsDvfTVDra8QzBI4sQ==',key_name='tempest-keypair-1076987994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7d489de217644979c5888d97158a800',ramdisk_id='',reservation_id='r-8ipm7twc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-187128538',owner_user_name='tempest-AttachVolumeTestJSON-187128538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:26:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d653c87883374ab59768ce28b2b9adfc',uuid=636a8f00-7685-4c1b-9404-cf16359dd08a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converting VIF {"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG os_vif [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7005d4a2-64b4-5e80-b66f-641e72d73868', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23e84680-3a, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23e84680-3a, col_values=(('qos', UUID('ae511e09-44ca-441e-9432-af0398c3be2b')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23e84680-3a, col_values=(('external_ids', {'iface-id': '23e84680-3abf-49b8-9750-1a0a3cd8b4cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:53:96', 'vm-uuid': '636a8f00-7685-4c1b-9404-cf16359dd08a'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:29 user nova-compute[75571]: INFO os_vif [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a')
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] No VIF found with MAC fa:16:3e:b0:53:96, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.network.neutron [req-3b8de463-dc79-41df-9ee0-f3890eb44204 req-760d7ebc-b468-4002-8cc5-207055931402 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Updated VIF entry in instance network info cache for port 23e84680-3abf-49b8-9750-1a0a3cd8b4cb. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG nova.network.neutron [req-3b8de463-dc79-41df-9ee0-f3890eb44204 req-760d7ebc-b468-4002-8cc5-207055931402 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Updating instance_info_cache with network_info: [{"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:26:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3b8de463-dc79-41df-9ee0-f3890eb44204 req-760d7ebc-b468-4002-8cc5-207055931402 service nova] Releasing lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:26:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:31 user nova-compute[75571]: DEBUG nova.compute.manager [req-19c32b34-6adc-4fd3-886b-32a58a3b805a req-f823b28f-83f8-432b-9691-d0cfac2c849f service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:26:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-19c32b34-6adc-4fd3-886b-32a58a3b805a req-f823b28f-83f8-432b-9691-d0cfac2c849f service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-19c32b34-6adc-4fd3-886b-32a58a3b805a req-f823b28f-83f8-432b-9691-d0cfac2c849f service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-19c32b34-6adc-4fd3-886b-32a58a3b805a req-f823b28f-83f8-432b-9691-d0cfac2c849f service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:31 user nova-compute[75571]: DEBUG nova.compute.manager [req-19c32b34-6adc-4fd3-886b-32a58a3b805a req-f823b28f-83f8-432b-9691-d0cfac2c849f service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:26:31 user nova-compute[75571]: WARNING nova.compute.manager [req-19c32b34-6adc-4fd3-886b-32a58a3b805a req-f823b28f-83f8-432b-9691-d0cfac2c849f service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state building and task_state spawning.
Nov 28 20:26:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG nova.objects.instance [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'flavor' on Instance uuid fe1fe030-1a1e-49c9-97e8-6e9840d4908d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:32 user nova-compute[75571]: INFO nova.compute.manager [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Attaching volume a0e3c161-4228-4fc0-afb9-4de5e6eff658 to /dev/vdb
Nov 28 20:26:32 user nova-compute[75571]: DEBUG os_brick.utils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e84b9e9-f4ad-40e1-a7ef-ec993f7e7aa5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d6d92a-cc80-4bfe-b182-6ad84aac684d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e824fa8-de54-4d8b-817b-a699dd96a1e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[822f8123-5bf6-47d9-bb08-39c5aabc64e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:26:32 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:26:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b847e44e-7f72-45a4-942f-74b8139eaeec]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG os_brick.utils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:26:32 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Updating existing volume attachment record: 025d8e54-74fd-4586-bc50-0e8c22bc6e0d {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:26:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-9534ff37-c496-4a91-b57e-2516c291d554 req-cd9fa396-4c0d-443f-a518-529fd83bca8d service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:26:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9534ff37-c496-4a91-b57e-2516c291d554 req-cd9fa396-4c0d-443f-a518-529fd83bca8d service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9534ff37-c496-4a91-b57e-2516c291d554 req-cd9fa396-4c0d-443f-a518-529fd83bca8d service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9534ff37-c496-4a91-b57e-2516c291d554 req-cd9fa396-4c0d-443f-a518-529fd83bca8d service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-9534ff37-c496-4a91-b57e-2516c291d554 req-cd9fa396-4c0d-443f-a518-529fd83bca8d service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:26:33 user nova-compute[75571]: WARNING nova.compute.manager [req-9534ff37-c496-4a91-b57e-2516c291d554 req-cd9fa396-4c0d-443f-a518-529fd83bca8d service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state building and task_state spawning.
Nov 28 20:26:33 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:26:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:26:33 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Instance spawned successfully.
Nov 28 20:26:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:26:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:26:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:26:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:26:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:26:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:26:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:26:33 user nova-compute[75571]: INFO nova.compute.manager [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Took 6.29 seconds to spawn the instance on the hypervisor.
Nov 28 20:26:33 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:26:33 user nova-compute[75571]: INFO nova.compute.manager [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Took 7.08 seconds to build instance.
Nov 28 20:26:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.178s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UctVXQIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:26:39 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:26:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:26:39 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:26:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:26:39 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[619f6e7c-e032-4863-a291-67b16511f277]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:26:39 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd8b064-3750-48bc-9fda-6110a09977b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658] added
Nov 28 20:26:39 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27c9e0e-f984-44fc-ba34-8393f648f7c3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c61183c-78ae-4fad-8d15-b12875140227]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UctVXQIj {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UctVXQIj" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e6ed07-5a18-422a-bdc8-f9760af7c436]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UctVXQIj'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c65925f-28d4-4543-a8f3-9767370cfb51]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d0812f-7b2d-4665-a56a-6085f33cf151]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:26:39 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:26:39 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:26:39 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:26:39 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:26:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3337c1-bf0e-4ef0-9306-bcbb29d78891]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260]
Nov 28 20:26:40 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260] successful.
Nov 28 20:26:40 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[be67f78c-6d9c-4de0-802f-85ce1488e348]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6f0a7a-a8ae-45b6-be9d-1480b1e167be]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:26:40 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:26:40 user nova-compute[75571]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)
Nov 28 20:26:40 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:26:40 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:26:40 user nova-compute[75571]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)
Nov 28 20:26:40 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c26b3bb-a80b-47c9-b672-8092a4cdb08e]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:26:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UctVXQIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:26:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:26:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26161653436616238', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:26:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161653436616238', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:26:41 user nova-compute[75571]: DEBUG nova.objects.instance [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'flavor' on Instance uuid fe1fe030-1a1e-49c9-97e8-6e9840d4908d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:26:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:26:41 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:26:41 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:26:41 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:26:41 user nova-compute[75571]:   <serial>a0e3c161-4228-4fc0-afb9-4de5e6eff658</serial>
Nov 28 20:26:41 user nova-compute[75571]: </disk>
Nov 28 20:26:41 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:26:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:26:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:26:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] No VIF found with MAC fa:16:3e:87:26:b0, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:26:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.238s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-7df0e165-5ff9-473a-9def-f4367c8a09bd req-32b1f5b1-eba7-4fa5-86fa-a8d0a8a78b4c service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received event network-changed-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:26:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-7df0e165-5ff9-473a-9def-f4367c8a09bd req-32b1f5b1-eba7-4fa5-86fa-a8d0a8a78b4c service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Refreshing instance network info cache due to event network-changed-f496e45a-10e5-489c-bec3-3788ecad173c. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:26:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7df0e165-5ff9-473a-9def-f4367c8a09bd req-32b1f5b1-eba7-4fa5-86fa-a8d0a8a78b4c service nova] Acquiring lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:26:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7df0e165-5ff9-473a-9def-f4367c8a09bd req-32b1f5b1-eba7-4fa5-86fa-a8d0a8a78b4c service nova] Acquired lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:26:47 user nova-compute[75571]: DEBUG nova.network.neutron [req-7df0e165-5ff9-473a-9def-f4367c8a09bd req-32b1f5b1-eba7-4fa5-86fa-a8d0a8a78b4c service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Refreshing network info cache for port f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:26:47 user nova-compute[75571]: DEBUG nova.network.neutron [req-7df0e165-5ff9-473a-9def-f4367c8a09bd req-32b1f5b1-eba7-4fa5-86fa-a8d0a8a78b4c service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Updated VIF entry in instance network info cache for port f496e45a-10e5-489c-bec3-3788ecad173c. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:26:47 user nova-compute[75571]: DEBUG nova.network.neutron [req-7df0e165-5ff9-473a-9def-f4367c8a09bd req-32b1f5b1-eba7-4fa5-86fa-a8d0a8a78b4c service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Updating instance_info_cache with network_info: [{"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:26:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7df0e165-5ff9-473a-9def-f4367c8a09bd req-32b1f5b1-eba7-4fa5-86fa-a8d0a8a78b4c service nova] Releasing lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:26:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-cf0aa3e9-cfca-4716-a68c-c76702f4dff1 req-303e21ac-4116-4793-a474-ebbea2b350ae service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received event network-changed-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:26:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-cf0aa3e9-cfca-4716-a68c-c76702f4dff1 req-303e21ac-4116-4793-a474-ebbea2b350ae service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Refreshing instance network info cache due to event network-changed-f496e45a-10e5-489c-bec3-3788ecad173c. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:26:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cf0aa3e9-cfca-4716-a68c-c76702f4dff1 req-303e21ac-4116-4793-a474-ebbea2b350ae service nova] Acquiring lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:26:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cf0aa3e9-cfca-4716-a68c-c76702f4dff1 req-303e21ac-4116-4793-a474-ebbea2b350ae service nova] Acquired lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:26:49 user nova-compute[75571]: DEBUG nova.network.neutron [req-cf0aa3e9-cfca-4716-a68c-c76702f4dff1 req-303e21ac-4116-4793-a474-ebbea2b350ae service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Refreshing network info cache for port f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:26:49 user nova-compute[75571]: DEBUG nova.network.neutron [req-cf0aa3e9-cfca-4716-a68c-c76702f4dff1 req-303e21ac-4116-4793-a474-ebbea2b350ae service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Updated VIF entry in instance network info cache for port f496e45a-10e5-489c-bec3-3788ecad173c. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:26:49 user nova-compute[75571]: DEBUG nova.network.neutron [req-cf0aa3e9-cfca-4716-a68c-c76702f4dff1 req-303e21ac-4116-4793-a474-ebbea2b350ae service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Updating instance_info_cache with network_info: [{"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:26:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cf0aa3e9-cfca-4716-a68c-c76702f4dff1 req-303e21ac-4116-4793-a474-ebbea2b350ae service nova] Releasing lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:26:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:53 user nova-compute[75571]: INFO nova.compute.manager [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Rebooting instance
Nov 28 20:26:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:26:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquired lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:26:53 user nova-compute[75571]: DEBUG nova.network.neutron [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:26:54 user nova-compute[75571]: DEBUG nova.network.neutron [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Updating instance_info_cache with network_info: [{"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:26:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Releasing lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:26:54 user nova-compute[75571]: DEBUG nova.compute.manager [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:26:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:54 user nova-compute[75571]: DEBUG nova.compute.manager [req-b761efd0-218c-43c7-a193-7585da1d0590 req-e06f6cdd-8e8e-4b1d-ad6d-a0e559a428d2 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received event network-vif-unplugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:26:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b761efd0-218c-43c7-a193-7585da1d0590 req-e06f6cdd-8e8e-4b1d-ad6d-a0e559a428d2 service nova] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b761efd0-218c-43c7-a193-7585da1d0590 req-e06f6cdd-8e8e-4b1d-ad6d-a0e559a428d2 service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b761efd0-218c-43c7-a193-7585da1d0590 req-e06f6cdd-8e8e-4b1d-ad6d-a0e559a428d2 service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:54 user nova-compute[75571]: DEBUG nova.compute.manager [req-b761efd0-218c-43c7-a193-7585da1d0590 req-e06f6cdd-8e8e-4b1d-ad6d-a0e559a428d2 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] No waiting events found dispatching network-vif-unplugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:26:54 user nova-compute[75571]: WARNING nova.compute.manager [req-b761efd0-218c-43c7-a193-7585da1d0590 req-e06f6cdd-8e8e-4b1d-ad6d-a0e559a428d2 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received unexpected event network-vif-unplugged-f496e45a-10e5-489c-bec3-3788ecad173c for instance with vm_state active and task_state reboot_started_hard.
Nov 28 20:26:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:55 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Instance destroyed successfully.
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.objects.instance [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'resources' on Instance uuid fe1fe030-1a1e-49c9-97e8-6e9840d4908d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1371290012',display_name='tempest-TestMinimumBasicScenario-server-1371290012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1371290012',id=30,image_ref='b593e02e-c19a-4aca-a243-304aa450f095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOwoMBR4cnJDatR+jEGAoE1++DF00x1L3tAHFh+2yRDgkQBY4IPkD5ygZ01Zy4k93InMKpeftJSTa2JLsnlu1pFbf2YVD4gZrxRSbUCScLWZKcNGiSbU5NXz8hrSEW1+w==',key_name='tempest-TestMinimumBasicScenario-149674416',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fb173b085164da1b53412e2948fbdfe',ramdisk_id='',reservation_id='r-h3jercbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b593e02e-c19a-4aca-a243-304aa450f095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1412958496',owner_user_name='tempest-TestMinimumBasicScenario-1412958496-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:26:54Z,user_data=None,user_id='6722115f609e44ccad60d00c89a04ddb',uuid=fe1fe030-1a1e-49c9-97e8-6e9840d4908d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converting VIF {"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:26:b0,bridge_name='br-int',has_traffic_filtering=True,id=f496e45a-10e5-489c-bec3-3788ecad173c,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496e45a-10') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_vif [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:26:b0,bridge_name='br-int',has_traffic_filtering=True,id=f496e45a-10e5-489c-bec3-3788ecad173c,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496e45a-10') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf496e45a-10, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=713e5482-8a0c-44a1-950f-af0d16520f60) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:55 user nova-compute[75571]: INFO os_vif [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:26:b0,bridge_name='br-int',has_traffic_filtering=True,id=f496e45a-10e5-489c-bec3-3788ecad173c,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496e45a-10')
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UctVXQIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:26:55 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d518aa51-1625-40a6-8bd8-5fbd4effeea0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:26:55 user nova-compute[75571]: No targets found.
Nov 28 20:26:55 user nova-compute[75571]: iSNS:
Nov 28 20:26:55 user nova-compute[75571]: No targets found.
Nov 28 20:26:55 user nova-compute[75571]: STATIC:
Nov 28 20:26:55 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8
Nov 28 20:26:55 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:26:55 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:26:55 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658
Nov 28 20:26:55 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:26:55 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:26:55 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:26:55 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:26:55 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:26:55 user nova-compute[75571]: FIRMWARE:
Nov 28 20:26:55 user nova-compute[75571]: No targets found.
Nov 28 20:26:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:26:55 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:26:55 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[933c6c4b-d3ee-46bf-847a-858a5d320f85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ffdaa8-e843-4412-a003-87ed44213048]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768135480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c52bae0-e4f5-41ff-9e78-2f561c981eb7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[be329a42-8017-44ff-9361-224bb66ed455]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd249d8-c2f7-454d-a96c-788f6085fe49]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c849894b-c5b5-413b-91fc-90dc7d6b6ff1]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d56818-2c78-4f06-9e55-6bd82a8c371c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9b3c02-cf14-4446-a43d-0a6237bc3135]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260]
Nov 28 20:26:55 user nova-compute[75571]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260] successful.
Nov 28 20:26:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0168155c-a81d-4fe2-aaba-aca6f5509e25]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] <== disconnect_volume: return (289ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Start _get_guest_xml network_info=[{"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b593e02e-c19a-4aca-a243-304aa450f095,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'b593e02e-c19a-4aca-a243-304aa450f095'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UctVXQIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'fe1fe030-1a1e-49c9-97e8-6e9840d4908d', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0e3c161-4228-4fc0-afb9-4de5e6eff658', 'serial': 'a0e3c161-4228-4fc0-afb9-4de5e6eff658'}, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '025d8e54-74fd-4586-bc50-0e8c22bc6e0d', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:26:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:26:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b593e02e-c19a-4aca-a243-304aa450f095,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.objects.instance [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'vcpu_model' on Instance uuid fe1fe030-1a1e-49c9-97e8-6e9840d4908d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.objects.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Object Instance<fe1fe030-1a1e-49c9-97e8-6e9840d4908d> lazy-loaded attributes: resources,vcpu_model {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UctVXQIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:26:55 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:26:55 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:26:55 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc65dadb-1af4-4abd-a71d-6c5173c46d33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:26:55 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a58cd9-4c0d-4067-ab83-91129066ba35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658] added
Nov 28 20:26:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4c42fd-e0ee-41e0-8933-b81dd0a62de1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4584dea8-bc05-41c5-8cbd-76804f6ec76b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UctVXQIj {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UctVXQIj" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[12acef86-5534-426d-b927-7bcdc3974cde]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UctVXQIj'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7d11c7-b216-4292-92ce-6c942bc2bac0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc73195-243a-4ff7-bebd-a36fdf6186ed]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[747ede8d-ace5-4e38-9fc0-ffbd3cc92a01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260]
Nov 28 20:26:55 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260] successful.
Nov 28 20:26:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[425d81a3-f7f0-4272-b8dd-b3085b33bd50]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74b0efa-3ff8-4165-9bde-e2815f3a60b3]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)
Nov 28 20:26:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f70dd2-1515-40c7-a636-b8d4628d32da]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:26:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UctVXQIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:26:56 user nova-compute[75571]: DEBUG nova.compute.manager [req-1a0a969d-daf1-4503-a6a1-dc32e3881f70 req-0d7c5611-64cc-4863-b4e9-c80f7ff9b8b1 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received event network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:26:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1a0a969d-daf1-4503-a6a1-dc32e3881f70 req-0d7c5611-64cc-4863-b4e9-c80f7ff9b8b1 service nova] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1a0a969d-daf1-4503-a6a1-dc32e3881f70 req-0d7c5611-64cc-4863-b4e9-c80f7ff9b8b1 service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1a0a969d-daf1-4503-a6a1-dc32e3881f70 req-0d7c5611-64cc-4863-b4e9-c80f7ff9b8b1 service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:56 user nova-compute[75571]: DEBUG nova.compute.manager [req-1a0a969d-daf1-4503-a6a1-dc32e3881f70 req-0d7c5611-64cc-4863-b4e9-c80f7ff9b8b1 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] No waiting events found dispatching network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:26:56 user nova-compute[75571]: WARNING nova.compute.manager [req-1a0a969d-daf1-4503-a6a1-dc32e3881f70 req-0d7c5611-64cc-4863-b4e9-c80f7ff9b8b1 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received unexpected event network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c for instance with vm_state active and task_state reboot_started_hard.
Nov 28 20:26:56 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:26:56 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26161653436616238', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:26:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161653436616238', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:26:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1371290012',display_name='tempest-TestMinimumBasicScenario-server-1371290012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1371290012',id=30,image_ref='b593e02e-c19a-4aca-a243-304aa450f095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOwoMBR4cnJDatR+jEGAoE1++DF00x1L3tAHFh+2yRDgkQBY4IPkD5ygZ01Zy4k93InMKpeftJSTa2JLsnlu1pFbf2YVD4gZrxRSbUCScLWZKcNGiSbU5NXz8hrSEW1+w==',key_name='tempest-TestMinimumBasicScenario-149674416',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fb173b085164da1b53412e2948fbdfe',ramdisk_id='',reservation_id='r-h3jercbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b593e02e-c19a-4aca-a243-304aa450f095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1412958496',owner_user_name='tempest-TestMinimumBasicScenario-1412958496-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:26:54Z,user_data=None,user_id='6722115f609e44ccad60d00c89a04ddb',uuid=fe1fe030-1a1e-49c9-97e8-6e9840d4908d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:26:56 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converting VIF {"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:26:56 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:26:b0,bridge_name='br-int',has_traffic_filtering=True,id=f496e45a-10e5-489c-bec3-3788ecad173c,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496e45a-10') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:26:56 user nova-compute[75571]: DEBUG nova.objects.instance [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'pci_devices' on Instance uuid fe1fe030-1a1e-49c9-97e8-6e9840d4908d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:26:56 user nova-compute[75571]: DEBUG nova.objects.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Object Instance<fe1fe030-1a1e-49c9-97e8-6e9840d4908d> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:26:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:26:56 user nova-compute[75571]:   <uuid>fe1fe030-1a1e-49c9-97e8-6e9840d4908d</uuid>
Nov 28 20:26:56 user nova-compute[75571]:   <name>instance-0000001e</name>
Nov 28 20:26:56 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:26:56 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:26:56 user nova-compute[75571]:   <metadata>
Nov 28 20:26:56 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:26:56 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:26:56 user nova-compute[75571]:       <nova:name>tempest-TestMinimumBasicScenario-server-1371290012</nova:name>
Nov 28 20:26:56 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:26:55</nova:creationTime>
Nov 28 20:26:56 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:26:56 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:26:56 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:26:56 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:26:56 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:26:56 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:26:56 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:26:56 user nova-compute[75571]:       <nova:owner>
Nov 28 20:26:56 user nova-compute[75571]:         <nova:user uuid="6722115f609e44ccad60d00c89a04ddb">tempest-TestMinimumBasicScenario-1412958496-project-member</nova:user>
Nov 28 20:26:56 user nova-compute[75571]:         <nova:project uuid="4fb173b085164da1b53412e2948fbdfe">tempest-TestMinimumBasicScenario-1412958496</nova:project>
Nov 28 20:26:56 user nova-compute[75571]:       </nova:owner>
Nov 28 20:26:56 user nova-compute[75571]:       <nova:root type="image" uuid="b593e02e-c19a-4aca-a243-304aa450f095"/>
Nov 28 20:26:56 user nova-compute[75571]:       <nova:ports>
Nov 28 20:26:56 user nova-compute[75571]:         <nova:port uuid="f496e45a-10e5-489c-bec3-3788ecad173c">
Nov 28 20:26:56 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 20:26:56 user nova-compute[75571]:         </nova:port>
Nov 28 20:26:56 user nova-compute[75571]:       </nova:ports>
Nov 28 20:26:56 user nova-compute[75571]:     </nova:instance>
Nov 28 20:26:56 user nova-compute[75571]:   </metadata>
Nov 28 20:26:56 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:26:56 user nova-compute[75571]:     <system>
Nov 28 20:26:56 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:26:56 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:26:56 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:26:56 user nova-compute[75571]:       <entry name="serial">fe1fe030-1a1e-49c9-97e8-6e9840d4908d</entry>
Nov 28 20:26:56 user nova-compute[75571]:       <entry name="uuid">fe1fe030-1a1e-49c9-97e8-6e9840d4908d</entry>
Nov 28 20:26:56 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:26:56 user nova-compute[75571]:     </system>
Nov 28 20:26:56 user nova-compute[75571]:   </sysinfo>
Nov 28 20:26:56 user nova-compute[75571]:   <os>
Nov 28 20:26:56 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:26:56 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:26:56 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:26:56 user nova-compute[75571]:   </os>
Nov 28 20:26:56 user nova-compute[75571]:   <features>
Nov 28 20:26:56 user nova-compute[75571]:     <acpi/>
Nov 28 20:26:56 user nova-compute[75571]:     <apic/>
Nov 28 20:26:56 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:26:56 user nova-compute[75571]:   </features>
Nov 28 20:26:56 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:26:56 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:26:56 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:26:56 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:26:56 user nova-compute[75571]:   </clock>
Nov 28 20:26:56 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:26:56 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:26:56 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:26:56 user nova-compute[75571]:   </cpu>
Nov 28 20:26:56 user nova-compute[75571]:   <devices>
Nov 28 20:26:56 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:26:56 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:26:56 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk"/>
Nov 28 20:26:56 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:26:56 user nova-compute[75571]:     </disk>
Nov 28 20:26:56 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:26:56 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:26:56 user nova-compute[75571]:       <source dev="/dev/sdb"/>
Nov 28 20:26:56 user nova-compute[75571]:       <target dev="vdb" bus="virtio"/>
Nov 28 20:26:56 user nova-compute[75571]:       <serial>a0e3c161-4228-4fc0-afb9-4de5e6eff658</serial>
Nov 28 20:26:56 user nova-compute[75571]:     </disk>
Nov 28 20:26:56 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:26:56 user nova-compute[75571]:       <mac address="fa:16:3e:87:26:b0"/>
Nov 28 20:26:56 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:26:56 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:26:56 user nova-compute[75571]:       <target dev="tapf496e45a-10"/>
Nov 28 20:26:56 user nova-compute[75571]:     </interface>
Nov 28 20:26:56 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:26:56 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/console.log" append="off"/>
Nov 28 20:26:56 user nova-compute[75571]:     </serial>
Nov 28 20:26:56 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:26:56 user nova-compute[75571]:     <video>
Nov 28 20:26:56 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:26:56 user nova-compute[75571]:     </video>
Nov 28 20:26:56 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:26:56 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:26:56 user nova-compute[75571]:     </rng>
Nov 28 20:26:56 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:26:56 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:26:56 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:26:56 user nova-compute[75571]:     </memballoon>
Nov 28 20:26:56 user nova-compute[75571]:   </devices>
Nov 28 20:26:56 user nova-compute[75571]: </domain>
Nov 28 20:26:56 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:26:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG nova.objects.instance [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'trusted_certs' on Instance uuid fe1fe030-1a1e-49c9-97e8-6e9840d4908d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG nova.objects.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Object Instance<fe1fe030-1a1e-49c9-97e8-6e9840d4908d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792 --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792 --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Cannot resize image /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG nova.objects.instance [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'migration_context' on Instance uuid fe1fe030-1a1e-49c9-97e8-6e9840d4908d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG nova.objects.base [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Object Instance<fe1fe030-1a1e-49c9-97e8-6e9840d4908d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1371290012',display_name='tempest-TestMinimumBasicScenario-server-1371290012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1371290012',id=30,image_ref='b593e02e-c19a-4aca-a243-304aa450f095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOwoMBR4cnJDatR+jEGAoE1++DF00x1L3tAHFh+2yRDgkQBY4IPkD5ygZ01Zy4k93InMKpeftJSTa2JLsnlu1pFbf2YVD4gZrxRSbUCScLWZKcNGiSbU5NXz8hrSEW1+w==',key_name='tempest-TestMinimumBasicScenario-149674416',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='4fb173b085164da1b53412e2948fbdfe',ramdisk_id='',reservation_id='r-h3jercbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b593e02e-c19a-4aca-a243-304aa450f095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1412958496',owner_user_name='tempest-TestMinimumBasicScenario-1412958496-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:26:54Z,user_data=None,user_id='6722115f609e44ccad60d00c89a04ddb',uuid=fe1fe030-1a1e-49c9-97e8-6e9840d4908d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converting VIF {"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:26:b0,bridge_name='br-int',has_traffic_filtering=True,id=f496e45a-10e5-489c-bec3-3788ecad173c,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496e45a-10') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG os_vif [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:26:b0,bridge_name='br-int',has_traffic_filtering=True,id=f496e45a-10e5-489c-bec3-3788ecad173c,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496e45a-10') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '236f8c4e-5b5a-5f70-b2f7-11c8b7eeefa6', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf496e45a-10, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf496e45a-10, col_values=(('qos', UUID('5bf13d1e-3fa4-4f04-beda-0f49cd41ba92')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf496e45a-10, col_values=(('external_ids', {'iface-id': 'f496e45a-10e5-489c-bec3-3788ecad173c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:26:b0', 'vm-uuid': 'fe1fe030-1a1e-49c9-97e8-6e9840d4908d'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:26:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:57 user nova-compute[75571]: INFO os_vif [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:26:b0,bridge_name='br-int',has_traffic_filtering=True,id=f496e45a-10e5-489c-bec3-3788ecad173c,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496e45a-10')
Nov 28 20:26:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:59 user nova-compute[75571]: DEBUG nova.compute.manager [req-b3df331e-8e0d-42d0-a722-56a37a076c65 req-423f0152-b12f-4810-985a-e1c2a3d33626 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received event network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:26:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b3df331e-8e0d-42d0-a722-56a37a076c65 req-423f0152-b12f-4810-985a-e1c2a3d33626 service nova] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:26:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b3df331e-8e0d-42d0-a722-56a37a076c65 req-423f0152-b12f-4810-985a-e1c2a3d33626 service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:26:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b3df331e-8e0d-42d0-a722-56a37a076c65 req-423f0152-b12f-4810-985a-e1c2a3d33626 service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:26:59 user nova-compute[75571]: DEBUG nova.compute.manager [req-b3df331e-8e0d-42d0-a722-56a37a076c65 req-423f0152-b12f-4810-985a-e1c2a3d33626 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] No waiting events found dispatching network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:26:59 user nova-compute[75571]: WARNING nova.compute.manager [req-b3df331e-8e0d-42d0-a722-56a37a076c65 req-423f0152-b12f-4810-985a-e1c2a3d33626 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received unexpected event network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c for instance with vm_state active and task_state reboot_started_hard.
Nov 28 20:26:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:26:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:01 user nova-compute[75571]: DEBUG nova.compute.manager [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:27:01 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Instance rebooted successfully.
Nov 28 20:27:01 user nova-compute[75571]: DEBUG nova.compute.manager [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:27:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.544s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:27:01 user nova-compute[75571]: DEBUG nova.compute.manager [req-6165bdc1-305b-4fa0-8c3d-1cf129ec5587 req-3303f1c8-12bc-477d-91e7-5ba711cf5964 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received event network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:27:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6165bdc1-305b-4fa0-8c3d-1cf129ec5587 req-3303f1c8-12bc-477d-91e7-5ba711cf5964 service nova] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:27:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6165bdc1-305b-4fa0-8c3d-1cf129ec5587 req-3303f1c8-12bc-477d-91e7-5ba711cf5964 service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:27:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6165bdc1-305b-4fa0-8c3d-1cf129ec5587 req-3303f1c8-12bc-477d-91e7-5ba711cf5964 service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:27:01 user nova-compute[75571]: DEBUG nova.compute.manager [req-6165bdc1-305b-4fa0-8c3d-1cf129ec5587 req-3303f1c8-12bc-477d-91e7-5ba711cf5964 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] No waiting events found dispatching network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:27:01 user nova-compute[75571]: WARNING nova.compute.manager [req-6165bdc1-305b-4fa0-8c3d-1cf129ec5587 req-3303f1c8-12bc-477d-91e7-5ba711cf5964 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received unexpected event network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c for instance with vm_state active and task_state None.
Nov 28 20:27:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:03 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:27:03 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:27:03 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 20:27:03 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] There are 0 instances to clean {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 20:27:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:27:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:07 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:27:07 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:27:07 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:27:07 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:27:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:08 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:27:08 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:27:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:27:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:27:08 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:27:08 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Updating instance_info_cache with network_info: [{"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:27:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:27:08 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:27:08 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:27:08 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:27:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:27:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:27:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:27:08 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:27:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:27:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:27:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:27:11 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:27:11 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:27:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8065MB free_disk=25.035446166992188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:27:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:27:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:27:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:27:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:27:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:27:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 313a065e-94f3-4435-97af-6a16de64ca7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:27:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 93392110-c3c3-44ff-a046-2f11608106c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:27:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:27:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e6f2a651-b10a-45f4-8f94-6a4426654a86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:27:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 636a8f00-7685-4c1b-9404-cf16359dd08a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:27:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:27:11 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:27:11 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing inventories for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 20:27:12 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating ProviderTree inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 20:27:12 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 20:27:12 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing aggregate associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, aggregates: None {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 20:27:12 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing trait associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 20:27:12 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:27:12 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:27:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:27:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.759s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:27:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:27:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:27:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:27:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75571) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 20:27:15 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:27:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:27:23 user nova-compute[75571]: INFO nova.compute.manager [None req-abb28987-4a7e-4e8d-80ea-848b75a36439 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Get console output
Nov 28 20:27:23 user nova-compute[75571]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 28 20:27:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid 3b0d4ca0-b527-4131-97ff-222cd9ced151 {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid 313a065e-94f3-4435-97af-6a16de64ca7c {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid 93392110-c3c3-44ff-a046-2f11608106c3 {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid fe1fe030-1a1e-49c9-97e8-6e9840d4908d {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid e6f2a651-b10a-45f4-8f94-6a4426654a86 {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "3b0d4ca0-b527-4131-97ff-222cd9ced151" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "313a065e-94f3-4435-97af-6a16de64ca7c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "93392110-c3c3-44ff-a046-2f11608106c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "93392110-c3c3-44ff-a046-2f11608106c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "e6f2a651-b10a-45f4-8f94-6a4426654a86" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "313a065e-94f3-4435-97af-6a16de64ca7c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "93392110-c3c3-44ff-a046-2f11608106c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:27:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:27:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:27:55 user nova-compute[75571]: INFO nova.compute.manager [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] instance snapshotting
Nov 28 20:27:55 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Beginning live snapshot process
Nov 28 20:27:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json -f qcow2 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json -f qcow2 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi2d22_tc/ffaecdb52e49490690557725c887bb1a.delta 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi2d22_tc/ffaecdb52e49490690557725c887bb1a.delta 1073741824" returned: 0 in 0.049s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:56 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 20:27:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:27:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:27:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75571) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 20:27:57 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 20:27:57 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:27:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi2d22_tc/ffaecdb52e49490690557725c887bb1a.delta /opt/stack/data/nova/instances/snapshots/tmpi2d22_tc/ffaecdb52e49490690557725c887bb1a {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:27:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi2d22_tc/ffaecdb52e49490690557725c887bb1a.delta /opt/stack/data/nova/instances/snapshots/tmpi2d22_tc/ffaecdb52e49490690557725c887bb1a" returned: 0 in 0.454s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:27:58 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Snapshot extracted, beginning image upload
Nov 28 20:28:00 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Snapshot image upload complete
Nov 28 20:28:00 user nova-compute[75571]: INFO nova.compute.manager [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Took 4.90 seconds to snapshot the instance on the hypervisor.
Nov 28 20:28:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:28:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:28:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:28:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:28:08 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 3b0d4ca0-b527-4131-97ff-222cd9ced151 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updating instance_info_cache with network_info: [{"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-3b0d4ca0-b527-4131-97ff-222cd9ced151" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:28:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:28:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:28:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:28:12 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:28:12 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:28:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8182MB free_disk=24.969867706298828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 313a065e-94f3-4435-97af-6a16de64ca7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 93392110-c3c3-44ff-a046-2f11608106c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e6f2a651-b10a-45f4-8f94-6a4426654a86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 636a8f00-7685-4c1b-9404-cf16359dd08a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:28:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:28:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-b5f8ca18-4dc5-4756-a529-979f39111271 req-193029dd-2698-42a1-a297-67f475573d29 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-changed-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:28:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-b5f8ca18-4dc5-4756-a529-979f39111271 req-193029dd-2698-42a1-a297-67f475573d29 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Refreshing instance network info cache due to event network-changed-23e84680-3abf-49b8-9750-1a0a3cd8b4cb. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:28:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b5f8ca18-4dc5-4756-a529-979f39111271 req-193029dd-2698-42a1-a297-67f475573d29 service nova] Acquiring lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:28:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b5f8ca18-4dc5-4756-a529-979f39111271 req-193029dd-2698-42a1-a297-67f475573d29 service nova] Acquired lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:28:17 user nova-compute[75571]: DEBUG nova.network.neutron [req-b5f8ca18-4dc5-4756-a529-979f39111271 req-193029dd-2698-42a1-a297-67f475573d29 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Refreshing network info cache for port 23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:28:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:28:17 user nova-compute[75571]: DEBUG nova.network.neutron [req-b5f8ca18-4dc5-4756-a529-979f39111271 req-193029dd-2698-42a1-a297-67f475573d29 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Updated VIF entry in instance network info cache for port 23e84680-3abf-49b8-9750-1a0a3cd8b4cb. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:28:17 user nova-compute[75571]: DEBUG nova.network.neutron [req-b5f8ca18-4dc5-4756-a529-979f39111271 req-193029dd-2698-42a1-a297-67f475573d29 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Updating instance_info_cache with network_info: [{"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:28:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b5f8ca18-4dc5-4756-a529-979f39111271 req-193029dd-2698-42a1-a297-67f475573d29 service nova] Releasing lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:28:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG nova.objects.instance [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'flavor' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:20 user nova-compute[75571]: INFO nova.compute.manager [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Attaching volume 564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 to /dev/vdb
Nov 28 20:28:20 user nova-compute[75571]: DEBUG os_brick.utils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e47f1f4-b015-4618-9158-05eb350845b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d409ca60-74fc-4858-8837-a8509cc6232e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9818c545-2567-4959-b896-e4dcf31ec7d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[114fbab5-e997-4058-a79b-e39b16cba8e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:28:20 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:28:20 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d99a33-63d1-4986-89ba-8e581950cdae]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG os_brick.utils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:28:20 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Updating existing volume attachment record: dfa1ea55-571e-47b4-8086-913765d9df13 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:28:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "93392110-c3c3-44ff-a046-2f11608106c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "93392110-c3c3-44ff-a046-2f11608106c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "93392110-c3c3-44ff-a046-2f11608106c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:24 user nova-compute[75571]: INFO nova.compute.manager [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Terminating instance
Nov 28 20:28:24 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG nova.compute.manager [req-e5bd3867-e36d-4eb5-9c4f-0438db9b1733 req-980197c9-3c00-446e-aa6d-681a100e8736 service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received event network-vif-unplugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e5bd3867-e36d-4eb5-9c4f-0438db9b1733 req-980197c9-3c00-446e-aa6d-681a100e8736 service nova] Acquiring lock "93392110-c3c3-44ff-a046-2f11608106c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e5bd3867-e36d-4eb5-9c4f-0438db9b1733 req-980197c9-3c00-446e-aa6d-681a100e8736 service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e5bd3867-e36d-4eb5-9c4f-0438db9b1733 req-980197c9-3c00-446e-aa6d-681a100e8736 service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG nova.compute.manager [req-e5bd3867-e36d-4eb5-9c4f-0438db9b1733 req-980197c9-3c00-446e-aa6d-681a100e8736 service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] No waiting events found dispatching network-vif-unplugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG nova.compute.manager [req-e5bd3867-e36d-4eb5-9c4f-0438db9b1733 req-980197c9-3c00-446e-aa6d-681a100e8736 service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received event network-vif-unplugged-45eabb36-f147-4900-b1dc-8b48e4141866 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:24 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Instance destroyed successfully.
Nov 28 20:28:24 user nova-compute[75571]: DEBUG nova.objects.instance [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lazy-loading 'resources' on Instance uuid 93392110-c3c3-44ff-a046-2f11608106c3 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1507891953',display_name='tempest-ServerActionsTestOtherA-server-1507891953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1507891953',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORLi9cBeKxwKZF2rkLIldgYbs91Se5SaovgAyOLlR1LAXkmJO85TwVIU01jacVfp8MokOP7s1wTMn2ItcMxD1z+b2y7pkirDp4yb/pOf68MDBPxyqhiOej8r0TiPf6AAg==',key_name='tempest-keypair-344088806',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:24:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a85595c9e1704e71903d25a65f5b696c',ramdisk_id='',reservation_id='r-0cgit2ur',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-390918760',owner_user_name='tempest-ServerActionsTestOtherA-390918760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098319d33fa243f5a044cf3f3c9f983c',uuid=93392110-c3c3-44ff-a046-2f11608106c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converting VIF {"id": "45eabb36-f147-4900-b1dc-8b48e4141866", "address": "fa:16:3e:a9:a2:04", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eabb36-f1", "ovs_interfaceid": "45eabb36-f147-4900-b1dc-8b48e4141866", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:a2:04,bridge_name='br-int',has_traffic_filtering=True,id=45eabb36-f147-4900-b1dc-8b48e4141866,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eabb36-f1') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG os_vif [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:a2:04,bridge_name='br-int',has_traffic_filtering=True,id=45eabb36-f147-4900-b1dc-8b48e4141866,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eabb36-f1') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45eabb36-f1, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76780923-092e-4b01-896c-cb30ca682080) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:28:24 user nova-compute[75571]: INFO os_vif [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:a2:04,bridge_name='br-int',has_traffic_filtering=True,id=45eabb36-f147-4900-b1dc-8b48e4141866,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eabb36-f1')
Nov 28 20:28:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqDoeFXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:28:24 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:28:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4fbb66-7b1a-4f94-b826-9c1c5bf94f10]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:28:24 user nova-compute[75571]: No targets found.
Nov 28 20:28:24 user nova-compute[75571]: iSNS:
Nov 28 20:28:24 user nova-compute[75571]: No targets found.
Nov 28 20:28:24 user nova-compute[75571]: STATIC:
Nov 28 20:28:24 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8
Nov 28 20:28:24 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:28:24 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:28:24 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658
Nov 28 20:28:24 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:28:24 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:28:24 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:28:24 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:28:24 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:28:24 user nova-compute[75571]: FIRMWARE:
Nov 28 20:28:24 user nova-compute[75571]: No targets found.
Nov 28 20:28:24 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:28:24 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:28:24 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32e5d9e-2050-4d95-8c0f-f2a6add095fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d861a2-51e4-43be-b3f3-ac518f35a961]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:28:24 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:28:24 user nova-compute[75571]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)
Nov 28 20:28:24 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:28:24 user nova-compute[75571]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 (non-flash)
Nov 28 20:28:24 user nova-compute[75571]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)
Nov 28 20:28:24 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77681dbd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8'): ({'sdg'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Removing single pathed devices sdg {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd60bf8-9e75-411a-a10a-76ac9fc1af24]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7f7f40-9517-43b9-9520-429a3fcfdc5b]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flushing IO for device /dev/sdg {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:28:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f350f4d0-819e-4ae1-bdf2-794f2f79cd77]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0640572c-d136-4f2e-b374-e6cab0475002]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] SCSI volumes sdg have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4adf19d9', '/dev/disk/by-id/scsi-1SCST_BIO4adf19d9-2582687a82fe4316', '/dev/disk/by-id/scsi-23235383236383761') {{(pid=86013) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad5c879-fb59-444f-9ede-99fd0c9ecde6]: (4, None) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1186a90-f347-4fda-8d9e-f6c76ec62d05]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce0326f-99bd-4ff8-be43-567d32757b46]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260]
Nov 28 20:28:25 user nova-compute[75571]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8, portal: 172.16.0.220,3260] successful.
Nov 28 20:28:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12945667-6430-4669-b816-315eefdfd6f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad338d37-c4ca-47c4-9a74-d778e523e01c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] <== disconnect_volume: return (285ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:28:25 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Deleting instance files /opt/stack/data/nova/instances/93392110-c3c3-44ff-a046-2f11608106c3_del
Nov 28 20:28:25 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Deletion of /opt/stack/data/nova/instances/93392110-c3c3-44ff-a046-2f11608106c3_del complete
Nov 28 20:28:25 user nova-compute[75571]: INFO nova.compute.manager [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 28 20:28:25 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:28:25 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:28:26 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:28:26 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Took 0.90 seconds to deallocate network for instance.
Nov 28 20:28:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-be9cf767-d43b-418c-b6c4-dba864424c6f req-0ccb3f68-9d27-4564-82d9-796ec4a6d427 service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received event network-vif-deleted-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:28:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-00d69df0-ebd5-4228-8cf6-68eba0f8b185 req-60164c25-d4d4-43d8-8d47-e9c7cdc1fe7b service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received event network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:28:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-00d69df0-ebd5-4228-8cf6-68eba0f8b185 req-60164c25-d4d4-43d8-8d47-e9c7cdc1fe7b service nova] Acquiring lock "93392110-c3c3-44ff-a046-2f11608106c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-00d69df0-ebd5-4228-8cf6-68eba0f8b185 req-60164c25-d4d4-43d8-8d47-e9c7cdc1fe7b service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-00d69df0-ebd5-4228-8cf6-68eba0f8b185 req-60164c25-d4d4-43d8-8d47-e9c7cdc1fe7b service nova] Lock "93392110-c3c3-44ff-a046-2f11608106c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-00d69df0-ebd5-4228-8cf6-68eba0f8b185 req-60164c25-d4d4-43d8-8d47-e9c7cdc1fe7b service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] No waiting events found dispatching network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:28:26 user nova-compute[75571]: WARNING nova.compute.manager [req-00d69df0-ebd5-4228-8cf6-68eba0f8b185 req-60164c25-d4d4-43d8-8d47-e9c7cdc1fe7b service nova] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Received unexpected event network-vif-plugged-45eabb36-f147-4900-b1dc-8b48e4141866 for instance with vm_state active and task_state deleting.
Nov 28 20:28:26 user nova-compute[75571]: INFO nova.compute.manager [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Took 0.76 seconds to detach 1 volumes for instance.
Nov 28 20:28:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Deleting volume: 12945667-6430-4669-b816-315eefdfd6f8 {{(pid=75571) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:27 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Deleted allocations for instance 93392110-c3c3-44ff-a046-2f11608106c3
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "93392110-c3c3-44ff-a046-2f11608106c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.342s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqZWzSIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:28:27 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:28:27 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:28:27 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[578a36eb-b1f8-4c8e-94cd-5de4ac99881b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:28:27 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fdcd6b-2ca4-49ec-9745-c5fb52d09056]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15] added
Nov 28 20:28:27 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d5394e-7b21-402c-9ebf-860983d2e5d3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[81edd84b-9cb3-49c1-9e69-c8b6b7733814]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqZWzSIU {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqZWzSIU" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ef274e-2a4a-4111-bd13-7c7d942ce214]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LqZWzSIU'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a86c6c-99c1-4a84-bb8a-274df39a1f9e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[db96ce01-5540-46f8-95b8-c6ac8044deb7]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:28:27 user nova-compute[75571]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)
Nov 28 20:28:27 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:28:27 user nova-compute[75571]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)
Nov 28 20:28:27 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcbfc6a-40a7-4a28-ab65-56813763ec41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260]
Nov 28 20:28:27 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260] successful.
Nov 28 20:28:27 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbf3bdc-1868-4413-9c80-0c530900c432]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e4788b-55ed-4c79-a24b-c4727d7f34fc]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:28:27 user nova-compute[75571]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)
Nov 28 20:28:27 user nova-compute[75571]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:28:27 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:28:27 user nova-compute[75571]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)
Nov 28 20:28:27 user nova-compute[75571]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:28:27 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89dcd3a-779d-46b8-b6b0-0cf62a2607f8]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:28:27 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:28:28 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:28:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqZWzSIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:28:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:28:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23763643762386239', 'path': '/dev/sdc'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:28:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763643762386239', 'path': '/dev/sdc'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:28:28 user nova-compute[75571]: DEBUG nova.objects.instance [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'flavor' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:28:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:28:29 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:28:29 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:28:29 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:28:29 user nova-compute[75571]:   <serial>564f704c-2c1e-45f6-b1a6-ed05d4ee8f15</serial>
Nov 28 20:28:29 user nova-compute[75571]: </disk>
Nov 28 20:28:29 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:28:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:28:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:28:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] No VIF found with MAC fa:16:3e:b0:53:96, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:28:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.031s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-90cb038c-7139-4085-8db9-9ae72a5db687 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-90cb038c-7139-4085-8db9-9ae72a5db687 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-90cb038c-7139-4085-8db9-9ae72a5db687 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:28:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-90cb038c-7139-4085-8db9-9ae72a5db687 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75571) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 20:28:30 user nova-compute[75571]: DEBUG nova.objects.instance [None req-90cb038c-7139-4085-8db9-9ae72a5db687 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'flavor' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:28:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:30 user nova-compute[75571]: DEBUG nova.compute.manager [req-92b0ac43-4902-4a93-af34-2fa4a979802d req-987e3cb0-cea7-4948-8a23-96713771a2e2 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-unplugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:28:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-92b0ac43-4902-4a93-af34-2fa4a979802d req-987e3cb0-cea7-4948-8a23-96713771a2e2 service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-92b0ac43-4902-4a93-af34-2fa4a979802d req-987e3cb0-cea7-4948-8a23-96713771a2e2 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-92b0ac43-4902-4a93-af34-2fa4a979802d req-987e3cb0-cea7-4948-8a23-96713771a2e2 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:30 user nova-compute[75571]: DEBUG nova.compute.manager [req-92b0ac43-4902-4a93-af34-2fa4a979802d req-987e3cb0-cea7-4948-8a23-96713771a2e2 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-unplugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:28:30 user nova-compute[75571]: WARNING nova.compute.manager [req-92b0ac43-4902-4a93-af34-2fa4a979802d req-987e3cb0-cea7-4948-8a23-96713771a2e2 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-unplugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state active and task_state powering-off.
Nov 28 20:28:31 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Instance destroyed successfully.
Nov 28 20:28:31 user nova-compute[75571]: DEBUG nova.compute.manager [None req-90cb038c-7139-4085-8db9-9ae72a5db687 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:28:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-90cb038c-7139-4085-8db9-9ae72a5db687 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.856s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:32 user nova-compute[75571]: DEBUG nova.compute.manager [req-0d162917-ea7b-4cd7-8c03-28fedc095859 req-5e531e43-5c36-4121-9c05-f3b4d91c23fb service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:28:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0d162917-ea7b-4cd7-8c03-28fedc095859 req-5e531e43-5c36-4121-9c05-f3b4d91c23fb service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0d162917-ea7b-4cd7-8c03-28fedc095859 req-5e531e43-5c36-4121-9c05-f3b4d91c23fb service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0d162917-ea7b-4cd7-8c03-28fedc095859 req-5e531e43-5c36-4121-9c05-f3b4d91c23fb service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:32 user nova-compute[75571]: DEBUG nova.compute.manager [req-0d162917-ea7b-4cd7-8c03-28fedc095859 req-5e531e43-5c36-4121-9c05-f3b4d91c23fb service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:28:32 user nova-compute[75571]: WARNING nova.compute.manager [req-0d162917-ea7b-4cd7-8c03-28fedc095859 req-5e531e43-5c36-4121-9c05-f3b4d91c23fb service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state stopped and task_state None.
Nov 28 20:28:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:39 user nova-compute[75571]: INFO nova.compute.manager [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Terminating instance
Nov 28 20:28:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-fa8cb00b-2230-457b-b734-cb4c04b41bce req-495a2679-aaf2-4181-acea-c58db372b78b service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Received event network-vif-unplugged-585ae662-b7ec-4f43-b5bd-5966bd473eb3 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fa8cb00b-2230-457b-b734-cb4c04b41bce req-495a2679-aaf2-4181-acea-c58db372b78b service nova] Acquiring lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fa8cb00b-2230-457b-b734-cb4c04b41bce req-495a2679-aaf2-4181-acea-c58db372b78b service nova] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fa8cb00b-2230-457b-b734-cb4c04b41bce req-495a2679-aaf2-4181-acea-c58db372b78b service nova] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-fa8cb00b-2230-457b-b734-cb4c04b41bce req-495a2679-aaf2-4181-acea-c58db372b78b service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] No waiting events found dispatching network-vif-unplugged-585ae662-b7ec-4f43-b5bd-5966bd473eb3 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-fa8cb00b-2230-457b-b734-cb4c04b41bce req-495a2679-aaf2-4181-acea-c58db372b78b service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Received event network-vif-unplugged-585ae662-b7ec-4f43-b5bd-5966bd473eb3 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:28:39 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Instance destroyed successfully.
Nov 28 20:28:39 user nova-compute[75571]: DEBUG nova.objects.instance [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lazy-loading 'resources' on Instance uuid 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-379425302',display_name='tempest-ServersNegativeTestJSON-server-379425302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-379425302',id=25,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:20:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc33efd1bb7f49679e13621e8dd3449a',ramdisk_id='',reservation_id='r-fv8h5a7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-146088746',owner_user_name='tempest-ServersNegativeTestJSON-146088746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:20:01Z,user_data=None,user_id='24aa8ca42c7342fa91f5eab19b6c0c9b',uuid=20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "address": "fa:16:3e:36:90:f8", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585ae662-b7", "ovs_interfaceid": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Converting VIF {"id": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "address": "fa:16:3e:36:90:f8", "network": {"id": "b45a9bdc-c522-435b-8532-28ec9780b49a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1027579120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc33efd1bb7f49679e13621e8dd3449a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585ae662-b7", "ovs_interfaceid": "585ae662-b7ec-4f43-b5bd-5966bd473eb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:90:f8,bridge_name='br-int',has_traffic_filtering=True,id=585ae662-b7ec-4f43-b5bd-5966bd473eb3,network=Network(b45a9bdc-c522-435b-8532-28ec9780b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap585ae662-b7') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG os_vif [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:90:f8,bridge_name='br-int',has_traffic_filtering=True,id=585ae662-b7ec-4f43-b5bd-5966bd473eb3,network=Network(b45a9bdc-c522-435b-8532-28ec9780b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap585ae662-b7') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap585ae662-b7, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8874c89b-c1cd-40cb-b0cb-57464d24e538) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:39 user nova-compute[75571]: INFO os_vif [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:90:f8,bridge_name='br-int',has_traffic_filtering=True,id=585ae662-b7ec-4f43-b5bd-5966bd473eb3,network=Network(b45a9bdc-c522-435b-8532-28ec9780b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap585ae662-b7')
Nov 28 20:28:39 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Deleting instance files /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6_del
Nov 28 20:28:39 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Deletion of /opt/stack/data/nova/instances/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6_del complete
Nov 28 20:28:39 user nova-compute[75571]: INFO nova.compute.manager [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 28 20:28:39 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:28:39 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:28:40 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:28:40 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Took 0.48 seconds to deallocate network for instance.
Nov 28 20:28:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-00629d50-59ac-4666-af5c-748ee1caf8bd req-b549d3b0-b127-4b41-b91f-adf52a9befa0 service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Received event network-vif-deleted-585ae662-b7ec-4f43-b5bd-5966bd473eb3 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:28:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:40 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:28:40 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:28:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:40 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Deleted allocations for instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6
Nov 28 20:28:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.824s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-5c3e5fd3-1860-475a-8ffe-b7434dbe7c21 req-ca281136-4e4e-4da3-ad7f-96c6a8c05517 service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Received event network-vif-plugged-585ae662-b7ec-4f43-b5bd-5966bd473eb3 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:28:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5c3e5fd3-1860-475a-8ffe-b7434dbe7c21 req-ca281136-4e4e-4da3-ad7f-96c6a8c05517 service nova] Acquiring lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5c3e5fd3-1860-475a-8ffe-b7434dbe7c21 req-ca281136-4e4e-4da3-ad7f-96c6a8c05517 service nova] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5c3e5fd3-1860-475a-8ffe-b7434dbe7c21 req-ca281136-4e4e-4da3-ad7f-96c6a8c05517 service nova] Lock "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:28:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-5c3e5fd3-1860-475a-8ffe-b7434dbe7c21 req-ca281136-4e4e-4da3-ad7f-96c6a8c05517 service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] No waiting events found dispatching network-vif-plugged-585ae662-b7ec-4f43-b5bd-5966bd473eb3 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:28:41 user nova-compute[75571]: WARNING nova.compute.manager [req-5c3e5fd3-1860-475a-8ffe-b7434dbe7c21 req-ca281136-4e4e-4da3-ad7f-96c6a8c05517 service nova] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Received unexpected event network-vif-plugged-585ae662-b7ec-4f43-b5bd-5966bd473eb3 for instance with vm_state deleted and task_state None.
Nov 28 20:28:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-a3126a91-0dd5-428c-b9b3-dc088e1ef1d6 req-3cb2fcae-74e7-463b-b1f9-b2c9c318ef3a service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received event network-changed-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:28:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-a3126a91-0dd5-428c-b9b3-dc088e1ef1d6 req-3cb2fcae-74e7-463b-b1f9-b2c9c318ef3a service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Refreshing instance network info cache due to event network-changed-f496e45a-10e5-489c-bec3-3788ecad173c. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:28:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a3126a91-0dd5-428c-b9b3-dc088e1ef1d6 req-3cb2fcae-74e7-463b-b1f9-b2c9c318ef3a service nova] Acquiring lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:28:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a3126a91-0dd5-428c-b9b3-dc088e1ef1d6 req-3cb2fcae-74e7-463b-b1f9-b2c9c318ef3a service nova] Acquired lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:28:45 user nova-compute[75571]: DEBUG nova.network.neutron [req-a3126a91-0dd5-428c-b9b3-dc088e1ef1d6 req-3cb2fcae-74e7-463b-b1f9-b2c9c318ef3a service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Refreshing network info cache for port f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-071d6680-c289-4d20-bb4b-a9cc4b64b0a7 req-6d1f0a07-012d-4b62-a278-a98750797cd5 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received event network-changed-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-071d6680-c289-4d20-bb4b-a9cc4b64b0a7 req-6d1f0a07-012d-4b62-a278-a98750797cd5 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Refreshing instance network info cache due to event network-changed-f496e45a-10e5-489c-bec3-3788ecad173c. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-071d6680-c289-4d20-bb4b-a9cc4b64b0a7 req-6d1f0a07-012d-4b62-a278-a98750797cd5 service nova] Acquiring lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:28:46 user nova-compute[75571]: INFO nova.compute.manager [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Detaching volume a0e3c161-4228-4fc0-afb9-4de5e6eff658
Nov 28 20:28:46 user nova-compute[75571]: INFO nova.virt.block_device [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Attempting to driver detach volume a0e3c161-4228-4fc0-afb9-4de5e6eff658 from mountpoint /dev/vdb
Nov 28 20:28:46 user nova-compute[75571]: DEBUG nova.network.neutron [req-a3126a91-0dd5-428c-b9b3-dc088e1ef1d6 req-3cb2fcae-74e7-463b-b1f9-b2c9c318ef3a service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Updated VIF entry in instance network info cache for port f496e45a-10e5-489c-bec3-3788ecad173c. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG nova.network.neutron [req-a3126a91-0dd5-428c-b9b3-dc088e1ef1d6 req-3cb2fcae-74e7-463b-b1f9-b2c9c318ef3a service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Updating instance_info_cache with network_info: [{"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Attempting to detach device vdb from instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:28:46 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:28:46 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:28:46 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:28:46 user nova-compute[75571]:   <serial>a0e3c161-4228-4fc0-afb9-4de5e6eff658</serial>
Nov 28 20:28:46 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 20:28:46 user nova-compute[75571]: </disk>
Nov 28 20:28:46 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:28:46 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Successfully detached device vdb from instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d from the persistent domain config.
Nov 28 20:28:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:28:46 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:28:46 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:28:46 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:28:46 user nova-compute[75571]:   <serial>a0e3c161-4228-4fc0-afb9-4de5e6eff658</serial>
Nov 28 20:28:46 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 20:28:46 user nova-compute[75571]: </disk>
Nov 28 20:28:46 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a3126a91-0dd5-428c-b9b3-dc088e1ef1d6 req-3cb2fcae-74e7-463b-b1f9-b2c9c318ef3a service nova] Releasing lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-071d6680-c289-4d20-bb4b-a9cc4b64b0a7 req-6d1f0a07-012d-4b62-a278-a98750797cd5 service nova] Acquired lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG nova.network.neutron [req-071d6680-c289-4d20-bb4b-a9cc4b64b0a7 req-6d1f0a07-012d-4b62-a278-a98750797cd5 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Refreshing network info cache for port f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG nova.network.neutron [req-071d6680-c289-4d20-bb4b-a9cc4b64b0a7 req-6d1f0a07-012d-4b62-a278-a98750797cd5 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Updated VIF entry in instance network info cache for port f496e45a-10e5-489c-bec3-3788ecad173c. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG nova.network.neutron [req-071d6680-c289-4d20-bb4b-a9cc4b64b0a7 req-6d1f0a07-012d-4b62-a278-a98750797cd5 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Updating instance_info_cache with network_info: [{"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:28:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-071d6680-c289-4d20-bb4b-a9cc4b64b0a7 req-6d1f0a07-012d-4b62-a278-a98750797cd5 service nova] Releasing lock "refresh_cache-fe1fe030-1a1e-49c9-97e8-6e9840d4908d" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:28:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:28:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:28:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:29:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:29:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:02 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:29:02 user nova-compute[75571]: INFO nova.compute.claims [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Claim successful on node user
Nov 28 20:29:02 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:29:02 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:29:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:29:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:29:02 user nova-compute[75571]: DEBUG nova.network.neutron [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:29:02 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:29:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:29:03 user nova-compute[75571]: INFO nova.virt.block_device [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Booting with volume-backed-image 77b9e284-7155-4207-b748-934c25ce18d0 at /dev/vda
Nov 28 20:29:03 user nova-compute[75571]: DEBUG nova.policy [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:29:03 user nova-compute[75571]: DEBUG nova.network.neutron [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Successfully created port: aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:29:04 user nova-compute[75571]: DEBUG nova.network.neutron [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Successfully updated port: aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:29:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "refresh_cache-5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:29:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquired lock "refresh_cache-5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:29:04 user nova-compute[75571]: DEBUG nova.network.neutron [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:29:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-77438c33-68ca-4f8e-ab16-05eca3cbcf23 req-8b0b02ff-a8b2-411a-82b6-2734b8a195a6 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received event network-changed-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:29:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-77438c33-68ca-4f8e-ab16-05eca3cbcf23 req-8b0b02ff-a8b2-411a-82b6-2734b8a195a6 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Refreshing instance network info cache due to event network-changed-aded16b1-1b80-4e18-ab01-ea36010cc6ff. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:29:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-77438c33-68ca-4f8e-ab16-05eca3cbcf23 req-8b0b02ff-a8b2-411a-82b6-2734b8a195a6 service nova] Acquiring lock "refresh_cache-5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:29:04 user nova-compute[75571]: DEBUG nova.network.neutron [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:29:04 user nova-compute[75571]: DEBUG nova.network.neutron [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Updating instance_info_cache with network_info: [{"id": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "address": "fa:16:3e:a1:20:af", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaded16b1-1b", "ovs_interfaceid": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:29:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Releasing lock "refresh_cache-5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:29:04 user nova-compute[75571]: DEBUG nova.compute.manager [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Instance network_info: |[{"id": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "address": "fa:16:3e:a1:20:af", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaded16b1-1b", "ovs_interfaceid": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:29:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-77438c33-68ca-4f8e-ab16-05eca3cbcf23 req-8b0b02ff-a8b2-411a-82b6-2734b8a195a6 service nova] Acquired lock "refresh_cache-5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:29:04 user nova-compute[75571]: DEBUG nova.network.neutron [req-77438c33-68ca-4f8e-ab16-05eca3cbcf23 req-8b0b02ff-a8b2-411a-82b6-2734b8a195a6 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Refreshing network info cache for port aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:29:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:29:05 user nova-compute[75571]: DEBUG nova.network.neutron [req-77438c33-68ca-4f8e-ab16-05eca3cbcf23 req-8b0b02ff-a8b2-411a-82b6-2734b8a195a6 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Updated VIF entry in instance network info cache for port aded16b1-1b80-4e18-ab01-ea36010cc6ff. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:29:05 user nova-compute[75571]: DEBUG nova.network.neutron [req-77438c33-68ca-4f8e-ab16-05eca3cbcf23 req-8b0b02ff-a8b2-411a-82b6-2734b8a195a6 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Updating instance_info_cache with network_info: [{"id": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "address": "fa:16:3e:a1:20:af", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaded16b1-1b", "ovs_interfaceid": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:29:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-77438c33-68ca-4f8e-ab16-05eca3cbcf23 req-8b0b02ff-a8b2-411a-82b6-2734b8a195a6 service nova] Releasing lock "refresh_cache-5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:29:06 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d is timed out.
Nov 28 20:29:06 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Successfully detached device vdb from instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d from the live domain config.
Nov 28 20:29:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:29:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UctVXQIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:29:06 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:29:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:29:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:29:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd6deb7-5075-45b8-a294-90e0c3d30ec9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:29:07 user nova-compute[75571]: No targets found.
Nov 28 20:29:07 user nova-compute[75571]: iSNS:
Nov 28 20:29:07 user nova-compute[75571]: No targets found.
Nov 28 20:29:07 user nova-compute[75571]: STATIC:
Nov 28 20:29:07 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658
Nov 28 20:29:07 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:29:07 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:29:07 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15
Nov 28 20:29:07 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:29:07 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:29:07 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:29:07 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:29:07 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:29:07 user nova-compute[75571]: FIRMWARE:
Nov 28 20:29:07 user nova-compute[75571]: No targets found.
Nov 28 20:29:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:29:07 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:29:07 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7a58af-9351-4f28-9909-9f6c44f6c1ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f096ba1-b963-44fb-984b-1807602171c4]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:29:07 user nova-compute[75571]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)
Nov 28 20:29:07 user nova-compute[75571]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:29:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:29:07 user nova-compute[75571]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 (non-flash)
Nov 28 20:29:07 user nova-compute[75571]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:29:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f776814f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdafc91-1c5f-436f-b1f8-2dfd309bd129]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cd5e2b-129a-4d68-bfbc-ffb88ad78f9e]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e51bfae-dec0-49e6-9243-82bb9d508201]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef33ce1c-8bb9-4d37-a12e-a10435aa1a3c]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8fee04-7687-4bbf-9ef3-5415f64dc26f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cbf4c7-e239-4457-a8a4-b6eb5d3970b0]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260]
Nov 28 20:29:07 user nova-compute[75571]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658, portal: 172.16.0.220,3260] successful.
Nov 28 20:29:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0e3c161-4228-4fc0-afb9-4de5e6eff658 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0a9d0d-d135-4a71-9b89-f63d169d3c95]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] <== disconnect_volume: return (306ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:29:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG nova.objects.instance [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'flavor' on Instance uuid fe1fe030-1a1e-49c9-97e8-6e9840d4908d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.680s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG os_brick.utils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1094ee-611b-47bb-853f-f3ae4c828a35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe9d7e9-ab31-44a4-ad6b-5877585de91c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29606e3-0d20-4aea-83b3-e62398713d13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b81bfc7-4f11-474e-ac7f-ab4afd4b7433]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:29:08 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:29:08 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdae349e-0f8a-47d8-a419-a1fd2796dae6]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG os_brick.utils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:29:08 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Updating existing volume attachment record: 521da25a-acc8-4ea5-a96c-7e0c2d5a9eaf {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:29:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:29:09 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:29:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:29:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:29:09 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:29:09 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Updating instance_info_cache with network_info: [{"id": "fc196680-3f93-4710-b508-752c9aa39f18", "address": "fa:16:3e:44:80:a9", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc196680-3f", "ovs_interfaceid": "fc196680-3f93-4710-b508-752c9aa39f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:29:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:29:09 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:29:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:29:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:29:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:29:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:12 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:29:12 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:29:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8588MB free_disk=24.995609283447266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 313a065e-94f3-4435-97af-6a16de64ca7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e6f2a651-b10a-45f4-8f94-6a4426654a86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 636a8f00-7685-4c1b-9404-cf16359dd08a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:29:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:29:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.compute.manager [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:29:15 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Creating image(s)
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Ensure instance console log exists: /opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Start _get_guest_xml network_info=[{"id": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "address": "fa:16:3e:a1:20:af", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaded16b1-1b", "ovs_interfaceid": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysmcSPHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867', 'attached_at': '', 'detached_at': '', 'volume_id': 'b15c2acb-f787-44e6-aecf-f23dac0b7b0e', 'serial': 'b15c2acb-f787-44e6-aecf-f23dac0b7b0e'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '521da25a-acc8-4ea5-a96c-7e0c2d5a9eaf', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:29:15 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:29:15 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysmcSPHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:29:15 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:29:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:29:15 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:29:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:29:15 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:29:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cb22c5-d19a-44c3-a785-386ab46f5524]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:29:15 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[324efd90-5b25-4ee6-a919-664b642678d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e] added
Nov 28 20:29:15 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3deaed4-25e2-4c92-a027-02fd993c3b03]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e56a7a-fe25-4539-94bd-a68a77fce648]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:15 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ysmcSPHv {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ysmcSPHv" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3782c7db-0764-453c-a7b6-f208340e32a6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ysmcSPHv'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3f6aef-e503-498b-b6e4-5eb31ab3362e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b654ada0-1752-4c32-9da8-a7f3f2b9f877]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:29:16 user nova-compute[75571]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:29:16 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:29:16 user nova-compute[75571]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:29:16 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e600920b-08d1-4077-9333-5384d7b981b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e, portal: 172.16.0.220,3260]
Nov 28 20:29:16 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e, portal: 172.16.0.220,3260] successful.
Nov 28 20:29:16 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc03938d-e708-443e-90a7-5af2fb9757f4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4f43e5-4f69-457a-bb68-1bfb4c357271]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:29:16 user nova-compute[75571]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:29:16 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:29:16 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:29:16 user nova-compute[75571]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:29:16 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:29:16 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa276c21-fd8d-459d-8a94-0ae4c884baf3]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:29:16 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysmcSPHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23334343830366537', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334343830366537', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:29:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-773181244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-773181244',id=33,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd03007966db45f48ae6c22ed6f84871',ramdisk_id='',reservation_id='r-0z1j7bj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-468878',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-468878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:29:03Z,user_data=None,user_id='007af37c9a914cd5863e486c041701be',uuid=5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "address": "fa:16:3e:a1:20:af", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaded16b1-1b", "ovs_interfaceid": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converting VIF {"id": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "address": "fa:16:3e:a1:20:af", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaded16b1-1b", "ovs_interfaceid": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:20:af,bridge_name='br-int',has_traffic_filtering=True,id=aded16b1-1b80-4e18-ab01-ea36010cc6ff,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaded16b1-1b') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG nova.objects.instance [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'pci_devices' on Instance uuid 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:29:17 user nova-compute[75571]:   <uuid>5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867</uuid>
Nov 28 20:29:17 user nova-compute[75571]:   <name>instance-00000021</name>
Nov 28 20:29:17 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:29:17 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:29:17 user nova-compute[75571]:   <metadata>
Nov 28 20:29:17 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:29:17 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:29:17 user nova-compute[75571]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-773181244</nova:name>
Nov 28 20:29:17 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:29:15</nova:creationTime>
Nov 28 20:29:17 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:29:17 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:29:17 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:29:17 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:29:17 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:29:17 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:29:17 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:29:17 user nova-compute[75571]:       <nova:owner>
Nov 28 20:29:17 user nova-compute[75571]:         <nova:user uuid="007af37c9a914cd5863e486c041701be">tempest-ServerBootFromVolumeStableRescueTest-468878-project-member</nova:user>
Nov 28 20:29:17 user nova-compute[75571]:         <nova:project uuid="dd03007966db45f48ae6c22ed6f84871">tempest-ServerBootFromVolumeStableRescueTest-468878</nova:project>
Nov 28 20:29:17 user nova-compute[75571]:       </nova:owner>
Nov 28 20:29:17 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:29:17 user nova-compute[75571]:       <nova:ports>
Nov 28 20:29:17 user nova-compute[75571]:         <nova:port uuid="aded16b1-1b80-4e18-ab01-ea36010cc6ff">
Nov 28 20:29:17 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 20:29:17 user nova-compute[75571]:         </nova:port>
Nov 28 20:29:17 user nova-compute[75571]:       </nova:ports>
Nov 28 20:29:17 user nova-compute[75571]:     </nova:instance>
Nov 28 20:29:17 user nova-compute[75571]:   </metadata>
Nov 28 20:29:17 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:29:17 user nova-compute[75571]:     <system>
Nov 28 20:29:17 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:29:17 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:29:17 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:29:17 user nova-compute[75571]:       <entry name="serial">5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867</entry>
Nov 28 20:29:17 user nova-compute[75571]:       <entry name="uuid">5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867</entry>
Nov 28 20:29:17 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:29:17 user nova-compute[75571]:     </system>
Nov 28 20:29:17 user nova-compute[75571]:   </sysinfo>
Nov 28 20:29:17 user nova-compute[75571]:   <os>
Nov 28 20:29:17 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:29:17 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:29:17 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:29:17 user nova-compute[75571]:   </os>
Nov 28 20:29:17 user nova-compute[75571]:   <features>
Nov 28 20:29:17 user nova-compute[75571]:     <acpi/>
Nov 28 20:29:17 user nova-compute[75571]:     <apic/>
Nov 28 20:29:17 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:29:17 user nova-compute[75571]:   </features>
Nov 28 20:29:17 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:29:17 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:29:17 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:29:17 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:29:17 user nova-compute[75571]:   </clock>
Nov 28 20:29:17 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:29:17 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:29:17 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:29:17 user nova-compute[75571]:   </cpu>
Nov 28 20:29:17 user nova-compute[75571]:   <devices>
Nov 28 20:29:17 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:29:17 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:29:17 user nova-compute[75571]:       <source dev="/dev/sdb"/>
Nov 28 20:29:17 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:29:17 user nova-compute[75571]:       <serial>b15c2acb-f787-44e6-aecf-f23dac0b7b0e</serial>
Nov 28 20:29:17 user nova-compute[75571]:     </disk>
Nov 28 20:29:17 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:29:17 user nova-compute[75571]:       <mac address="fa:16:3e:a1:20:af"/>
Nov 28 20:29:17 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:29:17 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:29:17 user nova-compute[75571]:       <target dev="tapaded16b1-1b"/>
Nov 28 20:29:17 user nova-compute[75571]:     </interface>
Nov 28 20:29:17 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:29:17 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/console.log" append="off"/>
Nov 28 20:29:17 user nova-compute[75571]:     </serial>
Nov 28 20:29:17 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:29:17 user nova-compute[75571]:     <video>
Nov 28 20:29:17 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:29:17 user nova-compute[75571]:     </video>
Nov 28 20:29:17 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:29:17 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:29:17 user nova-compute[75571]:     </rng>
Nov 28 20:29:17 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:29:17 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:29:17 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:29:17 user nova-compute[75571]:     </memballoon>
Nov 28 20:29:17 user nova-compute[75571]:   </devices>
Nov 28 20:29:17 user nova-compute[75571]: </domain>
Nov 28 20:29:17 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:29:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-773181244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-773181244',id=33,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd03007966db45f48ae6c22ed6f84871',ramdisk_id='',reservation_id='r-0z1j7bj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-468878',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-468878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:29:03Z,user_data=None,user_id='007af37c9a914cd5863e486c041701be',uuid=5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "address": "fa:16:3e:a1:20:af", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaded16b1-1b", "ovs_interfaceid": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converting VIF {"id": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "address": "fa:16:3e:a1:20:af", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaded16b1-1b", "ovs_interfaceid": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:20:af,bridge_name='br-int',has_traffic_filtering=True,id=aded16b1-1b80-4e18-ab01-ea36010cc6ff,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaded16b1-1b') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG os_vif [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:20:af,bridge_name='br-int',has_traffic_filtering=True,id=aded16b1-1b80-4e18-ab01-ea36010cc6ff,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaded16b1-1b') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '095bc71a-6c85-5810-abd8-48270eb79e32', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaded16b1-1b, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaded16b1-1b, col_values=(('qos', UUID('6cc95fc2-9d0a-4f7f-b73d-2aad0aa6c205')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaded16b1-1b, col_values=(('external_ids', {'iface-id': 'aded16b1-1b80-4e18-ab01-ea36010cc6ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:20:af', 'vm-uuid': '5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:17 user nova-compute[75571]: INFO os_vif [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:20:af,bridge_name='br-int',has_traffic_filtering=True,id=aded16b1-1b80-4e18-ab01-ea36010cc6ff,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaded16b1-1b')
Nov 28 20:29:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] No VIF found with MAC fa:16:3e:a1:20:af, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "3b0d4ca0-b527-4131-97ff-222cd9ced151" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "3b0d4ca0-b527-4131-97ff-222cd9ced151-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:17 user nova-compute[75571]: INFO nova.compute.manager [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Terminating instance
Nov 28 20:29:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:29:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-1552b159-b3e9-437a-88c6-6aab41cbdbf9 req-f327e3e0-b344-4d3c-8531-4ee64cec2fb9 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Received event network-vif-unplugged-ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:29:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1552b159-b3e9-437a-88c6-6aab41cbdbf9 req-f327e3e0-b344-4d3c-8531-4ee64cec2fb9 service nova] Acquiring lock "3b0d4ca0-b527-4131-97ff-222cd9ced151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1552b159-b3e9-437a-88c6-6aab41cbdbf9 req-f327e3e0-b344-4d3c-8531-4ee64cec2fb9 service nova] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1552b159-b3e9-437a-88c6-6aab41cbdbf9 req-f327e3e0-b344-4d3c-8531-4ee64cec2fb9 service nova] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-1552b159-b3e9-437a-88c6-6aab41cbdbf9 req-f327e3e0-b344-4d3c-8531-4ee64cec2fb9 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] No waiting events found dispatching network-vif-unplugged-ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:29:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-1552b159-b3e9-437a-88c6-6aab41cbdbf9 req-f327e3e0-b344-4d3c-8531-4ee64cec2fb9 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Received event network-vif-unplugged-ba72889d-186f-4e53-893b-5509d0882a6a for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:29:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:19 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Instance destroyed successfully.
Nov 28 20:29:19 user nova-compute[75571]: DEBUG nova.objects.instance [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lazy-loading 'resources' on Instance uuid 3b0d4ca0-b527-4131-97ff-222cd9ced151 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-397313947',display_name='tempest-ServerActionsTestOtherA-server-397313947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-397313947',id=2,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORLi9cBeKxwKZF2rkLIldgYbs91Se5SaovgAyOLlR1LAXkmJO85TwVIU01jacVfp8MokOP7s1wTMn2ItcMxD1z+b2y7pkirDp4yb/pOf68MDBPxyqhiOej8r0TiPf6AAg==',key_name='tempest-keypair-344088806',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a85595c9e1704e71903d25a65f5b696c',ramdisk_id='',reservation_id='r-0pkty9pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-390918760',owner_user_name='tempest-ServerActionsTestOtherA-390918760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098319d33fa243f5a044cf3f3c9f983c',uuid=3b0d4ca0-b527-4131-97ff-222cd9ced151,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converting VIF {"id": "ba72889d-186f-4e53-893b-5509d0882a6a", "address": "fa:16:3e:e8:68:9b", "network": {"id": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-984729900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85595c9e1704e71903d25a65f5b696c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba72889d-18", "ovs_interfaceid": "ba72889d-186f-4e53-893b-5509d0882a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=ba72889d-186f-4e53-893b-5509d0882a6a,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba72889d-18') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG os_vif [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=ba72889d-186f-4e53-893b-5509d0882a6a,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba72889d-18') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba72889d-18, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f8e4631-edd3-4b06-910b-58eaf0b3ba4c) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:19 user nova-compute[75571]: INFO os_vif [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=ba72889d-186f-4e53-893b-5509d0882a6a,network=Network(8cc12ce3-3e35-45e4-bbee-b5d66b5b468b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba72889d-18')
Nov 28 20:29:19 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Deleting instance files /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151_del
Nov 28 20:29:19 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Deletion of /opt/stack/data/nova/instances/3b0d4ca0-b527-4131-97ff-222cd9ced151_del complete
Nov 28 20:29:19 user nova-compute[75571]: INFO nova.compute.manager [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 28 20:29:19 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-5600cb98-ebb7-4fa7-bef7-1d27bc87225e req-2747c810-13ca-42a6-b61a-bf71bf2ebc96 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5600cb98-ebb7-4fa7-bef7-1d27bc87225e req-2747c810-13ca-42a6-b61a-bf71bf2ebc96 service nova] Acquiring lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5600cb98-ebb7-4fa7-bef7-1d27bc87225e req-2747c810-13ca-42a6-b61a-bf71bf2ebc96 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5600cb98-ebb7-4fa7-bef7-1d27bc87225e req-2747c810-13ca-42a6-b61a-bf71bf2ebc96 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-5600cb98-ebb7-4fa7-bef7-1d27bc87225e req-2747c810-13ca-42a6-b61a-bf71bf2ebc96 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] No waiting events found dispatching network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:29:19 user nova-compute[75571]: WARNING nova.compute.manager [req-5600cb98-ebb7-4fa7-bef7-1d27bc87225e req-2747c810-13ca-42a6-b61a-bf71bf2ebc96 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received unexpected event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance with vm_state building and task_state spawning.
Nov 28 20:29:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:29:19 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Took 0.75 seconds to deallocate network for instance.
Nov 28 20:29:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:20 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:29:20 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:29:20 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:29:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:20 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Deleted allocations for instance 3b0d4ca0-b527-4131-97ff-222cd9ced151
Nov 28 20:29:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-5e42164c-2032-471e-82e0-028e0328e065 req-4497e4c6-bf70-4086-844e-6eda225c3db4 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Received event network-vif-plugged-ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:29:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5e42164c-2032-471e-82e0-028e0328e065 req-4497e4c6-bf70-4086-844e-6eda225c3db4 service nova] Acquiring lock "3b0d4ca0-b527-4131-97ff-222cd9ced151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5e42164c-2032-471e-82e0-028e0328e065 req-4497e4c6-bf70-4086-844e-6eda225c3db4 service nova] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5e42164c-2032-471e-82e0-028e0328e065 req-4497e4c6-bf70-4086-844e-6eda225c3db4 service nova] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-5e42164c-2032-471e-82e0-028e0328e065 req-4497e4c6-bf70-4086-844e-6eda225c3db4 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] No waiting events found dispatching network-vif-plugged-ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:29:20 user nova-compute[75571]: WARNING nova.compute.manager [req-5e42164c-2032-471e-82e0-028e0328e065 req-4497e4c6-bf70-4086-844e-6eda225c3db4 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Received unexpected event network-vif-plugged-ba72889d-186f-4e53-893b-5509d0882a6a for instance with vm_state deleted and task_state None.
Nov 28 20:29:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "3b0d4ca0-b527-4131-97ff-222cd9ced151" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.476s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:21 user nova-compute[75571]: DEBUG nova.compute.manager [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:29:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:29:21 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Instance spawned successfully.
Nov 28 20:29:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:29:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:29:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:29:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:29:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:29:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:29:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:29:21 user nova-compute[75571]: INFO nova.compute.manager [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 28 20:29:21 user nova-compute[75571]: DEBUG nova.compute.manager [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:29:21 user nova-compute[75571]: INFO nova.compute.manager [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Took 18.78 seconds to build instance.
Nov 28 20:29:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-99d6e7dc-3cf0-487d-9e30-7bef3102d47a req-79ab3137-19fd-48b6-8df4-59d4ef123b83 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:29:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-99d6e7dc-3cf0-487d-9e30-7bef3102d47a req-79ab3137-19fd-48b6-8df4-59d4ef123b83 service nova] Acquiring lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-99d6e7dc-3cf0-487d-9e30-7bef3102d47a req-79ab3137-19fd-48b6-8df4-59d4ef123b83 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-99d6e7dc-3cf0-487d-9e30-7bef3102d47a req-79ab3137-19fd-48b6-8df4-59d4ef123b83 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-99d6e7dc-3cf0-487d-9e30-7bef3102d47a req-79ab3137-19fd-48b6-8df4-59d4ef123b83 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] No waiting events found dispatching network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:29:21 user nova-compute[75571]: WARNING nova.compute.manager [req-99d6e7dc-3cf0-487d-9e30-7bef3102d47a req-79ab3137-19fd-48b6-8df4-59d4ef123b83 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received unexpected event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance with vm_state active and task_state None.
Nov 28 20:29:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-99d6e7dc-3cf0-487d-9e30-7bef3102d47a req-79ab3137-19fd-48b6-8df4-59d4ef123b83 service nova] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Received event network-vif-deleted-ba72889d-186f-4e53-893b-5509d0882a6a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:29:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.881s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:40 user nova-compute[75571]: INFO nova.compute.manager [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Terminating instance
Nov 28 20:29:40 user nova-compute[75571]: DEBUG nova.compute.manager [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:29:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-1b0a139a-aa45-40e3-8853-dac69434d552 req-34aa59d1-4526-4c9a-bb26-9c4739ad1fb1 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received event network-vif-unplugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:29:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1b0a139a-aa45-40e3-8853-dac69434d552 req-34aa59d1-4526-4c9a-bb26-9c4739ad1fb1 service nova] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1b0a139a-aa45-40e3-8853-dac69434d552 req-34aa59d1-4526-4c9a-bb26-9c4739ad1fb1 service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1b0a139a-aa45-40e3-8853-dac69434d552 req-34aa59d1-4526-4c9a-bb26-9c4739ad1fb1 service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-1b0a139a-aa45-40e3-8853-dac69434d552 req-34aa59d1-4526-4c9a-bb26-9c4739ad1fb1 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] No waiting events found dispatching network-vif-unplugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:29:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-1b0a139a-aa45-40e3-8853-dac69434d552 req-34aa59d1-4526-4c9a-bb26-9c4739ad1fb1 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received event network-vif-unplugged-f496e45a-10e5-489c-bec3-3788ecad173c for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:41 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Instance destroyed successfully.
Nov 28 20:29:41 user nova-compute[75571]: DEBUG nova.objects.instance [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'resources' on Instance uuid fe1fe030-1a1e-49c9-97e8-6e9840d4908d {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1371290012',display_name='tempest-TestMinimumBasicScenario-server-1371290012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1371290012',id=30,image_ref='b593e02e-c19a-4aca-a243-304aa450f095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOwoMBR4cnJDatR+jEGAoE1++DF00x1L3tAHFh+2yRDgkQBY4IPkD5ygZ01Zy4k93InMKpeftJSTa2JLsnlu1pFbf2YVD4gZrxRSbUCScLWZKcNGiSbU5NXz8hrSEW1+w==',key_name='tempest-TestMinimumBasicScenario-149674416',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fb173b085164da1b53412e2948fbdfe',ramdisk_id='',reservation_id='r-h3jercbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b593e02e-c19a-4aca-a243-304aa450f095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1412958496',owner_user_name='tempest-TestMinimumBasicScenario-1412958496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:27:01Z,user_data=None,user_id='6722115f609e44ccad60d00c89a04ddb',uuid=fe1fe030-1a1e-49c9-97e8-6e9840d4908d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converting VIF {"id": "f496e45a-10e5-489c-bec3-3788ecad173c", "address": "fa:16:3e:87:26:b0", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf496e45a-10", "ovs_interfaceid": "f496e45a-10e5-489c-bec3-3788ecad173c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:26:b0,bridge_name='br-int',has_traffic_filtering=True,id=f496e45a-10e5-489c-bec3-3788ecad173c,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496e45a-10') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG os_vif [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:26:b0,bridge_name='br-int',has_traffic_filtering=True,id=f496e45a-10e5-489c-bec3-3788ecad173c,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496e45a-10') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf496e45a-10, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bf13d1e-3fa4-4f04-beda-0f49cd41ba92) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:41 user nova-compute[75571]: INFO os_vif [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:26:b0,bridge_name='br-int',has_traffic_filtering=True,id=f496e45a-10e5-489c-bec3-3788ecad173c,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf496e45a-10')
Nov 28 20:29:41 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Deleting instance files /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d_del
Nov 28 20:29:41 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Deletion of /opt/stack/data/nova/instances/fe1fe030-1a1e-49c9-97e8-6e9840d4908d_del complete
Nov 28 20:29:41 user nova-compute[75571]: INFO nova.compute.manager [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 20:29:41 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-b6dbcf83-a693-469e-b92c-eddc92e42642 req-3146b67d-c5da-485e-982b-5d6e8d7a7e58 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received event network-vif-deleted-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:29:41 user nova-compute[75571]: INFO nova.compute.manager [req-b6dbcf83-a693-469e-b92c-eddc92e42642 req-3146b67d-c5da-485e-982b-5d6e8d7a7e58 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Neutron deleted interface f496e45a-10e5-489c-bec3-3788ecad173c; detaching it from the instance and deleting it from the info cache
Nov 28 20:29:41 user nova-compute[75571]: DEBUG nova.network.neutron [req-b6dbcf83-a693-469e-b92c-eddc92e42642 req-3146b67d-c5da-485e-982b-5d6e8d7a7e58 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:29:41 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Took 0.47 seconds to deallocate network for instance.
Nov 28 20:29:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-b6dbcf83-a693-469e-b92c-eddc92e42642 req-3146b67d-c5da-485e-982b-5d6e8d7a7e58 service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Detach interface failed, port_id=f496e45a-10e5-489c-bec3-3788ecad173c, reason: Instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:41 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:42 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Deleted allocations for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d
Nov 28 20:29:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "93698818-d7ba-4f25-a341-30e5390a829e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "93698818-d7ba-4f25-a341-30e5390a829e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.796s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:29:42 user nova-compute[75571]: INFO nova.compute.claims [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Claim successful on node user
Nov 28 20:29:42 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:29:42 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:29:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-37fcfac9-5518-49df-9f71-9d4a7bb62ef6 req-7db98625-f1de-4ab3-9e9d-5f64ed3c561e service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received event network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-37fcfac9-5518-49df-9f71-9d4a7bb62ef6 req-7db98625-f1de-4ab3-9e9d-5f64ed3c561e service nova] Acquiring lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-37fcfac9-5518-49df-9f71-9d4a7bb62ef6 req-7db98625-f1de-4ab3-9e9d-5f64ed3c561e service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-37fcfac9-5518-49df-9f71-9d4a7bb62ef6 req-7db98625-f1de-4ab3-9e9d-5f64ed3c561e service nova] Lock "fe1fe030-1a1e-49c9-97e8-6e9840d4908d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-37fcfac9-5518-49df-9f71-9d4a7bb62ef6 req-7db98625-f1de-4ab3-9e9d-5f64ed3c561e service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] No waiting events found dispatching network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:29:42 user nova-compute[75571]: WARNING nova.compute.manager [req-37fcfac9-5518-49df-9f71-9d4a7bb62ef6 req-7db98625-f1de-4ab3-9e9d-5f64ed3c561e service nova] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Received unexpected event network-vif-plugged-f496e45a-10e5-489c-bec3-3788ecad173c for instance with vm_state deleted and task_state None.
Nov 28 20:29:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG nova.policy [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:29:42 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Creating image(s)
Nov 28 20:29:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "/opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "/opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "/opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.177s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk 1073741824" returned: 0 in 0.048s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG nova.network.neutron [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Successfully created port: 4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Cannot resize image /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Ensure instance console log exists: /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.network.neutron [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Successfully updated port: 4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquired lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.network.neutron [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.compute.manager [req-ba708d38-7241-479e-8aee-accfb2ef2239 req-2e0388a0-26ab-4734-bfb2-0854e3fea6c6 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received event network-changed-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.compute.manager [req-ba708d38-7241-479e-8aee-accfb2ef2239 req-2e0388a0-26ab-4734-bfb2-0854e3fea6c6 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Refreshing instance network info cache due to event network-changed-4258c97f-0a86-4cf4-ade0-831330204fc8. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ba708d38-7241-479e-8aee-accfb2ef2239 req-2e0388a0-26ab-4734-bfb2-0854e3fea6c6 service nova] Acquiring lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.network.neutron [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.network.neutron [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Updating instance_info_cache with network_info: [{"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Releasing lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Instance network_info: |[{"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ba708d38-7241-479e-8aee-accfb2ef2239 req-2e0388a0-26ab-4734-bfb2-0854e3fea6c6 service nova] Acquired lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.network.neutron [req-ba708d38-7241-479e-8aee-accfb2ef2239 req-2e0388a0-26ab-4734-bfb2-0854e3fea6c6 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Refreshing network info cache for port 4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Start _get_guest_xml network_info=[{"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:29:44 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:29:44 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-795547296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-795547296',id=34,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7x8JUic8LMH/YQT25GlcwZE6wPOyKaJyvQnNWy47RBRoT/KqLjj+kPL9TeFksxFwkD4J4kVT9wKi4NGz2C12ZF7NEOueU54TasYfa+Zk7dRiUyC3kjH5YG1VpVp8Hw2w==',key_name='tempest-keypair-958726701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='292cfffce13446c8963785adfb4b9d22',ramdisk_id='',reservation_id='r-pmqejehf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1442792072',owner_user_name='tempest-AttachVolumeShelveTestJSON-1442792072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:29:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e21afd3261f4b1a87f7cbb4348fc9fe',uuid=93698818-d7ba-4f25-a341-30e5390a829e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converting VIF {"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:11:32,bridge_name='br-int',has_traffic_filtering=True,id=4258c97f-0a86-4cf4-ade0-831330204fc8,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4258c97f-0a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.objects.instance [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'pci_devices' on Instance uuid 93698818-d7ba-4f25-a341-30e5390a829e {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:29:44 user nova-compute[75571]:   <uuid>93698818-d7ba-4f25-a341-30e5390a829e</uuid>
Nov 28 20:29:44 user nova-compute[75571]:   <name>instance-00000022</name>
Nov 28 20:29:44 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:29:44 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:29:44 user nova-compute[75571]:   <metadata>
Nov 28 20:29:44 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:29:44 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:29:44 user nova-compute[75571]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-795547296</nova:name>
Nov 28 20:29:44 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:29:44</nova:creationTime>
Nov 28 20:29:44 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:29:44 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:29:44 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:29:44 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:29:44 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:29:44 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:29:44 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:29:44 user nova-compute[75571]:       <nova:owner>
Nov 28 20:29:44 user nova-compute[75571]:         <nova:user uuid="9e21afd3261f4b1a87f7cbb4348fc9fe">tempest-AttachVolumeShelveTestJSON-1442792072-project-member</nova:user>
Nov 28 20:29:44 user nova-compute[75571]:         <nova:project uuid="292cfffce13446c8963785adfb4b9d22">tempest-AttachVolumeShelveTestJSON-1442792072</nova:project>
Nov 28 20:29:44 user nova-compute[75571]:       </nova:owner>
Nov 28 20:29:44 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:29:44 user nova-compute[75571]:       <nova:ports>
Nov 28 20:29:44 user nova-compute[75571]:         <nova:port uuid="4258c97f-0a86-4cf4-ade0-831330204fc8">
Nov 28 20:29:44 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 20:29:44 user nova-compute[75571]:         </nova:port>
Nov 28 20:29:44 user nova-compute[75571]:       </nova:ports>
Nov 28 20:29:44 user nova-compute[75571]:     </nova:instance>
Nov 28 20:29:44 user nova-compute[75571]:   </metadata>
Nov 28 20:29:44 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:29:44 user nova-compute[75571]:     <system>
Nov 28 20:29:44 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:29:44 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:29:44 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:29:44 user nova-compute[75571]:       <entry name="serial">93698818-d7ba-4f25-a341-30e5390a829e</entry>
Nov 28 20:29:44 user nova-compute[75571]:       <entry name="uuid">93698818-d7ba-4f25-a341-30e5390a829e</entry>
Nov 28 20:29:44 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:29:44 user nova-compute[75571]:     </system>
Nov 28 20:29:44 user nova-compute[75571]:   </sysinfo>
Nov 28 20:29:44 user nova-compute[75571]:   <os>
Nov 28 20:29:44 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:29:44 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:29:44 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:29:44 user nova-compute[75571]:   </os>
Nov 28 20:29:44 user nova-compute[75571]:   <features>
Nov 28 20:29:44 user nova-compute[75571]:     <acpi/>
Nov 28 20:29:44 user nova-compute[75571]:     <apic/>
Nov 28 20:29:44 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:29:44 user nova-compute[75571]:   </features>
Nov 28 20:29:44 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:29:44 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:29:44 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:29:44 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:29:44 user nova-compute[75571]:   </clock>
Nov 28 20:29:44 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:29:44 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:29:44 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:29:44 user nova-compute[75571]:   </cpu>
Nov 28 20:29:44 user nova-compute[75571]:   <devices>
Nov 28 20:29:44 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:29:44 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:29:44 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk"/>
Nov 28 20:29:44 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:29:44 user nova-compute[75571]:     </disk>
Nov 28 20:29:44 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:29:44 user nova-compute[75571]:       <mac address="fa:16:3e:a0:11:32"/>
Nov 28 20:29:44 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:29:44 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:29:44 user nova-compute[75571]:       <target dev="tap4258c97f-0a"/>
Nov 28 20:29:44 user nova-compute[75571]:     </interface>
Nov 28 20:29:44 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:29:44 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/console.log" append="off"/>
Nov 28 20:29:44 user nova-compute[75571]:     </serial>
Nov 28 20:29:44 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:29:44 user nova-compute[75571]:     <video>
Nov 28 20:29:44 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:29:44 user nova-compute[75571]:     </video>
Nov 28 20:29:44 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:29:44 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:29:44 user nova-compute[75571]:     </rng>
Nov 28 20:29:44 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:29:44 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:29:44 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:29:44 user nova-compute[75571]:     </memballoon>
Nov 28 20:29:44 user nova-compute[75571]:   </devices>
Nov 28 20:29:44 user nova-compute[75571]: </domain>
Nov 28 20:29:44 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-795547296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-795547296',id=34,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7x8JUic8LMH/YQT25GlcwZE6wPOyKaJyvQnNWy47RBRoT/KqLjj+kPL9TeFksxFwkD4J4kVT9wKi4NGz2C12ZF7NEOueU54TasYfa+Zk7dRiUyC3kjH5YG1VpVp8Hw2w==',key_name='tempest-keypair-958726701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='292cfffce13446c8963785adfb4b9d22',ramdisk_id='',reservation_id='r-pmqejehf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1442792072',owner_user_name='tempest-AttachVolumeShelveTestJSON-1442792072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:29:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e21afd3261f4b1a87f7cbb4348fc9fe',uuid=93698818-d7ba-4f25-a341-30e5390a829e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converting VIF {"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:11:32,bridge_name='br-int',has_traffic_filtering=True,id=4258c97f-0a86-4cf4-ade0-831330204fc8,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4258c97f-0a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG os_vif [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:11:32,bridge_name='br-int',has_traffic_filtering=True,id=4258c97f-0a86-4cf4-ade0-831330204fc8,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4258c97f-0a') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aaa68caf-0e5b-5d50-9dc5-d5659f8e7ee8', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4258c97f-0a, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4258c97f-0a, col_values=(('qos', UUID('8575c818-1ea5-432d-8e76-2c1e8f377176')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4258c97f-0a, col_values=(('external_ids', {'iface-id': '4258c97f-0a86-4cf4-ade0-831330204fc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:11:32', 'vm-uuid': '93698818-d7ba-4f25-a341-30e5390a829e'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:29:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:44 user nova-compute[75571]: INFO os_vif [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:11:32,bridge_name='br-int',has_traffic_filtering=True,id=4258c97f-0a86-4cf4-ade0-831330204fc8,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4258c97f-0a')
Nov 28 20:29:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:29:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] No VIF found with MAC fa:16:3e:a0:11:32, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:29:45 user nova-compute[75571]: DEBUG nova.network.neutron [req-ba708d38-7241-479e-8aee-accfb2ef2239 req-2e0388a0-26ab-4734-bfb2-0854e3fea6c6 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Updated VIF entry in instance network info cache for port 4258c97f-0a86-4cf4-ade0-831330204fc8. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:29:45 user nova-compute[75571]: DEBUG nova.network.neutron [req-ba708d38-7241-479e-8aee-accfb2ef2239 req-2e0388a0-26ab-4734-bfb2-0854e3fea6c6 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Updating instance_info_cache with network_info: [{"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:29:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ba708d38-7241-479e-8aee-accfb2ef2239 req-2e0388a0-26ab-4734-bfb2-0854e3fea6c6 service nova] Releasing lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:29:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-52cbf22e-b0a5-458c-a947-79d30b838ef5 req-292b02bc-cc4a-47c4-8908-10f159e30f62 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received event network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:29:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-52cbf22e-b0a5-458c-a947-79d30b838ef5 req-292b02bc-cc4a-47c4-8908-10f159e30f62 service nova] Acquiring lock "93698818-d7ba-4f25-a341-30e5390a829e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-52cbf22e-b0a5-458c-a947-79d30b838ef5 req-292b02bc-cc4a-47c4-8908-10f159e30f62 service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-52cbf22e-b0a5-458c-a947-79d30b838ef5 req-292b02bc-cc4a-47c4-8908-10f159e30f62 service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-52cbf22e-b0a5-458c-a947-79d30b838ef5 req-292b02bc-cc4a-47c4-8908-10f159e30f62 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] No waiting events found dispatching network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:29:46 user nova-compute[75571]: WARNING nova.compute.manager [req-52cbf22e-b0a5-458c-a947-79d30b838ef5 req-292b02bc-cc4a-47c4-8908-10f159e30f62 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received unexpected event network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 for instance with vm_state building and task_state spawning.
Nov 28 20:29:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:48 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:29:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:29:48 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Instance spawned successfully.
Nov 28 20:29:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:29:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:29:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:29:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:29:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:29:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:29:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:29:48 user nova-compute[75571]: INFO nova.compute.manager [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 28 20:29:48 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:29:48 user nova-compute[75571]: INFO nova.compute.manager [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Took 6.40 seconds to build instance.
Nov 28 20:29:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "93698818-d7ba-4f25-a341-30e5390a829e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.501s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-f60f5a0e-56fb-4964-a558-d1d29c8a2599 req-271f44a0-4ae7-422f-99b6-1b8c1b0564e7 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received event network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:29:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f60f5a0e-56fb-4964-a558-d1d29c8a2599 req-271f44a0-4ae7-422f-99b6-1b8c1b0564e7 service nova] Acquiring lock "93698818-d7ba-4f25-a341-30e5390a829e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:29:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f60f5a0e-56fb-4964-a558-d1d29c8a2599 req-271f44a0-4ae7-422f-99b6-1b8c1b0564e7 service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:29:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f60f5a0e-56fb-4964-a558-d1d29c8a2599 req-271f44a0-4ae7-422f-99b6-1b8c1b0564e7 service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:29:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-f60f5a0e-56fb-4964-a558-d1d29c8a2599 req-271f44a0-4ae7-422f-99b6-1b8c1b0564e7 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] No waiting events found dispatching network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:29:48 user nova-compute[75571]: WARNING nova.compute.manager [req-f60f5a0e-56fb-4964-a558-d1d29c8a2599 req-271f44a0-4ae7-422f-99b6-1b8c1b0564e7 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received unexpected event network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 for instance with vm_state active and task_state None.
Nov 28 20:29:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:29:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:29:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:29:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:29:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:29:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:30:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:30:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:10 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:30:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:11 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:30:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:30:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:30:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:30:11 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:30:11 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Updating instance_info_cache with network_info: [{"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:30:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:30:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:30:11 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:30:11 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:30:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:30:14 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:30:14 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:30:14 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8465MB free_disk=25.020118713378906GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 313a065e-94f3-4435-97af-6a16de64ca7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e6f2a651-b10a-45f4-8f94-6a4426654a86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 636a8f00-7685-4c1b-9404-cf16359dd08a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 93698818-d7ba-4f25-a341-30e5390a829e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.366s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "29443f30-6d05-4148-9185-a31f78b4a68f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:30:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:18 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:30:18 user nova-compute[75571]: INFO nova.compute.claims [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Claim successful on node user
Nov 28 20:30:19 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG nova.compute.manager [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG nova.compute.manager [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG nova.network.neutron [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:30:19 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:30:19 user nova-compute[75571]: DEBUG nova.compute.manager [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG nova.policy [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG nova.compute.manager [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:30:19 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Creating image(s)
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "/opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "/opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "/opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "def2369e-4d57-482b-aef9-dab7c3a7cb84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.198s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:30:19 user nova-compute[75571]: INFO nova.compute.claims [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Claim successful on node user
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.253s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk 1073741824" returned: 0 in 0.056s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Successfully created port: ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Successfully updated port: ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.898s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.534s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Cannot resize image /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Ensure instance console log exists: /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-59fbcfb9-4a68-4552-b98f-e4cf3290b204 req-817dfd00-9f29-4f6d-82e0-4410633383fc service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-changed-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-59fbcfb9-4a68-4552-b98f-e4cf3290b204 req-817dfd00-9f29-4f6d-82e0-4410633383fc service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Refreshing instance network info cache due to event network-changed-ff9deee0-3665-4ae4-864e-1da67b83ccd2. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-59fbcfb9-4a68-4552-b98f-e4cf3290b204 req-817dfd00-9f29-4f6d-82e0-4410633383fc service nova] Acquiring lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-59fbcfb9-4a68-4552-b98f-e4cf3290b204 req-817dfd00-9f29-4f6d-82e0-4410633383fc service nova] Acquired lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.network.neutron [req-59fbcfb9-4a68-4552-b98f-e4cf3290b204 req-817dfd00-9f29-4f6d-82e0-4410633383fc service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Refreshing network info cache for port ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:30:20 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.network.neutron [req-59fbcfb9-4a68-4552-b98f-e4cf3290b204 req-817dfd00-9f29-4f6d-82e0-4410633383fc service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.policy [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:30:20 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Creating image(s)
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "/opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "/opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "/opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.network.neutron [req-59fbcfb9-4a68-4552-b98f-e4cf3290b204 req-817dfd00-9f29-4f6d-82e0-4410633383fc service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-59fbcfb9-4a68-4552-b98f-e4cf3290b204 req-817dfd00-9f29-4f6d-82e0-4410633383fc service nova] Releasing lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquired lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:30:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.network.neutron [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.objects.instance [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'flavor' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquired lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.objects.instance [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'info_cache' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.186s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.objects.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Object Instance<636a8f00-7685-4c1b-9404-cf16359dd08a> lazy-loaded attributes: flavor,info_cache {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk 1073741824" returned: 0 in 0.055s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Successfully created port: ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.network.neutron [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Updating instance_info_cache with network_info: [{"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Releasing lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.compute.manager [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Instance network_info: |[{"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Start _get_guest_xml network_info=[{"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.196s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Checking if we can resize image /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:21 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:30:21 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2038069783',display_name='tempest-ServerRescueNegativeTestJSON-server-2038069783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2038069783',id=35,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d72dc075421c4e7eb9c0ff2bf1641a92',ramdisk_id='',reservation_id='r-vjt3ghjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-506941201',owner_user_name='tempest-ServerRescueNegativeTestJSON-506941201-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:30:19Z,user_data=None,user_id='634123644067453a92f4d43da0b28fa7',uuid=29443f30-6d05-4148-9185-a31f78b4a68f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converting VIF {"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:2e:94,bridge_name='br-int',has_traffic_filtering=True,id=ff9deee0-3665-4ae4-864e-1da67b83ccd2,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9deee0-36') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.objects.instance [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'pci_devices' on Instance uuid 29443f30-6d05-4148-9185-a31f78b4a68f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:30:21 user nova-compute[75571]:   <uuid>29443f30-6d05-4148-9185-a31f78b4a68f</uuid>
Nov 28 20:30:21 user nova-compute[75571]:   <name>instance-00000023</name>
Nov 28 20:30:21 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:30:21 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:30:21 user nova-compute[75571]:   <metadata>
Nov 28 20:30:21 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:30:21 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:30:21 user nova-compute[75571]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2038069783</nova:name>
Nov 28 20:30:21 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:30:21</nova:creationTime>
Nov 28 20:30:21 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:30:21 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:30:21 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:30:21 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:30:21 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:30:21 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:30:21 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:30:21 user nova-compute[75571]:       <nova:owner>
Nov 28 20:30:21 user nova-compute[75571]:         <nova:user uuid="634123644067453a92f4d43da0b28fa7">tempest-ServerRescueNegativeTestJSON-506941201-project-member</nova:user>
Nov 28 20:30:21 user nova-compute[75571]:         <nova:project uuid="d72dc075421c4e7eb9c0ff2bf1641a92">tempest-ServerRescueNegativeTestJSON-506941201</nova:project>
Nov 28 20:30:21 user nova-compute[75571]:       </nova:owner>
Nov 28 20:30:21 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:30:21 user nova-compute[75571]:       <nova:ports>
Nov 28 20:30:21 user nova-compute[75571]:         <nova:port uuid="ff9deee0-3665-4ae4-864e-1da67b83ccd2">
Nov 28 20:30:21 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:30:21 user nova-compute[75571]:         </nova:port>
Nov 28 20:30:21 user nova-compute[75571]:       </nova:ports>
Nov 28 20:30:21 user nova-compute[75571]:     </nova:instance>
Nov 28 20:30:21 user nova-compute[75571]:   </metadata>
Nov 28 20:30:21 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:30:21 user nova-compute[75571]:     <system>
Nov 28 20:30:21 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:30:21 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:30:21 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:30:21 user nova-compute[75571]:       <entry name="serial">29443f30-6d05-4148-9185-a31f78b4a68f</entry>
Nov 28 20:30:21 user nova-compute[75571]:       <entry name="uuid">29443f30-6d05-4148-9185-a31f78b4a68f</entry>
Nov 28 20:30:21 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:30:21 user nova-compute[75571]:     </system>
Nov 28 20:30:21 user nova-compute[75571]:   </sysinfo>
Nov 28 20:30:21 user nova-compute[75571]:   <os>
Nov 28 20:30:21 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:30:21 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:30:21 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:30:21 user nova-compute[75571]:   </os>
Nov 28 20:30:21 user nova-compute[75571]:   <features>
Nov 28 20:30:21 user nova-compute[75571]:     <acpi/>
Nov 28 20:30:21 user nova-compute[75571]:     <apic/>
Nov 28 20:30:21 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:30:21 user nova-compute[75571]:   </features>
Nov 28 20:30:21 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:30:21 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:30:21 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:30:21 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:30:21 user nova-compute[75571]:   </clock>
Nov 28 20:30:21 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:30:21 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:30:21 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:30:21 user nova-compute[75571]:   </cpu>
Nov 28 20:30:21 user nova-compute[75571]:   <devices>
Nov 28 20:30:21 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:30:21 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:30:21 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk"/>
Nov 28 20:30:21 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:30:21 user nova-compute[75571]:     </disk>
Nov 28 20:30:21 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:30:21 user nova-compute[75571]:       <mac address="fa:16:3e:cf:2e:94"/>
Nov 28 20:30:21 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:30:21 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:30:21 user nova-compute[75571]:       <target dev="tapff9deee0-36"/>
Nov 28 20:30:21 user nova-compute[75571]:     </interface>
Nov 28 20:30:21 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:30:21 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/console.log" append="off"/>
Nov 28 20:30:21 user nova-compute[75571]:     </serial>
Nov 28 20:30:21 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:30:21 user nova-compute[75571]:     <video>
Nov 28 20:30:21 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:30:21 user nova-compute[75571]:     </video>
Nov 28 20:30:21 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:30:21 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:30:21 user nova-compute[75571]:     </rng>
Nov 28 20:30:21 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:30:21 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:30:21 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:30:21 user nova-compute[75571]:     </memballoon>
Nov 28 20:30:21 user nova-compute[75571]:   </devices>
Nov 28 20:30:21 user nova-compute[75571]: </domain>
Nov 28 20:30:21 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2038069783',display_name='tempest-ServerRescueNegativeTestJSON-server-2038069783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2038069783',id=35,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d72dc075421c4e7eb9c0ff2bf1641a92',ramdisk_id='',reservation_id='r-vjt3ghjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-506941201',owner_user_name='tempest-ServerRescueNegativeTestJSON-506941201-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:30:19Z,user_data=None,user_id='634123644067453a92f4d43da0b28fa7',uuid=29443f30-6d05-4148-9185-a31f78b4a68f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converting VIF {"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:2e:94,bridge_name='br-int',has_traffic_filtering=True,id=ff9deee0-3665-4ae4-864e-1da67b83ccd2,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9deee0-36') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG os_vif [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:2e:94,bridge_name='br-int',has_traffic_filtering=True,id=ff9deee0-3665-4ae4-864e-1da67b83ccd2,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9deee0-36') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8084016-f6ff-5f63-a717-0866b7d4dfd5', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff9deee0-36, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff9deee0-36, col_values=(('qos', UUID('4dd01b02-3a14-4a92-bf49-c8a44448ed5d')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff9deee0-36, col_values=(('external_ids', {'iface-id': 'ff9deee0-3665-4ae4-864e-1da67b83ccd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:2e:94', 'vm-uuid': '29443f30-6d05-4148-9185-a31f78b4a68f'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Cannot resize image /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Ensure instance console log exists: /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:21 user nova-compute[75571]: INFO os_vif [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:2e:94,bridge_name='br-int',has_traffic_filtering=True,id=ff9deee0-3665-4ae4-864e-1da67b83ccd2,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9deee0-36')
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:30:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No VIF found with MAC fa:16:3e:cf:2e:94, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Updating instance_info_cache with network_info: [{"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Releasing lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Successfully updated port: ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquired lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:30:22 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Instance destroyed successfully.
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.objects.instance [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'resources' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.objects.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Object Instance<636a8f00-7685-4c1b-9404-cf16359dd08a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:26:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-599565098',display_name='tempest-AttachVolumeTestJSON-server-599565098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-599565098',id=32,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3XwsjqlLJC+H5W8+kliU+liUVxsmiGlirVM1hB3Xvq2TAMksvSwoTdDPqxJDLnMy/epsE7znWc/yERpeFqyVO3BqmqmL465Jtof0GPEtberkTrsDvfTVDra8QzBI4sQ==',key_name='tempest-keypair-1076987994',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:26:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a7d489de217644979c5888d97158a800',ramdisk_id='',reservation_id='r-8ipm7twc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-187128538',owner_user_name='tempest-AttachVolumeTestJSON-187128538-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d653c87883374ab59768ce28b2b9adfc',uuid=636a8f00-7685-4c1b-9404-cf16359dd08a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converting VIF {"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_vif [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.compute.manager [req-e689fecd-3e81-490f-8b06-5601ca85256e req-4801d6ec-49cb-4595-88dc-64ace36f1651 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received event network-changed-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.compute.manager [req-e689fecd-3e81-490f-8b06-5601ca85256e req-4801d6ec-49cb-4595-88dc-64ace36f1651 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Refreshing instance network info cache due to event network-changed-ca71d400-500b-4d9b-9141-67afb25ac98d. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e689fecd-3e81-490f-8b06-5601ca85256e req-4801d6ec-49cb-4595-88dc-64ace36f1651 service nova] Acquiring lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23e84680-3a, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae511e09-44ca-441e-9432-af0398c3be2b) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:22 user nova-compute[75571]: INFO os_vif [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a')
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqZWzSIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:30:22 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3eaa90-fbf6-4690-bb4a-ebc417bf7ea8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:30:22 user nova-compute[75571]: No targets found.
Nov 28 20:30:22 user nova-compute[75571]: iSNS:
Nov 28 20:30:22 user nova-compute[75571]: No targets found.
Nov 28 20:30:22 user nova-compute[75571]: STATIC:
Nov 28 20:30:22 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e
Nov 28 20:30:22 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:30:22 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:30:22 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15
Nov 28 20:30:22 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:30:22 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:30:22 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:30:22 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:30:22 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:30:22 user nova-compute[75571]: FIRMWARE:
Nov 28 20:30:22 user nova-compute[75571]: No targets found.
Nov 28 20:30:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:30:22 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:30:22 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f321dae9-7b91-4b4b-84e7-6434e5d3000b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c571cbad-f369-45f5-b9ac-14d1f9fc405a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:30:22 user nova-compute[75571]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:30:22 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:30:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:30:22 user nova-compute[75571]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:30:22 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:30:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77682d95a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15'): ({'sdc'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Removing single pathed devices sdc {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b470e7-f592-420d-8173-57bd483b0e2f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f958a8f8-f167-44d8-ac72-b098a9b3edae]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flushing IO for device /dev/sdc {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5465629-c511-4886-bf6c-6fcac42dd029]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1416d14d-48f0-4f39-82ca-0efd6c1fa853]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7a28e0-1d3c-4c15-ba17-11bbbd6cb9cc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.network.neutron [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Updating instance_info_cache with network_info: [{"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Releasing lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Instance network_info: |[{"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e689fecd-3e81-490f-8b06-5601ca85256e req-4801d6ec-49cb-4595-88dc-64ace36f1651 service nova] Acquired lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.network.neutron [req-e689fecd-3e81-490f-8b06-5601ca85256e req-4801d6ec-49cb-4595-88dc-64ace36f1651 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Refreshing network info cache for port ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Start _get_guest_xml network_info=[{"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[389245b6-e6d5-4a60-b971-104d57d88d78]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260]
Nov 28 20:30:22 user nova-compute[75571]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260] successful.
Nov 28 20:30:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:30:22 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d7a70c-f645-4900-b5a8-166d2572b3d1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] <== disconnect_volume: return (311ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:30:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1606228576',display_name='tempest-ServerRescueNegativeTestJSON-server-1606228576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1606228576',id=36,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d72dc075421c4e7eb9c0ff2bf1641a92',ramdisk_id='',reservation_id='r-s7rpgbpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-506941201',owner_user_name='tempest-ServerRescueNegativeTestJSON-506941201-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:30:21Z,user_data=None,user_id='634123644067453a92f4d43da0b28fa7',uuid=def2369e-4d57-482b-aef9-dab7c3a7cb84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converting VIF {"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:61:d8,bridge_name='br-int',has_traffic_filtering=True,id=ca71d400-500b-4d9b-9141-67afb25ac98d,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca71d400-50') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.objects.instance [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'pci_devices' on Instance uuid def2369e-4d57-482b-aef9-dab7c3a7cb84 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Start _get_guest_xml network_info=[{"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqZWzSIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '636a8f00-7685-4c1b-9404-cf16359dd08a', 'attached_at': '', 'detached_at': '', 'volume_id': '564f704c-2c1e-45f6-b1a6-ed05d4ee8f15', 'serial': '564f704c-2c1e-45f6-b1a6-ed05d4ee8f15'}, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'dfa1ea55-571e-47b4-8086-913765d9df13', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.objects.instance [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'numa_topology' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:30:22 user nova-compute[75571]:   <uuid>def2369e-4d57-482b-aef9-dab7c3a7cb84</uuid>
Nov 28 20:30:22 user nova-compute[75571]:   <name>instance-00000024</name>
Nov 28 20:30:22 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:30:22 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:30:22 user nova-compute[75571]:   <metadata>
Nov 28 20:30:22 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:30:22 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:30:22 user nova-compute[75571]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1606228576</nova:name>
Nov 28 20:30:22 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:30:22</nova:creationTime>
Nov 28 20:30:22 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:30:22 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:30:22 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:30:22 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:30:22 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:30:22 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:30:22 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:30:22 user nova-compute[75571]:       <nova:owner>
Nov 28 20:30:22 user nova-compute[75571]:         <nova:user uuid="634123644067453a92f4d43da0b28fa7">tempest-ServerRescueNegativeTestJSON-506941201-project-member</nova:user>
Nov 28 20:30:22 user nova-compute[75571]:         <nova:project uuid="d72dc075421c4e7eb9c0ff2bf1641a92">tempest-ServerRescueNegativeTestJSON-506941201</nova:project>
Nov 28 20:30:22 user nova-compute[75571]:       </nova:owner>
Nov 28 20:30:22 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:30:22 user nova-compute[75571]:       <nova:ports>
Nov 28 20:30:22 user nova-compute[75571]:         <nova:port uuid="ca71d400-500b-4d9b-9141-67afb25ac98d">
Nov 28 20:30:22 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 20:30:22 user nova-compute[75571]:         </nova:port>
Nov 28 20:30:22 user nova-compute[75571]:       </nova:ports>
Nov 28 20:30:22 user nova-compute[75571]:     </nova:instance>
Nov 28 20:30:22 user nova-compute[75571]:   </metadata>
Nov 28 20:30:22 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:30:22 user nova-compute[75571]:     <system>
Nov 28 20:30:22 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:30:22 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:30:22 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:30:22 user nova-compute[75571]:       <entry name="serial">def2369e-4d57-482b-aef9-dab7c3a7cb84</entry>
Nov 28 20:30:22 user nova-compute[75571]:       <entry name="uuid">def2369e-4d57-482b-aef9-dab7c3a7cb84</entry>
Nov 28 20:30:22 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:30:22 user nova-compute[75571]:     </system>
Nov 28 20:30:22 user nova-compute[75571]:   </sysinfo>
Nov 28 20:30:22 user nova-compute[75571]:   <os>
Nov 28 20:30:22 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:30:22 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:30:22 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:30:22 user nova-compute[75571]:   </os>
Nov 28 20:30:22 user nova-compute[75571]:   <features>
Nov 28 20:30:22 user nova-compute[75571]:     <acpi/>
Nov 28 20:30:22 user nova-compute[75571]:     <apic/>
Nov 28 20:30:22 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:30:22 user nova-compute[75571]:   </features>
Nov 28 20:30:22 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:30:22 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:30:22 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:30:22 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:30:22 user nova-compute[75571]:   </clock>
Nov 28 20:30:22 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:30:22 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:30:22 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:30:22 user nova-compute[75571]:   </cpu>
Nov 28 20:30:22 user nova-compute[75571]:   <devices>
Nov 28 20:30:22 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:30:22 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:30:22 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk"/>
Nov 28 20:30:22 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:30:22 user nova-compute[75571]:     </disk>
Nov 28 20:30:22 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:30:22 user nova-compute[75571]:       <mac address="fa:16:3e:4c:61:d8"/>
Nov 28 20:30:22 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:30:22 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:30:22 user nova-compute[75571]:       <target dev="tapca71d400-50"/>
Nov 28 20:30:22 user nova-compute[75571]:     </interface>
Nov 28 20:30:22 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:30:22 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/console.log" append="off"/>
Nov 28 20:30:22 user nova-compute[75571]:     </serial>
Nov 28 20:30:22 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:30:22 user nova-compute[75571]:     <video>
Nov 28 20:30:22 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:30:22 user nova-compute[75571]:     </video>
Nov 28 20:30:22 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:30:22 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:30:22 user nova-compute[75571]:     </rng>
Nov 28 20:30:22 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:30:22 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:30:22 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:30:22 user nova-compute[75571]:     </memballoon>
Nov 28 20:30:22 user nova-compute[75571]:   </devices>
Nov 28 20:30:22 user nova-compute[75571]: </domain>
Nov 28 20:30:22 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:30:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1606228576',display_name='tempest-ServerRescueNegativeTestJSON-server-1606228576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1606228576',id=36,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d72dc075421c4e7eb9c0ff2bf1641a92',ramdisk_id='',reservation_id='r-s7rpgbpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-506941201',owner_user_name='tempest-ServerRescueNegativeTestJSON-506941201-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:30:21Z,user_data=None,user_id='634123644067453a92f4d43da0b28fa7',uuid=def2369e-4d57-482b-aef9-dab7c3a7cb84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converting VIF {"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:61:d8,bridge_name='br-int',has_traffic_filtering=True,id=ca71d400-500b-4d9b-9141-67afb25ac98d,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca71d400-50') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_vif [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:61:d8,bridge_name='br-int',has_traffic_filtering=True,id=ca71d400-500b-4d9b-9141-67afb25ac98d,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca71d400-50') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09326f46-4753-5e98-8834-2a5554efffba', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.objects.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Object Instance<636a8f00-7685-4c1b-9404-cf16359dd08a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:30:22 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:30:22 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca71d400-50, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca71d400-50, col_values=(('qos', UUID('b3de7301-b05a-447e-9fb2-b7e53a34a774')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca71d400-50, col_values=(('external_ids', {'iface-id': 'ca71d400-500b-4d9b-9141-67afb25ac98d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:61:d8', 'vm-uuid': 'def2369e-4d57-482b-aef9-dab7c3a7cb84'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.objects.instance [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'vcpu_model' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:22 user nova-compute[75571]: INFO os_vif [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:61:d8,bridge_name='br-int',has_traffic_filtering=True,id=ca71d400-500b-4d9b-9141-67afb25ac98d,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca71d400-50')
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.objects.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Object Instance<636a8f00-7685-4c1b-9404-cf16359dd08a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqZWzSIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:30:22 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:30:22 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:30:22 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2770caeb-6ee6-4c6a-8da0-d1672a79cd10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:30:22 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No VIF found with MAC fa:16:3e:4c:61:d8, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0ac941-854f-4e6d-af46-48a83d191aae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15] added
Nov 28 20:30:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefdfd79-7e01-4d4c-8640-a4ca9339b36a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaac2f70-ab03-4739-a0e3-eedd00d7da56]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqZWzSIU {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqZWzSIU" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c138ee6d-db87-4fe4-8cb6-9e2d95e49a78]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LqZWzSIU'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d47d72-0d2b-4144-9f02-2946b96e3a51]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a70db7-981f-4e3c-ae60-65c1bb02f567]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:30:22 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:30:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:30:22 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:30:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[92da9f99-e7c2-4770-96c5-500eb862c502]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260]
Nov 28 20:30:22 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260] successful.
Nov 28 20:30:22 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3078c4c-7a12-42f4-a5a1-78f49752be0f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[efabea83-0caf-4233-83ea-9199ab40d3e4]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:30:23 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:30:23 user nova-compute[75571]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:30:23 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:30:23 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:30:23 user nova-compute[75571]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:30:23 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1052ca-64bb-4cc6-ad70-c279331cdd1b]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqZWzSIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG nova.network.neutron [req-e689fecd-3e81-490f-8b06-5601ca85256e req-4801d6ec-49cb-4595-88dc-64ace36f1651 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Updated VIF entry in instance network info cache for port ca71d400-500b-4d9b-9141-67afb25ac98d. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG nova.network.neutron [req-e689fecd-3e81-490f-8b06-5601ca85256e req-4801d6ec-49cb-4595-88dc-64ace36f1651 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Updating instance_info_cache with network_info: [{"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e689fecd-3e81-490f-8b06-5601ca85256e req-4801d6ec-49cb-4595-88dc-64ace36f1651 service nova] Releasing lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23763643762386239', 'path': '/dev/sdc'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763643762386239', 'path': '/dev/sdc'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:26:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-599565098',display_name='tempest-AttachVolumeTestJSON-server-599565098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-599565098',id=32,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3XwsjqlLJC+H5W8+kliU+liUVxsmiGlirVM1hB3Xvq2TAMksvSwoTdDPqxJDLnMy/epsE7znWc/yERpeFqyVO3BqmqmL465Jtof0GPEtberkTrsDvfTVDra8QzBI4sQ==',key_name='tempest-keypair-1076987994',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:26:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a7d489de217644979c5888d97158a800',ramdisk_id='',reservation_id='r-8ipm7twc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-187128538',owner_user_name='tempest-AttachVolumeTestJSON-187128538-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d653c87883374ab59768ce28b2b9adfc',uuid=636a8f00-7685-4c1b-9404-cf16359dd08a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converting VIF {"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.objects.instance [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'pci_devices' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.objects.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Object Instance<636a8f00-7685-4c1b-9404-cf16359dd08a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:30:24 user nova-compute[75571]:   <uuid>636a8f00-7685-4c1b-9404-cf16359dd08a</uuid>
Nov 28 20:30:24 user nova-compute[75571]:   <name>instance-00000020</name>
Nov 28 20:30:24 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:30:24 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:30:24 user nova-compute[75571]:   <metadata>
Nov 28 20:30:24 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:30:24 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:30:24 user nova-compute[75571]:       <nova:name>tempest-AttachVolumeTestJSON-server-599565098</nova:name>
Nov 28 20:30:24 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:30:22</nova:creationTime>
Nov 28 20:30:24 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:30:24 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:30:24 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:30:24 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:30:24 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:30:24 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:30:24 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:30:24 user nova-compute[75571]:       <nova:owner>
Nov 28 20:30:24 user nova-compute[75571]:         <nova:user uuid="d653c87883374ab59768ce28b2b9adfc">tempest-AttachVolumeTestJSON-187128538-project-member</nova:user>
Nov 28 20:30:24 user nova-compute[75571]:         <nova:project uuid="a7d489de217644979c5888d97158a800">tempest-AttachVolumeTestJSON-187128538</nova:project>
Nov 28 20:30:24 user nova-compute[75571]:       </nova:owner>
Nov 28 20:30:24 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:30:24 user nova-compute[75571]:       <nova:ports>
Nov 28 20:30:24 user nova-compute[75571]:         <nova:port uuid="23e84680-3abf-49b8-9750-1a0a3cd8b4cb">
Nov 28 20:30:24 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 20:30:24 user nova-compute[75571]:         </nova:port>
Nov 28 20:30:24 user nova-compute[75571]:       </nova:ports>
Nov 28 20:30:24 user nova-compute[75571]:     </nova:instance>
Nov 28 20:30:24 user nova-compute[75571]:   </metadata>
Nov 28 20:30:24 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:30:24 user nova-compute[75571]:     <system>
Nov 28 20:30:24 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:30:24 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:30:24 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:30:24 user nova-compute[75571]:       <entry name="serial">636a8f00-7685-4c1b-9404-cf16359dd08a</entry>
Nov 28 20:30:24 user nova-compute[75571]:       <entry name="uuid">636a8f00-7685-4c1b-9404-cf16359dd08a</entry>
Nov 28 20:30:24 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:30:24 user nova-compute[75571]:     </system>
Nov 28 20:30:24 user nova-compute[75571]:   </sysinfo>
Nov 28 20:30:24 user nova-compute[75571]:   <os>
Nov 28 20:30:24 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:30:24 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:30:24 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:30:24 user nova-compute[75571]:   </os>
Nov 28 20:30:24 user nova-compute[75571]:   <features>
Nov 28 20:30:24 user nova-compute[75571]:     <acpi/>
Nov 28 20:30:24 user nova-compute[75571]:     <apic/>
Nov 28 20:30:24 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:30:24 user nova-compute[75571]:   </features>
Nov 28 20:30:24 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:30:24 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:30:24 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:30:24 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:30:24 user nova-compute[75571]:   </clock>
Nov 28 20:30:24 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:30:24 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:30:24 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:30:24 user nova-compute[75571]:   </cpu>
Nov 28 20:30:24 user nova-compute[75571]:   <devices>
Nov 28 20:30:24 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:30:24 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:30:24 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk"/>
Nov 28 20:30:24 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:30:24 user nova-compute[75571]:     </disk>
Nov 28 20:30:24 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:30:24 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:30:24 user nova-compute[75571]:       <source dev="/dev/sdc"/>
Nov 28 20:30:24 user nova-compute[75571]:       <target dev="vdb" bus="virtio"/>
Nov 28 20:30:24 user nova-compute[75571]:       <serial>564f704c-2c1e-45f6-b1a6-ed05d4ee8f15</serial>
Nov 28 20:30:24 user nova-compute[75571]:     </disk>
Nov 28 20:30:24 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:30:24 user nova-compute[75571]:       <mac address="fa:16:3e:b0:53:96"/>
Nov 28 20:30:24 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:30:24 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:30:24 user nova-compute[75571]:       <target dev="tap23e84680-3a"/>
Nov 28 20:30:24 user nova-compute[75571]:     </interface>
Nov 28 20:30:24 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:30:24 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/console.log" append="off"/>
Nov 28 20:30:24 user nova-compute[75571]:     </serial>
Nov 28 20:30:24 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:30:24 user nova-compute[75571]:     <video>
Nov 28 20:30:24 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:30:24 user nova-compute[75571]:     </video>
Nov 28 20:30:24 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:30:24 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:30:24 user nova-compute[75571]:     </rng>
Nov 28 20:30:24 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:30:24 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:30:24 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:30:24 user nova-compute[75571]:     </memballoon>
Nov 28 20:30:24 user nova-compute[75571]:   </devices>
Nov 28 20:30:24 user nova-compute[75571]: </domain>
Nov 28 20:30:24 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.compute.manager [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.compute.manager [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:30:24 user nova-compute[75571]: WARNING nova.compute.manager [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received unexpected event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with vm_state building and task_state spawning.
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.compute.manager [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.compute.manager [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:30:24 user nova-compute[75571]: WARNING nova.compute.manager [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received unexpected event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with vm_state building and task_state spawning.
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.objects.instance [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'trusted_certs' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.objects.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Object Instance<636a8f00-7685-4c1b-9404-cf16359dd08a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.221s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.compute.manager [req-8791842a-b442-4b1a-bf15-929cd4a81576 req-68c7dfbd-813a-4d80-ae6d-9460521f525d service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received event network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8791842a-b442-4b1a-bf15-929cd4a81576 req-68c7dfbd-813a-4d80-ae6d-9460521f525d service nova] Acquiring lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8791842a-b442-4b1a-bf15-929cd4a81576 req-68c7dfbd-813a-4d80-ae6d-9460521f525d service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8791842a-b442-4b1a-bf15-929cd4a81576 req-68c7dfbd-813a-4d80-ae6d-9460521f525d service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.compute.manager [req-8791842a-b442-4b1a-bf15-929cd4a81576 req-68c7dfbd-813a-4d80-ae6d-9460521f525d service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] No waiting events found dispatching network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:30:24 user nova-compute[75571]: WARNING nova.compute.manager [req-8791842a-b442-4b1a-bf15-929cd4a81576 req-68c7dfbd-813a-4d80-ae6d-9460521f525d service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received unexpected event network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d for instance with vm_state building and task_state spawning.
Nov 28 20:30:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Cannot resize image /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.objects.instance [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'migration_context' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.objects.base [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Object Instance<636a8f00-7685-4c1b-9404-cf16359dd08a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:26:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-599565098',display_name='tempest-AttachVolumeTestJSON-server-599565098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-599565098',id=32,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3XwsjqlLJC+H5W8+kliU+liUVxsmiGlirVM1hB3Xvq2TAMksvSwoTdDPqxJDLnMy/epsE7znWc/yERpeFqyVO3BqmqmL465Jtof0GPEtberkTrsDvfTVDra8QzBI4sQ==',key_name='tempest-keypair-1076987994',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:26:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a7d489de217644979c5888d97158a800',ramdisk_id='',reservation_id='r-8ipm7twc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-187128538',owner_user_name='tempest-AttachVolumeTestJSON-187128538-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d653c87883374ab59768ce28b2b9adfc',uuid=636a8f00-7685-4c1b-9404-cf16359dd08a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converting VIF {"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG os_vif [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7005d4a2-64b4-5e80-b66f-641e72d73868', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23e84680-3a, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23e84680-3a, col_values=(('qos', UUID('58058b89-f959-4363-8f3b-1528be4a18d2')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23e84680-3a, col_values=(('external_ids', {'iface-id': '23e84680-3abf-49b8-9750-1a0a3cd8b4cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:53:96', 'vm-uuid': '636a8f00-7685-4c1b-9404-cf16359dd08a'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:30:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:24 user nova-compute[75571]: INFO os_vif [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a')
Nov 28 20:30:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:30:26 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Instance spawned successfully.
Nov 28 20:30:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-989c9904-4c10-4ad4-8778-e31d9c8f4177 req-306a3d04-8eca-49e7-b663-d6d8c48412d3 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-989c9904-4c10-4ad4-8778-e31d9c8f4177 req-306a3d04-8eca-49e7-b663-d6d8c48412d3 service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-989c9904-4c10-4ad4-8778-e31d9c8f4177 req-306a3d04-8eca-49e7-b663-d6d8c48412d3 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-989c9904-4c10-4ad4-8778-e31d9c8f4177 req-306a3d04-8eca-49e7-b663-d6d8c48412d3 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-989c9904-4c10-4ad4-8778-e31d9c8f4177 req-306a3d04-8eca-49e7-b663-d6d8c48412d3 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:30:26 user nova-compute[75571]: WARNING nova.compute.manager [req-989c9904-4c10-4ad4-8778-e31d9c8f4177 req-306a3d04-8eca-49e7-b663-d6d8c48412d3 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state stopped and task_state powering-on.
Nov 28 20:30:26 user nova-compute[75571]: INFO nova.compute.manager [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Took 7.22 seconds to spawn the instance on the hypervisor.
Nov 28 20:30:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:30:26 user nova-compute[75571]: INFO nova.compute.manager [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Took 7.99 seconds to build instance.
Nov 28 20:30:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "29443f30-6d05-4148-9185-a31f78b4a68f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.103s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-1245ddf2-82bd-4331-8926-43429239f7de req-b4a017f2-8848-49d3-8299-1d38be6cf8cc service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received event network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1245ddf2-82bd-4331-8926-43429239f7de req-b4a017f2-8848-49d3-8299-1d38be6cf8cc service nova] Acquiring lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1245ddf2-82bd-4331-8926-43429239f7de req-b4a017f2-8848-49d3-8299-1d38be6cf8cc service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1245ddf2-82bd-4331-8926-43429239f7de req-b4a017f2-8848-49d3-8299-1d38be6cf8cc service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-1245ddf2-82bd-4331-8926-43429239f7de req-b4a017f2-8848-49d3-8299-1d38be6cf8cc service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] No waiting events found dispatching network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:30:26 user nova-compute[75571]: WARNING nova.compute.manager [req-1245ddf2-82bd-4331-8926-43429239f7de req-b4a017f2-8848-49d3-8299-1d38be6cf8cc service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received unexpected event network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d for instance with vm_state building and task_state spawning.
Nov 28 20:30:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:30:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:30:28 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Instance spawned successfully.
Nov 28 20:30:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:30:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:28 user nova-compute[75571]: INFO nova.compute.manager [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Took 7.35 seconds to spawn the instance on the hypervisor.
Nov 28 20:30:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:30:28 user nova-compute[75571]: INFO nova.compute.manager [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Took 8.64 seconds to build instance.
Nov 28 20:30:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.786s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:30:28 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Instance rebooted successfully.
Nov 28 20:30:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:30:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-fbd6f3ea-48f3-476b-bf7b-02bf9ca1ab5d req-02abaaff-5c62-4a64-95f4-39c765109c06 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:30:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fbd6f3ea-48f3-476b-bf7b-02bf9ca1ab5d req-02abaaff-5c62-4a64-95f4-39c765109c06 service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fbd6f3ea-48f3-476b-bf7b-02bf9ca1ab5d req-02abaaff-5c62-4a64-95f4-39c765109c06 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fbd6f3ea-48f3-476b-bf7b-02bf9ca1ab5d req-02abaaff-5c62-4a64-95f4-39c765109c06 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-fbd6f3ea-48f3-476b-bf7b-02bf9ca1ab5d req-02abaaff-5c62-4a64-95f4-39c765109c06 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:30:28 user nova-compute[75571]: WARNING nova.compute.manager [req-fbd6f3ea-48f3-476b-bf7b-02bf9ca1ab5d req-02abaaff-5c62-4a64-95f4-39c765109c06 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state stopped and task_state powering-on.
Nov 28 20:30:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "136d54f3-eb9a-46fc-8b5f-318b68500804" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:30:35 user nova-compute[75571]: INFO nova.compute.claims [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Claim successful on node user
Nov 28 20:30:35 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:30:35 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:30:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG nova.policy [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:30:35 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Creating image(s)
Nov 28 20:30:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "/opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "/opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "/opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9.part --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:36 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Successfully created port: 48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:30:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:36 user nova-compute[75571]: DEBUG nova.virt.images [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 06d47545-e88b-4137-81e4-ef6283307ebb was qcow2, converting to raw {{(pid=75571) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 20:30:36 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:30:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9.part /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9.converted {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9.part /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9.converted" returned: 0 in 0.337s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9.converted --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.408s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9 --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Successfully updated port: 48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquired lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9 --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-526ce5f1-1645-4331-9038-7994a0bcf02e req-8f6d0324-8f68-439c-9f63-38f5fa73cebf service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received event network-changed-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-526ce5f1-1645-4331-9038-7994a0bcf02e req-8f6d0324-8f68-439c-9f63-38f5fa73cebf service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Refreshing instance network info cache due to event network-changed-48a201ba-2910-4d94-b7a9-ac3878402adf. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-526ce5f1-1645-4331-9038-7994a0bcf02e req-8f6d0324-8f68-439c-9f63-38f5fa73cebf service nova] Acquiring lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9 --force-share --output=json" returned: 0 in 0.191s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9,backing_fmt=raw /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9,backing_fmt=raw /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk 1073741824" returned: 0 in 0.050s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9 --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Updating instance_info_cache with network_info: [{"id": "48a201ba-2910-4d94-b7a9-ac3878402adf", "address": "fa:16:3e:3c:93:46", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a201ba-29", "ovs_interfaceid": "48a201ba-2910-4d94-b7a9-ac3878402adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Releasing lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Instance network_info: |[{"id": "48a201ba-2910-4d94-b7a9-ac3878402adf", "address": "fa:16:3e:3c:93:46", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a201ba-29", "ovs_interfaceid": "48a201ba-2910-4d94-b7a9-ac3878402adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-526ce5f1-1645-4331-9038-7994a0bcf02e req-8f6d0324-8f68-439c-9f63-38f5fa73cebf service nova] Acquired lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG nova.network.neutron [req-526ce5f1-1645-4331-9038-7994a0bcf02e req-8f6d0324-8f68-439c-9f63-38f5fa73cebf service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Refreshing network info cache for port 48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9 --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:30:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Cannot resize image /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Ensure instance console log exists: /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Start _get_guest_xml network_info=[{"id": "48a201ba-2910-4d94-b7a9-ac3878402adf", "address": "fa:16:3e:3c:93:46", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a201ba-29", "ovs_interfaceid": "48a201ba-2910-4d94-b7a9-ac3878402adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:30:32Z,direct_url=<?>,disk_format='qcow2',id=06d47545-e88b-4137-81e4-ef6283307ebb,min_disk=0,min_ram=0,name='tempest-scenario-img--701035081',owner='4fb173b085164da1b53412e2948fbdfe',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:30:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '06d47545-e88b-4137-81e4-ef6283307ebb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:30:38 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:30:38 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:30:32Z,direct_url=<?>,disk_format='qcow2',id=06d47545-e88b-4137-81e4-ef6283307ebb,min_disk=0,min_ram=0,name='tempest-scenario-img--701035081',owner='4fb173b085164da1b53412e2948fbdfe',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:30:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:30:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1665088042',display_name='tempest-TestMinimumBasicScenario-server-1665088042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1665088042',id=37,image_ref='06d47545-e88b-4137-81e4-ef6283307ebb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEipdzNZLqCPxCJq60u8xUyzkYMqPIO+X9JodtuRNDPqyX9NiH86q4PyHv85XM1J/imVlNMYd4EKsnbTlYoelp/NoQSXOcmQyHMjfmkcvsc+d7/aGGUQrHbku7H28CUfWA==',key_name='tempest-TestMinimumBasicScenario-661508500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fb173b085164da1b53412e2948fbdfe',ramdisk_id='',reservation_id='r-qlcpcqq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='06d47545-e88b-4137-81e4-ef6283307ebb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1412958496',owner_user_name='tempest-TestMinimumBasicScenario-1412958496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:30:36Z,user_data=None,user_id='6722115f609e44ccad60d00c89a04ddb',uuid=136d54f3-eb9a-46fc-8b5f-318b68500804,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48a201ba-2910-4d94-b7a9-ac3878402adf", "address": "fa:16:3e:3c:93:46", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a201ba-29", "ovs_interfaceid": "48a201ba-2910-4d94-b7a9-ac3878402adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converting VIF {"id": "48a201ba-2910-4d94-b7a9-ac3878402adf", "address": "fa:16:3e:3c:93:46", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a201ba-29", "ovs_interfaceid": "48a201ba-2910-4d94-b7a9-ac3878402adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:93:46,bridge_name='br-int',has_traffic_filtering=True,id=48a201ba-2910-4d94-b7a9-ac3878402adf,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a201ba-29') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.objects.instance [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'pci_devices' on Instance uuid 136d54f3-eb9a-46fc-8b5f-318b68500804 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:30:38 user nova-compute[75571]:   <uuid>136d54f3-eb9a-46fc-8b5f-318b68500804</uuid>
Nov 28 20:30:38 user nova-compute[75571]:   <name>instance-00000025</name>
Nov 28 20:30:38 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:30:38 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:30:38 user nova-compute[75571]:   <metadata>
Nov 28 20:30:38 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:30:38 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:30:38 user nova-compute[75571]:       <nova:name>tempest-TestMinimumBasicScenario-server-1665088042</nova:name>
Nov 28 20:30:38 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:30:38</nova:creationTime>
Nov 28 20:30:38 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:30:38 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:30:38 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:30:38 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:30:38 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:30:38 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:30:38 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:30:38 user nova-compute[75571]:       <nova:owner>
Nov 28 20:30:38 user nova-compute[75571]:         <nova:user uuid="6722115f609e44ccad60d00c89a04ddb">tempest-TestMinimumBasicScenario-1412958496-project-member</nova:user>
Nov 28 20:30:38 user nova-compute[75571]:         <nova:project uuid="4fb173b085164da1b53412e2948fbdfe">tempest-TestMinimumBasicScenario-1412958496</nova:project>
Nov 28 20:30:38 user nova-compute[75571]:       </nova:owner>
Nov 28 20:30:38 user nova-compute[75571]:       <nova:root type="image" uuid="06d47545-e88b-4137-81e4-ef6283307ebb"/>
Nov 28 20:30:38 user nova-compute[75571]:       <nova:ports>
Nov 28 20:30:38 user nova-compute[75571]:         <nova:port uuid="48a201ba-2910-4d94-b7a9-ac3878402adf">
Nov 28 20:30:38 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 20:30:38 user nova-compute[75571]:         </nova:port>
Nov 28 20:30:38 user nova-compute[75571]:       </nova:ports>
Nov 28 20:30:38 user nova-compute[75571]:     </nova:instance>
Nov 28 20:30:38 user nova-compute[75571]:   </metadata>
Nov 28 20:30:38 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:30:38 user nova-compute[75571]:     <system>
Nov 28 20:30:38 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:30:38 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:30:38 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:30:38 user nova-compute[75571]:       <entry name="serial">136d54f3-eb9a-46fc-8b5f-318b68500804</entry>
Nov 28 20:30:38 user nova-compute[75571]:       <entry name="uuid">136d54f3-eb9a-46fc-8b5f-318b68500804</entry>
Nov 28 20:30:38 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:30:38 user nova-compute[75571]:     </system>
Nov 28 20:30:38 user nova-compute[75571]:   </sysinfo>
Nov 28 20:30:38 user nova-compute[75571]:   <os>
Nov 28 20:30:38 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:30:38 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:30:38 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:30:38 user nova-compute[75571]:   </os>
Nov 28 20:30:38 user nova-compute[75571]:   <features>
Nov 28 20:30:38 user nova-compute[75571]:     <acpi/>
Nov 28 20:30:38 user nova-compute[75571]:     <apic/>
Nov 28 20:30:38 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:30:38 user nova-compute[75571]:   </features>
Nov 28 20:30:38 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:30:38 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:30:38 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:30:38 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:30:38 user nova-compute[75571]:   </clock>
Nov 28 20:30:38 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:30:38 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:30:38 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:30:38 user nova-compute[75571]:   </cpu>
Nov 28 20:30:38 user nova-compute[75571]:   <devices>
Nov 28 20:30:38 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:30:38 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:30:38 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk"/>
Nov 28 20:30:38 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:30:38 user nova-compute[75571]:     </disk>
Nov 28 20:30:38 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:30:38 user nova-compute[75571]:       <mac address="fa:16:3e:3c:93:46"/>
Nov 28 20:30:38 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:30:38 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:30:38 user nova-compute[75571]:       <target dev="tap48a201ba-29"/>
Nov 28 20:30:38 user nova-compute[75571]:     </interface>
Nov 28 20:30:38 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:30:38 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/console.log" append="off"/>
Nov 28 20:30:38 user nova-compute[75571]:     </serial>
Nov 28 20:30:38 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:30:38 user nova-compute[75571]:     <video>
Nov 28 20:30:38 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:30:38 user nova-compute[75571]:     </video>
Nov 28 20:30:38 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:30:38 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:30:38 user nova-compute[75571]:     </rng>
Nov 28 20:30:38 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:30:38 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:30:38 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:30:38 user nova-compute[75571]:     </memballoon>
Nov 28 20:30:38 user nova-compute[75571]:   </devices>
Nov 28 20:30:38 user nova-compute[75571]: </domain>
Nov 28 20:30:38 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:30:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1665088042',display_name='tempest-TestMinimumBasicScenario-server-1665088042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1665088042',id=37,image_ref='06d47545-e88b-4137-81e4-ef6283307ebb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEipdzNZLqCPxCJq60u8xUyzkYMqPIO+X9JodtuRNDPqyX9NiH86q4PyHv85XM1J/imVlNMYd4EKsnbTlYoelp/NoQSXOcmQyHMjfmkcvsc+d7/aGGUQrHbku7H28CUfWA==',key_name='tempest-TestMinimumBasicScenario-661508500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fb173b085164da1b53412e2948fbdfe',ramdisk_id='',reservation_id='r-qlcpcqq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='06d47545-e88b-4137-81e4-ef6283307ebb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1412958496',owner_user_name='tempest-TestMinimumBasicScenario-1412958496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:30:36Z,user_data=None,user_id='6722115f609e44ccad60d00c89a04ddb',uuid=136d54f3-eb9a-46fc-8b5f-318b68500804,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48a201ba-2910-4d94-b7a9-ac3878402adf", "address": "fa:16:3e:3c:93:46", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a201ba-29", "ovs_interfaceid": "48a201ba-2910-4d94-b7a9-ac3878402adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converting VIF {"id": "48a201ba-2910-4d94-b7a9-ac3878402adf", "address": "fa:16:3e:3c:93:46", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a201ba-29", "ovs_interfaceid": "48a201ba-2910-4d94-b7a9-ac3878402adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:93:46,bridge_name='br-int',has_traffic_filtering=True,id=48a201ba-2910-4d94-b7a9-ac3878402adf,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a201ba-29') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG os_vif [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:93:46,bridge_name='br-int',has_traffic_filtering=True,id=48a201ba-2910-4d94-b7a9-ac3878402adf,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a201ba-29') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1730a2c-bbb5-5aa9-8967-676aa948a95c', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48a201ba-29, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48a201ba-29, col_values=(('qos', UUID('a7686255-8b45-4fb6-9086-8f74df89d266')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48a201ba-29, col_values=(('external_ids', {'iface-id': '48a201ba-2910-4d94-b7a9-ac3878402adf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:93:46', 'vm-uuid': '136d54f3-eb9a-46fc-8b5f-318b68500804'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:38 user nova-compute[75571]: INFO os_vif [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:93:46,bridge_name='br-int',has_traffic_filtering=True,id=48a201ba-2910-4d94-b7a9-ac3878402adf,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a201ba-29')
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] No VIF found with MAC fa:16:3e:3c:93:46, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.network.neutron [req-526ce5f1-1645-4331-9038-7994a0bcf02e req-8f6d0324-8f68-439c-9f63-38f5fa73cebf service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Updated VIF entry in instance network info cache for port 48a201ba-2910-4d94-b7a9-ac3878402adf. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG nova.network.neutron [req-526ce5f1-1645-4331-9038-7994a0bcf02e req-8f6d0324-8f68-439c-9f63-38f5fa73cebf service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Updating instance_info_cache with network_info: [{"id": "48a201ba-2910-4d94-b7a9-ac3878402adf", "address": "fa:16:3e:3c:93:46", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a201ba-29", "ovs_interfaceid": "48a201ba-2910-4d94-b7a9-ac3878402adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:30:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-526ce5f1-1645-4331-9038-7994a0bcf02e req-8f6d0324-8f68-439c-9f63-38f5fa73cebf service nova] Releasing lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:30:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-b5fd0add-2f9f-463a-a9a0-1fb3ebbb6836 req-8d2fe6ed-10d4-46fb-9cec-e76db1351df0 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received event network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:30:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b5fd0add-2f9f-463a-a9a0-1fb3ebbb6836 req-8d2fe6ed-10d4-46fb-9cec-e76db1351df0 service nova] Acquiring lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b5fd0add-2f9f-463a-a9a0-1fb3ebbb6836 req-8d2fe6ed-10d4-46fb-9cec-e76db1351df0 service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b5fd0add-2f9f-463a-a9a0-1fb3ebbb6836 req-8d2fe6ed-10d4-46fb-9cec-e76db1351df0 service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:39 user nova-compute[75571]: DEBUG nova.compute.manager [req-b5fd0add-2f9f-463a-a9a0-1fb3ebbb6836 req-8d2fe6ed-10d4-46fb-9cec-e76db1351df0 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] No waiting events found dispatching network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:30:39 user nova-compute[75571]: WARNING nova.compute.manager [req-b5fd0add-2f9f-463a-a9a0-1fb3ebbb6836 req-8d2fe6ed-10d4-46fb-9cec-e76db1351df0 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received unexpected event network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf for instance with vm_state building and task_state spawning.
Nov 28 20:30:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:30:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:30:41 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Instance spawned successfully.
Nov 28 20:30:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:30:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:30:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-7a4cfa01-a47c-4d6f-9fc5-621d633bd916 req-068303d5-3cce-4dd4-8677-091188ec95db service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received event network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:30:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7a4cfa01-a47c-4d6f-9fc5-621d633bd916 req-068303d5-3cce-4dd4-8677-091188ec95db service nova] Acquiring lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7a4cfa01-a47c-4d6f-9fc5-621d633bd916 req-068303d5-3cce-4dd4-8677-091188ec95db service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7a4cfa01-a47c-4d6f-9fc5-621d633bd916 req-068303d5-3cce-4dd4-8677-091188ec95db service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-7a4cfa01-a47c-4d6f-9fc5-621d633bd916 req-068303d5-3cce-4dd4-8677-091188ec95db service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] No waiting events found dispatching network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:30:41 user nova-compute[75571]: WARNING nova.compute.manager [req-7a4cfa01-a47c-4d6f-9fc5-621d633bd916 req-068303d5-3cce-4dd4-8677-091188ec95db service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received unexpected event network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf for instance with vm_state building and task_state spawning.
Nov 28 20:30:41 user nova-compute[75571]: INFO nova.compute.manager [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 28 20:30:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:30:42 user nova-compute[75571]: INFO nova.compute.manager [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Took 6.85 seconds to build instance.
Nov 28 20:30:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.950s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:53 user nova-compute[75571]: INFO nova.compute.manager [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Rescuing
Nov 28 20:30:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "refresh_cache-5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:30:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquired lock "refresh_cache-5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:30:53 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:30:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:53 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Updating instance_info_cache with network_info: [{"id": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "address": "fa:16:3e:a1:20:af", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaded16b1-1b", "ovs_interfaceid": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:30:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Releasing lock "refresh_cache-5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:30:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:54 user nova-compute[75571]: DEBUG nova.compute.manager [req-55915a42-3a65-43bd-b7ec-815a38e0d690 req-54f91597-194a-4a91-9525-079720597361 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received event network-vif-unplugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:30:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-55915a42-3a65-43bd-b7ec-815a38e0d690 req-54f91597-194a-4a91-9525-079720597361 service nova] Acquiring lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-55915a42-3a65-43bd-b7ec-815a38e0d690 req-54f91597-194a-4a91-9525-079720597361 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-55915a42-3a65-43bd-b7ec-815a38e0d690 req-54f91597-194a-4a91-9525-079720597361 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:54 user nova-compute[75571]: DEBUG nova.compute.manager [req-55915a42-3a65-43bd-b7ec-815a38e0d690 req-54f91597-194a-4a91-9525-079720597361 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] No waiting events found dispatching network-vif-unplugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:30:54 user nova-compute[75571]: WARNING nova.compute.manager [req-55915a42-3a65-43bd-b7ec-815a38e0d690 req-54f91597-194a-4a91-9525-079720597361 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received unexpected event network-vif-unplugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance with vm_state active and task_state rescuing.
Nov 28 20:30:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:54 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Instance destroyed successfully.
Nov 28 20:30:54 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Attempting a stable device rescue
Nov 28 20:30:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75571) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 20:30:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Instance directory exists: not creating {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 20:30:54 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Creating image(s)
Nov 28 20:30:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "/opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "/opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "/opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:54 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "14d248f17ea541e1677c53b6657caaa14a8c262b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "14d248f17ea541e1677c53b6657caaa14a8c262b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14d248f17ea541e1677c53b6657caaa14a8c262b.part --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14d248f17ea541e1677c53b6657caaa14a8c262b.part --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:55 user nova-compute[75571]: DEBUG nova.virt.images [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 3ce3dfcc-9cca-4f66-bc88-7957a3302000 was qcow2, converting to raw {{(pid=75571) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 20:30:55 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:30:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/14d248f17ea541e1677c53b6657caaa14a8c262b.part /opt/stack/data/nova/instances/_base/14d248f17ea541e1677c53b6657caaa14a8c262b.converted {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG nova.compute.manager [req-3e16da95-0643-4985-8ac4-5aa99039fac4 req-b7cff9cc-3dac-497a-a93c-cf2eed3e9f33 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3e16da95-0643-4985-8ac4-5aa99039fac4 req-b7cff9cc-3dac-497a-a93c-cf2eed3e9f33 service nova] Acquiring lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3e16da95-0643-4985-8ac4-5aa99039fac4 req-b7cff9cc-3dac-497a-a93c-cf2eed3e9f33 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3e16da95-0643-4985-8ac4-5aa99039fac4 req-b7cff9cc-3dac-497a-a93c-cf2eed3e9f33 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG nova.compute.manager [req-3e16da95-0643-4985-8ac4-5aa99039fac4 req-b7cff9cc-3dac-497a-a93c-cf2eed3e9f33 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] No waiting events found dispatching network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:30:56 user nova-compute[75571]: WARNING nova.compute.manager [req-3e16da95-0643-4985-8ac4-5aa99039fac4 req-b7cff9cc-3dac-497a-a93c-cf2eed3e9f33 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received unexpected event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance with vm_state active and task_state rescuing.
Nov 28 20:30:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/14d248f17ea541e1677c53b6657caaa14a8c262b.part /opt/stack/data/nova/instances/_base/14d248f17ea541e1677c53b6657caaa14a8c262b.converted" returned: 0 in 0.564s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14d248f17ea541e1677c53b6657caaa14a8c262b.converted --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14d248f17ea541e1677c53b6657caaa14a8c262b.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "14d248f17ea541e1677c53b6657caaa14a8c262b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.959s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "14d248f17ea541e1677c53b6657caaa14a8c262b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "14d248f17ea541e1677c53b6657caaa14a8c262b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14d248f17ea541e1677c53b6657caaa14a8c262b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14d248f17ea541e1677c53b6657caaa14a8c262b --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/14d248f17ea541e1677c53b6657caaa14a8c262b,backing_fmt=raw /opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/disk.rescue {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/14d248f17ea541e1677c53b6657caaa14a8c262b,backing_fmt=raw /opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/disk.rescue" returned: 0 in 0.047s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "14d248f17ea541e1677c53b6657caaa14a8c262b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'migration_context' on Instance uuid 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG nova.objects.base [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Object Instance<5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Start _get_guest_xml network_info=[{"id": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "address": "fa:16:3e:a1:20:af", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "vif_mac": "fa:16:3e:a1:20:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaded16b1-1b", "ovs_interfaceid": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3ce3dfcc-9cca-4f66-bc88-7957a3302000', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysmcSPHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867', 'attached_at': '', 'detached_at': '', 'volume_id': 'b15c2acb-f787-44e6-aecf-f23dac0b7b0e', 'serial': 'b15c2acb-f787-44e6-aecf-f23dac0b7b0e'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '521da25a-acc8-4ea5-a96c-7e0c2d5a9eaf', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:30:56 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'resources' on Instance uuid 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.objects.base [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Object Instance<5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'numa_topology' on Instance uuid 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.objects.base [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Object Instance<5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:30:57 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:30:57 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.objects.base [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Object Instance<5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysmcSPHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:30:57 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:30:57 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:30:57 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd576bd-c047-43c5-a698-cf450d97638c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ysmcSPHv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 20:30:57 user nova-compute[75571]: node.name = iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e
Nov 28 20:30:57 user nova-compute[75571]: node.tpgt = -1
Nov 28 20:30:57 user nova-compute[75571]: node.startup = automatic
Nov 28 20:30:57 user nova-compute[75571]: node.leading_login = No
Nov 28 20:30:57 user nova-compute[75571]: iface.iscsi_ifacename = default
Nov 28 20:30:57 user nova-compute[75571]: iface.net_ifacename = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.ipaddress = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.prefix_len = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.hwaddress = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.transport_name = tcp
Nov 28 20:30:57 user nova-compute[75571]: iface.initiatorname = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.state = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.vlan_id = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.vlan_priority = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.vlan_state = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.iface_num = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.mtu = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.port = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.bootproto = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.subnet_mask = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.gateway = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.dhcp_alt_client_id = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.dhcp_dns = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.dhcp_learn_iqn = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.dhcp_vendor_id_state = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.dhcp_vendor_id = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.dhcp_slp_da = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.fragmentation = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.gratuitous_arp = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.incoming_forwarding = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.tos_state = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.tos = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.ttl = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.delayed_ack = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.tcp_nagle = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.tcp_wsf_state = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.tcp_wsf = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.tcp_timer_scale = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.tcp_timestamp = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.redirect = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.def_task_mgmt_timeout = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.header_digest = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.data_digest = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.immediate_data = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.initial_r2t = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.data_seq_inorder = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.data_pdu_inorder = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.erl = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.max_receive_data_len = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.first_burst_len = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.max_outstanding_r2t = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.max_burst_len = 0
Nov 28 20:30:57 user nova-compute[75571]: iface.chap_auth = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.bidi_chap = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.strict_login_compliance = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.discovery_auth = <empty>
Nov 28 20:30:57 user nova-compute[75571]: iface.discovery_logout = <empty>
Nov 28 20:30:57 user nova-compute[75571]: node.discovery_address = <empty>
Nov 28 20:30:57 user nova-compute[75571]: node.discovery_port = 0
Nov 28 20:30:57 user nova-compute[75571]: node.discovery_type = static
Nov 28 20:30:57 user nova-compute[75571]: node.session.initial_cmdsn = 0
Nov 28 20:30:57 user nova-compute[75571]: node.session.initial_login_retry_max = 8
Nov 28 20:30:57 user nova-compute[75571]: node.session.xmit_thread_priority = -20
Nov 28 20:30:57 user nova-compute[75571]: node.session.cmds_max = 128
Nov 28 20:30:57 user nova-compute[75571]: node.session.queue_depth = 32
Nov 28 20:30:57 user nova-compute[75571]: node.session.nr_sessions = 1
Nov 28 20:30:57 user nova-compute[75571]: node.session.auth.authmethod = CHAP
Nov 28 20:30:57 user nova-compute[75571]: node.session.auth.username = ysmcSPHv
Nov 28 20:30:57 user nova-compute[75571]: node.session.auth.password = ***
Nov 28 20:30:57 user nova-compute[75571]: node.session.auth.username_in = <empty>
Nov 28 20:30:57 user nova-compute[75571]: node.session.auth.password_in = <empty>
Nov 28 20:30:57 user nova-compute[75571]: node.session.auth.chap_algs = MD5
Nov 28 20:30:57 user nova-compute[75571]: node.session.timeo.replacement_timeout = 120
Nov 28 20:30:57 user nova-compute[75571]: node.session.err_timeo.abort_timeout = 15
Nov 28 20:30:57 user nova-compute[75571]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 20:30:57 user nova-compute[75571]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 20:30:57 user nova-compute[75571]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 20:30:57 user nova-compute[75571]: node.session.iscsi.FastAbort = Yes
Nov 28 20:30:57 user nova-compute[75571]: node.session.iscsi.InitialR2T = No
Nov 28 20:30:57 user nova-compute[75571]: node.session.iscsi.ImmediateData = Yes
Nov 28 20:30:57 user nova-compute[75571]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 20:30:57 user nova-compute[75571]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 20:30:57 user nova-compute[75571]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 20:30:57 user nova-compute[75571]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 20:30:57 user nova-compute[75571]: node.session.iscsi.MaxConnections = 1
Nov 28 20:30:57 user nova-compute[75571]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 20:30:57 user nova-compute[75571]: node.session.iscsi.ERL = 0
Nov 28 20:30:57 user nova-compute[75571]: node.session.scan = manual
Nov 28 20:30:57 user nova-compute[75571]: node.session.reopen_max = 0
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].address = 172.16.0.220
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].port = 3260
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].startup = manual
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].tcp.window_size = 524288
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].tcp.type_of_service = 0
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].timeo.logout_timeout = 15
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].timeo.login_timeout = 15
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].timeo.auth_timeout = 45
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].iscsi.DataDigest = None
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].iscsi.IFMarker = No
Nov 28 20:30:57 user nova-compute[75571]: node.conn[0].iscsi.OFMarker = No
Nov 28 20:30:57 user nova-compute[75571]: # END RECORD
Nov 28 20:30:57 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.065s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36c8a2e-8335-4d83-84e7-51e34d33522d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44f580e-334c-4645-a166-1321868c5536]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ysmcSPHv {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ysmcSPHv" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9e9111-29f7-494b-9a5b-a25f0c3ca60b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ysmcSPHv'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b128251-7fdd-485a-b0e6-f846829cd10c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3deb53b-3509-4cf0-8ef1-ed353f130488]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:30:57 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:30:57 user nova-compute[75571]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:30:57 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:30:57 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:30:57 user nova-compute[75571]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:30:57 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.185s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] HCTL ('33', '0', '0', 0) found on session 46 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ee2239-1c97-46cb-9262-1437f9208ea8]: (4, ('0 0 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Searching for a device in session 46 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysmcSPHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.210s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] <== connect_volume: return (211ms) {'type': 'block', 'scsi_wwn': '23334343830366537', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334343830366537', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:29:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-773181244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-773181244',id=33,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:29:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd03007966db45f48ae6c22ed6f84871',ramdisk_id='',reservation_id='r-0z1j7bj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-468878',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-468878-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:29:21Z,user_data=None,user_id='007af37c9a914cd5863e486c041701be',uuid=5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "address": "fa:16:3e:a1:20:af", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "vif_mac": "fa:16:3e:a1:20:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaded16b1-1b", "ovs_interfaceid": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converting VIF {"id": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "address": "fa:16:3e:a1:20:af", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "vif_mac": "fa:16:3e:a1:20:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaded16b1-1b", "ovs_interfaceid": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:20:af,bridge_name='br-int',has_traffic_filtering=True,id=aded16b1-1b80-4e18-ab01-ea36010cc6ff,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaded16b1-1b') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'pci_devices' on Instance uuid 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.objects.base [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Object Instance<5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:30:57 user nova-compute[75571]:   <uuid>5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867</uuid>
Nov 28 20:30:57 user nova-compute[75571]:   <name>instance-00000021</name>
Nov 28 20:30:57 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:30:57 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:30:57 user nova-compute[75571]:   <metadata>
Nov 28 20:30:57 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:30:57 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:30:57 user nova-compute[75571]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-773181244</nova:name>
Nov 28 20:30:57 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:30:57</nova:creationTime>
Nov 28 20:30:57 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:30:57 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:30:57 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:30:57 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:30:57 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:30:57 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:30:57 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:30:57 user nova-compute[75571]:       <nova:owner>
Nov 28 20:30:57 user nova-compute[75571]:         <nova:user uuid="007af37c9a914cd5863e486c041701be">tempest-ServerBootFromVolumeStableRescueTest-468878-project-member</nova:user>
Nov 28 20:30:57 user nova-compute[75571]:         <nova:project uuid="dd03007966db45f48ae6c22ed6f84871">tempest-ServerBootFromVolumeStableRescueTest-468878</nova:project>
Nov 28 20:30:57 user nova-compute[75571]:       </nova:owner>
Nov 28 20:30:57 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:30:57 user nova-compute[75571]:       <nova:ports>
Nov 28 20:30:57 user nova-compute[75571]:         <nova:port uuid="aded16b1-1b80-4e18-ab01-ea36010cc6ff">
Nov 28 20:30:57 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 20:30:57 user nova-compute[75571]:         </nova:port>
Nov 28 20:30:57 user nova-compute[75571]:       </nova:ports>
Nov 28 20:30:57 user nova-compute[75571]:     </nova:instance>
Nov 28 20:30:57 user nova-compute[75571]:   </metadata>
Nov 28 20:30:57 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:30:57 user nova-compute[75571]:     <system>
Nov 28 20:30:57 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:30:57 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:30:57 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:30:57 user nova-compute[75571]:       <entry name="serial">5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867</entry>
Nov 28 20:30:57 user nova-compute[75571]:       <entry name="uuid">5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867</entry>
Nov 28 20:30:57 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:30:57 user nova-compute[75571]:     </system>
Nov 28 20:30:57 user nova-compute[75571]:   </sysinfo>
Nov 28 20:30:57 user nova-compute[75571]:   <os>
Nov 28 20:30:57 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:30:57 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:30:57 user nova-compute[75571]:   </os>
Nov 28 20:30:57 user nova-compute[75571]:   <features>
Nov 28 20:30:57 user nova-compute[75571]:     <acpi/>
Nov 28 20:30:57 user nova-compute[75571]:     <apic/>
Nov 28 20:30:57 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:30:57 user nova-compute[75571]:   </features>
Nov 28 20:30:57 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:30:57 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:30:57 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:30:57 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:30:57 user nova-compute[75571]:   </clock>
Nov 28 20:30:57 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:30:57 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:30:57 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:30:57 user nova-compute[75571]:   </cpu>
Nov 28 20:30:57 user nova-compute[75571]:   <devices>
Nov 28 20:30:57 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:30:57 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:30:57 user nova-compute[75571]:       <source dev="/dev/sdb"/>
Nov 28 20:30:57 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:30:57 user nova-compute[75571]:       <serial>b15c2acb-f787-44e6-aecf-f23dac0b7b0e</serial>
Nov 28 20:30:57 user nova-compute[75571]:     </disk>
Nov 28 20:30:57 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:30:57 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:30:57 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/disk.rescue"/>
Nov 28 20:30:57 user nova-compute[75571]:       <target dev="vdb" bus="virtio"/>
Nov 28 20:30:57 user nova-compute[75571]:       <boot order="1"/>
Nov 28 20:30:57 user nova-compute[75571]:     </disk>
Nov 28 20:30:57 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:30:57 user nova-compute[75571]:       <mac address="fa:16:3e:a1:20:af"/>
Nov 28 20:30:57 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:30:57 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:30:57 user nova-compute[75571]:       <target dev="tapaded16b1-1b"/>
Nov 28 20:30:57 user nova-compute[75571]:     </interface>
Nov 28 20:30:57 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:30:57 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/console.log" append="off"/>
Nov 28 20:30:57 user nova-compute[75571]:     </serial>
Nov 28 20:30:57 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:30:57 user nova-compute[75571]:     <video>
Nov 28 20:30:57 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:30:57 user nova-compute[75571]:     </video>
Nov 28 20:30:57 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:30:57 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:30:57 user nova-compute[75571]:     </rng>
Nov 28 20:30:57 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:30:57 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:30:57 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:30:57 user nova-compute[75571]:     </memballoon>
Nov 28 20:30:57 user nova-compute[75571]:   </devices>
Nov 28 20:30:57 user nova-compute[75571]: </domain>
Nov 28 20:30:57 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:30:57 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Instance destroyed successfully.
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:30:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] No VIF found with MAC fa:16:3e:a1:20:af, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:30:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:58 user nova-compute[75571]: DEBUG nova.compute.manager [req-618ef3e7-45cb-41da-a183-6935c3b0cd14 req-5b7a1839-20ee-4728-8851-64aa437226bc service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:30:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-618ef3e7-45cb-41da-a183-6935c3b0cd14 req-5b7a1839-20ee-4728-8851-64aa437226bc service nova] Acquiring lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:30:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-618ef3e7-45cb-41da-a183-6935c3b0cd14 req-5b7a1839-20ee-4728-8851-64aa437226bc service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:30:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-618ef3e7-45cb-41da-a183-6935c3b0cd14 req-5b7a1839-20ee-4728-8851-64aa437226bc service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:30:58 user nova-compute[75571]: DEBUG nova.compute.manager [req-618ef3e7-45cb-41da-a183-6935c3b0cd14 req-5b7a1839-20ee-4728-8851-64aa437226bc service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] No waiting events found dispatching network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:30:58 user nova-compute[75571]: WARNING nova.compute.manager [req-618ef3e7-45cb-41da-a183-6935c3b0cd14 req-5b7a1839-20ee-4728-8851-64aa437226bc service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received unexpected event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance with vm_state active and task_state rescuing.
Nov 28 20:30:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:30:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:00 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:31:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-1b782e0a-610e-44ef-aa2e-617967bb2ad1 req-50b5b5f5-cf12-4d4a-b3e0-119f91705c92 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:31:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1b782e0a-610e-44ef-aa2e-617967bb2ad1 req-50b5b5f5-cf12-4d4a-b3e0-119f91705c92 service nova] Acquiring lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:31:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1b782e0a-610e-44ef-aa2e-617967bb2ad1 req-50b5b5f5-cf12-4d4a-b3e0-119f91705c92 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:31:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1b782e0a-610e-44ef-aa2e-617967bb2ad1 req-50b5b5f5-cf12-4d4a-b3e0-119f91705c92 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:31:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-1b782e0a-610e-44ef-aa2e-617967bb2ad1 req-50b5b5f5-cf12-4d4a-b3e0-119f91705c92 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] No waiting events found dispatching network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:31:00 user nova-compute[75571]: WARNING nova.compute.manager [req-1b782e0a-610e-44ef-aa2e-617967bb2ad1 req-50b5b5f5-cf12-4d4a-b3e0-119f91705c92 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received unexpected event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance with vm_state rescued and task_state None.
Nov 28 20:31:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:04 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:31:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:10 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:31:11 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:31:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:31:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-e6f2a651-b10a-45f4-8f94-6a4426654a86" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:31:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-e6f2a651-b10a-45f4-8f94-6a4426654a86" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:31:11 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:31:11 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Updating instance_info_cache with network_info: [{"id": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "address": "fa:16:3e:ba:24:79", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a58452-a5", "ovs_interfaceid": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:31:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-e6f2a651-b10a-45f4-8f94-6a4426654a86" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:31:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:31:11 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:31:12 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:31:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:14 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:16 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:31:16 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:31:16 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=7744MB free_disk=24.807395935058594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 313a065e-94f3-4435-97af-6a16de64ca7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e6f2a651-b10a-45f4-8f94-6a4426654a86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 636a8f00-7685-4c1b-9404-cf16359dd08a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 93698818-d7ba-4f25-a341-30e5390a829e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 136d54f3-eb9a-46fc-8b5f-318b68500804 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:31:16 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:31:17 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:31:17 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:31:17 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:31:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:31:18 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:31:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:21 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:31:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-5c523e16-9832-4cea-8391-08a601e116c8 req-20ec4dcf-2700-4c20-928f-c921bf07acb9 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received event network-changed-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:31:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-5c523e16-9832-4cea-8391-08a601e116c8 req-20ec4dcf-2700-4c20-928f-c921bf07acb9 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Refreshing instance network info cache due to event network-changed-4258c97f-0a86-4cf4-ade0-831330204fc8. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:31:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5c523e16-9832-4cea-8391-08a601e116c8 req-20ec4dcf-2700-4c20-928f-c921bf07acb9 service nova] Acquiring lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:31:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5c523e16-9832-4cea-8391-08a601e116c8 req-20ec4dcf-2700-4c20-928f-c921bf07acb9 service nova] Acquired lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:31:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-5c523e16-9832-4cea-8391-08a601e116c8 req-20ec4dcf-2700-4c20-928f-c921bf07acb9 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Refreshing network info cache for port 4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:31:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-5c523e16-9832-4cea-8391-08a601e116c8 req-20ec4dcf-2700-4c20-928f-c921bf07acb9 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Updated VIF entry in instance network info cache for port 4258c97f-0a86-4cf4-ade0-831330204fc8. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:31:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-5c523e16-9832-4cea-8391-08a601e116c8 req-20ec4dcf-2700-4c20-928f-c921bf07acb9 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Updating instance_info_cache with network_info: [{"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:31:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5c523e16-9832-4cea-8391-08a601e116c8 req-20ec4dcf-2700-4c20-928f-c921bf07acb9 service nova] Releasing lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:31:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "93698818-d7ba-4f25-a341-30e5390a829e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:31:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "93698818-d7ba-4f25-a341-30e5390a829e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:31:38 user nova-compute[75571]: INFO nova.compute.manager [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Shelving
Nov 28 20:31:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:38 user nova-compute[75571]: DEBUG nova.compute.manager [req-60606b74-9002-4537-9987-d751942e8fdd req-c4f46dab-d44b-4ba2-961e-42e4375ef5ef service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received event network-vif-unplugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:31:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60606b74-9002-4537-9987-d751942e8fdd req-c4f46dab-d44b-4ba2-961e-42e4375ef5ef service nova] Acquiring lock "93698818-d7ba-4f25-a341-30e5390a829e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:31:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60606b74-9002-4537-9987-d751942e8fdd req-c4f46dab-d44b-4ba2-961e-42e4375ef5ef service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:31:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-60606b74-9002-4537-9987-d751942e8fdd req-c4f46dab-d44b-4ba2-961e-42e4375ef5ef service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:31:38 user nova-compute[75571]: DEBUG nova.compute.manager [req-60606b74-9002-4537-9987-d751942e8fdd req-c4f46dab-d44b-4ba2-961e-42e4375ef5ef service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] No waiting events found dispatching network-vif-unplugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:31:38 user nova-compute[75571]: WARNING nova.compute.manager [req-60606b74-9002-4537-9987-d751942e8fdd req-c4f46dab-d44b-4ba2-961e-42e4375ef5ef service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received unexpected event network-vif-unplugged-4258c97f-0a86-4cf4-ade0-831330204fc8 for instance with vm_state active and task_state shelving.
Nov 28 20:31:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:38 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Instance destroyed successfully.
Nov 28 20:31:38 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Beginning cold snapshot process
Nov 28 20:31:39 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:31:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk /opt/stack/data/nova/instances/snapshots/tmpfgypzqiu/e02da8c7b97c4e9db381965090a99c02 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:31:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk /opt/stack/data/nova/instances/snapshots/tmpfgypzqiu/e02da8c7b97c4e9db381965090a99c02" returned: 0 in 0.775s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:31:39 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Snapshot extracted, beginning image upload
Nov 28 20:31:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-24c8caea-c612-4e64-a85b-c479fc6ca588 req-4ba8bd39-2441-4683-b488-f5cd77d7fa92 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received event network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:31:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-24c8caea-c612-4e64-a85b-c479fc6ca588 req-4ba8bd39-2441-4683-b488-f5cd77d7fa92 service nova] Acquiring lock "93698818-d7ba-4f25-a341-30e5390a829e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:31:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-24c8caea-c612-4e64-a85b-c479fc6ca588 req-4ba8bd39-2441-4683-b488-f5cd77d7fa92 service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:31:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-24c8caea-c612-4e64-a85b-c479fc6ca588 req-4ba8bd39-2441-4683-b488-f5cd77d7fa92 service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:31:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-24c8caea-c612-4e64-a85b-c479fc6ca588 req-4ba8bd39-2441-4683-b488-f5cd77d7fa92 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] No waiting events found dispatching network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:31:40 user nova-compute[75571]: WARNING nova.compute.manager [req-24c8caea-c612-4e64-a85b-c479fc6ca588 req-4ba8bd39-2441-4683-b488-f5cd77d7fa92 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received unexpected event network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 20:31:42 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Snapshot image upload complete
Nov 28 20:31:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:31:42 user nova-compute[75571]: INFO nova.compute.manager [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Shelve offloading
Nov 28 20:31:42 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Instance destroyed successfully.
Nov 28 20:31:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:31:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:31:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquired lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:31:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:31:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Updating instance_info_cache with network_info: [{"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:31:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Releasing lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:31:43 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Instance destroyed successfully.
Nov 28 20:31:43 user nova-compute[75571]: DEBUG nova.objects.instance [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'resources' on Instance uuid 93698818-d7ba-4f25-a341-30e5390a829e {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-795547296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-795547296',id=34,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7x8JUic8LMH/YQT25GlcwZE6wPOyKaJyvQnNWy47RBRoT/KqLjj+kPL9TeFksxFwkD4J4kVT9wKi4NGz2C12ZF7NEOueU54TasYfa+Zk7dRiUyC3kjH5YG1VpVp8Hw2w==',key_name='tempest-keypair-958726701',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:29:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='292cfffce13446c8963785adfb4b9d22',ramdisk_id='',reservation_id='r-pmqejehf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1442792072',owner_user_name='tempest-AttachVolumeShelveTestJSON-1442792072-project-member',shelved_at='2023-11-28T20:31:42.119587',shelved_host='user',shelved_image_id='7a0c8aa3-9cf2-4817-9668-062716fa7e9e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e21afd3261f4b1a87f7cbb4348fc9fe',uuid=93698818-d7ba-4f25-a341-30e5390a829e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converting VIF {"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:11:32,bridge_name='br-int',has_traffic_filtering=True,id=4258c97f-0a86-4cf4-ade0-831330204fc8,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4258c97f-0a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG os_vif [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:11:32,bridge_name='br-int',has_traffic_filtering=True,id=4258c97f-0a86-4cf4-ade0-831330204fc8,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4258c97f-0a') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4258c97f-0a, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8575c818-1ea5-432d-8e76-2c1e8f377176) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-c242fc2e-a873-4f81-aac8-e8906f3719b8 req-0496527f-00d4-454c-9fcb-ae05c8b64793 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received event network-changed-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-c242fc2e-a873-4f81-aac8-e8906f3719b8 req-0496527f-00d4-454c-9fcb-ae05c8b64793 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Refreshing instance network info cache due to event network-changed-4258c97f-0a86-4cf4-ade0-831330204fc8. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c242fc2e-a873-4f81-aac8-e8906f3719b8 req-0496527f-00d4-454c-9fcb-ae05c8b64793 service nova] Acquiring lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c242fc2e-a873-4f81-aac8-e8906f3719b8 req-0496527f-00d4-454c-9fcb-ae05c8b64793 service nova] Acquired lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG nova.network.neutron [req-c242fc2e-a873-4f81-aac8-e8906f3719b8 req-0496527f-00d4-454c-9fcb-ae05c8b64793 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Refreshing network info cache for port 4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:31:43 user nova-compute[75571]: INFO os_vif [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:11:32,bridge_name='br-int',has_traffic_filtering=True,id=4258c97f-0a86-4cf4-ade0-831330204fc8,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4258c97f-0a')
Nov 28 20:31:43 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Deleting instance files /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e_del
Nov 28 20:31:43 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Deletion of /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e_del complete
Nov 28 20:31:43 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Deleted allocations for instance 93698818-d7ba-4f25-a341-30e5390a829e
Nov 28 20:31:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG nova.objects.instance [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'numa_topology' on Instance uuid 93698818-d7ba-4f25-a341-30e5390a829e {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG nova.objects.base [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Object Instance<93698818-d7ba-4f25-a341-30e5390a829e> lazy-loaded attributes: resources,numa_topology {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:31:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "93698818-d7ba-4f25-a341-30e5390a829e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.766s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:31:44 user nova-compute[75571]: DEBUG nova.network.neutron [req-c242fc2e-a873-4f81-aac8-e8906f3719b8 req-0496527f-00d4-454c-9fcb-ae05c8b64793 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Updated VIF entry in instance network info cache for port 4258c97f-0a86-4cf4-ade0-831330204fc8. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:31:44 user nova-compute[75571]: DEBUG nova.network.neutron [req-c242fc2e-a873-4f81-aac8-e8906f3719b8 req-0496527f-00d4-454c-9fcb-ae05c8b64793 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Updating instance_info_cache with network_info: [{"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4258c97f-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:31:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c242fc2e-a873-4f81-aac8-e8906f3719b8 req-0496527f-00d4-454c-9fcb-ae05c8b64793 service nova] Releasing lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:31:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:31:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:04 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:32:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:09 user nova-compute[75571]: INFO nova.compute.manager [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Rescuing
Nov 28 20:32:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:32:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquired lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:32:09 user nova-compute[75571]: DEBUG nova.network.neutron [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG nova.network.neutron [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Updating instance_info_cache with network_info: [{"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Releasing lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-ac066656-80c8-40be-8c86-a00ca9ceb060 req-5bd2fe55-cd8a-4eed-be61-c8d321cbf8fb service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received event network-vif-unplugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ac066656-80c8-40be-8c86-a00ca9ceb060 req-5bd2fe55-cd8a-4eed-be61-c8d321cbf8fb service nova] Acquiring lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ac066656-80c8-40be-8c86-a00ca9ceb060 req-5bd2fe55-cd8a-4eed-be61-c8d321cbf8fb service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ac066656-80c8-40be-8c86-a00ca9ceb060 req-5bd2fe55-cd8a-4eed-be61-c8d321cbf8fb service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-ac066656-80c8-40be-8c86-a00ca9ceb060 req-5bd2fe55-cd8a-4eed-be61-c8d321cbf8fb service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] No waiting events found dispatching network-vif-unplugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:32:10 user nova-compute[75571]: WARNING nova.compute.manager [req-ac066656-80c8-40be-8c86-a00ca9ceb060 req-5bd2fe55-cd8a-4eed-be61-c8d321cbf8fb service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received unexpected event network-vif-unplugged-ca71d400-500b-4d9b-9141-67afb25ac98d for instance with vm_state active and task_state rescuing.
Nov 28 20:32:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:10 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Instance destroyed successfully.
Nov 28 20:32:10 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Attempting rescue
Nov 28 20:32:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75571) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Instance directory exists: not creating {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 20:32:10 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Creating image(s)
Nov 28 20:32:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "/opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "/opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "/opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG nova.objects.instance [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'trusted_certs' on Instance uuid def2369e-4d57-482b-aef9-dab7c3a7cb84 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue" returned: 0 in 0.050s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.objects.instance [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'migration_context' on Instance uuid def2369e-4d57-482b-aef9-dab7c3a7cb84 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.objects.base [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Object Instance<def2369e-4d57-482b-aef9-dab7c3a7cb84> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Start _get_guest_xml network_info=[{"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "vif_mac": "fa:16:3e:4c:61:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '77b9e284-7155-4207-b748-934c25ce18d0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.objects.instance [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'resources' on Instance uuid def2369e-4d57-482b-aef9-dab7c3a7cb84 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.objects.base [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Object Instance<def2369e-4d57-482b-aef9-dab7c3a7cb84> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.objects.instance [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'numa_topology' on Instance uuid def2369e-4d57-482b-aef9-dab7c3a7cb84 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.objects.base [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Object Instance<def2369e-4d57-482b-aef9-dab7c3a7cb84> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:32:11 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:32:11 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.objects.instance [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'vcpu_model' on Instance uuid def2369e-4d57-482b-aef9-dab7c3a7cb84 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.objects.base [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Object Instance<def2369e-4d57-482b-aef9-dab7c3a7cb84> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:30:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1606228576',display_name='tempest-ServerRescueNegativeTestJSON-server-1606228576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1606228576',id=36,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:30:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d72dc075421c4e7eb9c0ff2bf1641a92',ramdisk_id='',reservation_id='r-s7rpgbpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-506941201',owner_user_name='tempest-ServerRescueNegativeTestJSON-506941201-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:30:28Z,user_data=None,user_id='634123644067453a92f4d43da0b28fa7',uuid=def2369e-4d57-482b-aef9-dab7c3a7cb84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "vif_mac": "fa:16:3e:4c:61:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converting VIF {"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "vif_mac": "fa:16:3e:4c:61:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:61:d8,bridge_name='br-int',has_traffic_filtering=True,id=ca71d400-500b-4d9b-9141-67afb25ac98d,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca71d400-50') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.objects.instance [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'pci_devices' on Instance uuid def2369e-4d57-482b-aef9-dab7c3a7cb84 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.objects.base [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Object Instance<def2369e-4d57-482b-aef9-dab7c3a7cb84> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:32:11 user nova-compute[75571]:   <uuid>def2369e-4d57-482b-aef9-dab7c3a7cb84</uuid>
Nov 28 20:32:11 user nova-compute[75571]:   <name>instance-00000024</name>
Nov 28 20:32:11 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:32:11 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:32:11 user nova-compute[75571]:   <metadata>
Nov 28 20:32:11 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:32:11 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:32:11 user nova-compute[75571]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1606228576</nova:name>
Nov 28 20:32:11 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:32:11</nova:creationTime>
Nov 28 20:32:11 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:32:11 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:32:11 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:32:11 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:32:11 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:32:11 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:32:11 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:32:11 user nova-compute[75571]:       <nova:owner>
Nov 28 20:32:11 user nova-compute[75571]:         <nova:user uuid="634123644067453a92f4d43da0b28fa7">tempest-ServerRescueNegativeTestJSON-506941201-project-member</nova:user>
Nov 28 20:32:11 user nova-compute[75571]:         <nova:project uuid="d72dc075421c4e7eb9c0ff2bf1641a92">tempest-ServerRescueNegativeTestJSON-506941201</nova:project>
Nov 28 20:32:11 user nova-compute[75571]:       </nova:owner>
Nov 28 20:32:11 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:32:11 user nova-compute[75571]:       <nova:ports>
Nov 28 20:32:11 user nova-compute[75571]:         <nova:port uuid="ca71d400-500b-4d9b-9141-67afb25ac98d">
Nov 28 20:32:11 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 20:32:11 user nova-compute[75571]:         </nova:port>
Nov 28 20:32:11 user nova-compute[75571]:       </nova:ports>
Nov 28 20:32:11 user nova-compute[75571]:     </nova:instance>
Nov 28 20:32:11 user nova-compute[75571]:   </metadata>
Nov 28 20:32:11 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:32:11 user nova-compute[75571]:     <system>
Nov 28 20:32:11 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:32:11 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:32:11 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:32:11 user nova-compute[75571]:       <entry name="serial">def2369e-4d57-482b-aef9-dab7c3a7cb84</entry>
Nov 28 20:32:11 user nova-compute[75571]:       <entry name="uuid">def2369e-4d57-482b-aef9-dab7c3a7cb84</entry>
Nov 28 20:32:11 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:32:11 user nova-compute[75571]:     </system>
Nov 28 20:32:11 user nova-compute[75571]:   </sysinfo>
Nov 28 20:32:11 user nova-compute[75571]:   <os>
Nov 28 20:32:11 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:32:11 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:32:11 user nova-compute[75571]:   </os>
Nov 28 20:32:11 user nova-compute[75571]:   <features>
Nov 28 20:32:11 user nova-compute[75571]:     <acpi/>
Nov 28 20:32:11 user nova-compute[75571]:     <apic/>
Nov 28 20:32:11 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:32:11 user nova-compute[75571]:   </features>
Nov 28 20:32:11 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:32:11 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:32:11 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:32:11 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:32:11 user nova-compute[75571]:   </clock>
Nov 28 20:32:11 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:32:11 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:32:11 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:32:11 user nova-compute[75571]:   </cpu>
Nov 28 20:32:11 user nova-compute[75571]:   <devices>
Nov 28 20:32:11 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:32:11 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:32:11 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue"/>
Nov 28 20:32:11 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:32:11 user nova-compute[75571]:     </disk>
Nov 28 20:32:11 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:32:11 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:32:11 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk"/>
Nov 28 20:32:11 user nova-compute[75571]:       <target dev="vdb" bus="virtio"/>
Nov 28 20:32:11 user nova-compute[75571]:     </disk>
Nov 28 20:32:11 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:32:11 user nova-compute[75571]:       <mac address="fa:16:3e:4c:61:d8"/>
Nov 28 20:32:11 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:32:11 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:32:11 user nova-compute[75571]:       <target dev="tapca71d400-50"/>
Nov 28 20:32:11 user nova-compute[75571]:     </interface>
Nov 28 20:32:11 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:32:11 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/console.log" append="off"/>
Nov 28 20:32:11 user nova-compute[75571]:     </serial>
Nov 28 20:32:11 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:32:11 user nova-compute[75571]:     <video>
Nov 28 20:32:11 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:32:11 user nova-compute[75571]:     </video>
Nov 28 20:32:11 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:32:11 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:32:11 user nova-compute[75571]:     </rng>
Nov 28 20:32:11 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:32:11 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:32:11 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:32:11 user nova-compute[75571]:     </memballoon>
Nov 28 20:32:11 user nova-compute[75571]:   </devices>
Nov 28 20:32:11 user nova-compute[75571]: </domain>
Nov 28 20:32:11 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:32:11 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Instance destroyed successfully.
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:32:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No VIF found with MAC fa:16:3e:4c:61:d8, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:12 user nova-compute[75571]: INFO nova.compute.manager [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Detaching volume 564f704c-2c1e-45f6-b1a6-ed05d4ee8f15
Nov 28 20:32:12 user nova-compute[75571]: INFO nova.virt.block_device [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Attempting to driver detach volume 564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 from mountpoint /dev/vdb
Nov 28 20:32:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Attempting to detach device vdb from instance 636a8f00-7685-4c1b-9404-cf16359dd08a from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:32:12 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:32:12 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:32:12 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:32:12 user nova-compute[75571]:   <serial>564f704c-2c1e-45f6-b1a6-ed05d4ee8f15</serial>
Nov 28 20:32:12 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 20:32:12 user nova-compute[75571]: </disk>
Nov 28 20:32:12 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:12 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Successfully detached device vdb from instance 636a8f00-7685-4c1b-9404-cf16359dd08a from the persistent domain config.
Nov 28 20:32:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 636a8f00-7685-4c1b-9404-cf16359dd08a from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:32:12 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:32:12 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:32:12 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:32:12 user nova-compute[75571]:   <serial>564f704c-2c1e-45f6-b1a6-ed05d4ee8f15</serial>
Nov 28 20:32:12 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 20:32:12 user nova-compute[75571]: </disk>
Nov 28 20:32:12 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-51023118-5a5a-406f-a7d8-3a8ae0d2f97c req-8686df1b-76c7-4eeb-8301-6166bbeeaccb service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received event network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-51023118-5a5a-406f-a7d8-3a8ae0d2f97c req-8686df1b-76c7-4eeb-8301-6166bbeeaccb service nova] Acquiring lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-51023118-5a5a-406f-a7d8-3a8ae0d2f97c req-8686df1b-76c7-4eeb-8301-6166bbeeaccb service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-51023118-5a5a-406f-a7d8-3a8ae0d2f97c req-8686df1b-76c7-4eeb-8301-6166bbeeaccb service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-51023118-5a5a-406f-a7d8-3a8ae0d2f97c req-8686df1b-76c7-4eeb-8301-6166bbeeaccb service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] No waiting events found dispatching network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:32:12 user nova-compute[75571]: WARNING nova.compute.manager [req-51023118-5a5a-406f-a7d8-3a8ae0d2f97c req-8686df1b-76c7-4eeb-8301-6166bbeeaccb service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received unexpected event network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d for instance with vm_state active and task_state rescuing.
Nov 28 20:32:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Updating instance_info_cache with network_info: [{"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:32:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:32:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:32:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:32:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:32:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 20:32:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] There are 0 instances to clean {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 20:32:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:32:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received event network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] Acquiring lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] No waiting events found dispatching network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:32:14 user nova-compute[75571]: WARNING nova.compute.manager [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received unexpected event network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d for instance with vm_state active and task_state rescuing.
Nov 28 20:32:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received event network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] Acquiring lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] No waiting events found dispatching network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:32:14 user nova-compute[75571]: WARNING nova.compute.manager [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received unexpected event network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d for instance with vm_state active and task_state rescuing.
Nov 28 20:32:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:15 user nova-compute[75571]: DEBUG nova.compute.manager [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:32:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:32:15 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:32:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:18 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:32:18 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8235MB free_disk=24.783443450927734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 313a065e-94f3-4435-97af-6a16de64ca7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e6f2a651-b10a-45f4-8f94-6a4426654a86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 636a8f00-7685-4c1b-9404-cf16359dd08a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 136d54f3-eb9a-46fc-8b5f-318b68500804 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing inventories for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating ProviderTree inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing aggregate associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, aggregates: None {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 20:32:18 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing trait associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 20:32:19 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:32:19 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:32:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:32:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.662s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:19 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:32:19 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75571) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 20:32:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "136d54f3-eb9a-46fc-8b5f-318b68500804" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG nova.objects.instance [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'flavor' on Instance uuid 136d54f3-eb9a-46fc-8b5f-318b68500804 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "136d54f3-eb9a-46fc-8b5f-318b68500804" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:28 user nova-compute[75571]: INFO nova.compute.manager [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Attaching volume 851647b5-5c40-45e4-bfa4-8dc829d269f4 to /dev/vdb
Nov 28 20:32:28 user nova-compute[75571]: DEBUG os_brick.utils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81501a5-7733-487e-a9ee-b37397081d44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa35dd03-a6cc-4c1e-b64a-7d68488e6975]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[340ee619-d04e-439e-ae79-4cf0dc5756ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bd180d-216e-4eff-9adf-e1794987428c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:32:28 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:32:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[97449206-31e5-46f8-a1f3-6eec626deca8]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG os_brick.utils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:32:28 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Updating existing volume attachment record: 8aa5d7ce-bc48-4c2d-86f8-7ae15ca9add3 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:32:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:30 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:32:33 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 636a8f00-7685-4c1b-9404-cf16359dd08a is timed out.
Nov 28 20:32:33 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Successfully detached device vdb from instance 636a8f00-7685-4c1b-9404-cf16359dd08a from the live domain config.
Nov 28 20:32:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqZWzSIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:32:33 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9add1dce-1e21-4ed8-af10-e93dd307aea9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:32:33 user nova-compute[75571]: No targets found.
Nov 28 20:32:33 user nova-compute[75571]: iSNS:
Nov 28 20:32:33 user nova-compute[75571]: No targets found.
Nov 28 20:32:33 user nova-compute[75571]: STATIC:
Nov 28 20:32:33 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e
Nov 28 20:32:33 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:32:33 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:32:33 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15
Nov 28 20:32:33 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:32:33 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:32:33 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:32:33 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:32:33 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:32:33 user nova-compute[75571]: FIRMWARE:
Nov 28 20:32:33 user nova-compute[75571]: No targets found.
Nov 28 20:32:33 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:32:33 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:32:33 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe03c51-2b31-4f6a-b4d0-b84799338826]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29c6a88-fb15-455c-9c91-da261c532fd8]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:32:33 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:32:33 user nova-compute[75571]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:32:33 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:32:33 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:32:33 user nova-compute[75571]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 (non-flash)
Nov 28 20:32:33 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77687f1510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15'): ({'sdc'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Removing single pathed devices sdc {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc395c18-35b0-4133-88ff-58512e149135]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe234bd-3aef-40eb-a656-f82591cdf8d2]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flushing IO for device /dev/sdc {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18d36fa-2498-4ace-9c01-d762297f0a72]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffadae7c-2506-4894-b58f-8041b6bd0384]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec87cc0a-d61f-4ce5-a06d-292f35d0ceb9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d464da1-137e-4e5e-8f82-0a826652496e]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260]
Nov 28 20:32:33 user nova-compute[75571]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15, portal: 172.16.0.220,3260] successful.
Nov 28 20:32:33 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae57ff5-3703-4db7-a6e4-e3e83d143aea]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] <== disconnect_volume: return (312ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:32:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:34 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'flavor' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:32:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.907s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-14793024-c7d9-4e9a-b03f-8c3dffc4794d tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-14793024-c7d9-4e9a-b03f-8c3dffc4794d tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:34 user nova-compute[75571]: DEBUG nova.compute.manager [None req-14793024-c7d9-4e9a-b03f-8c3dffc4794d tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:32:34 user nova-compute[75571]: DEBUG nova.compute.manager [None req-14793024-c7d9-4e9a-b03f-8c3dffc4794d tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75571) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 20:32:34 user nova-compute[75571]: DEBUG nova.objects.instance [None req-14793024-c7d9-4e9a-b03f-8c3dffc4794d tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'flavor' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-22882186-eb4a-4a01-ac0e-f53ee637f4b7 req-844c1554-8c7b-425b-a7e6-add7afc000a9 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-unplugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-22882186-eb4a-4a01-ac0e-f53ee637f4b7 req-844c1554-8c7b-425b-a7e6-add7afc000a9 service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-22882186-eb4a-4a01-ac0e-f53ee637f4b7 req-844c1554-8c7b-425b-a7e6-add7afc000a9 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-22882186-eb4a-4a01-ac0e-f53ee637f4b7 req-844c1554-8c7b-425b-a7e6-add7afc000a9 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-22882186-eb4a-4a01-ac0e-f53ee637f4b7 req-844c1554-8c7b-425b-a7e6-add7afc000a9 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-unplugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:32:35 user nova-compute[75571]: WARNING nova.compute.manager [req-22882186-eb4a-4a01-ac0e-f53ee637f4b7 req-844c1554-8c7b-425b-a7e6-add7afc000a9 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-unplugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state active and task_state powering-off.
Nov 28 20:32:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:35 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Instance destroyed successfully.
Nov 28 20:32:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-14793024-c7d9-4e9a-b03f-8c3dffc4794d tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RrDmdGix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:32:35 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:32:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:32:35 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:32:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:32:35 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cbe46d-3b38-4637-a25c-5777fb3b434f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:32:35 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71ba891-2b6e-40a0-a2b3-d7f80bfd035a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4] added
Nov 28 20:32:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-14793024-c7d9-4e9a-b03f-8c3dffc4794d tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.846s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[562f0619-63fe-4211-9150-979550ae66a3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[46687dcb-d1f7-4be5-8a69-f669ab190bfa]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RrDmdGix {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RrDmdGix" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[511106a3-a46e-4dd7-a20f-00171f11c58f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RrDmdGix'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aa58fd-73b0-43bf-8e85-b5a0d0233b65]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4c9610-49ba-4b2e-91a4-42dac18eafee]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:32:35 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:32:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:32:35 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:32:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde6d9cc-6954-4eb5-af0a-ca1cfbe19c23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4, portal: 172.16.0.220,3260]
Nov 28 20:32:35 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4, portal: 172.16.0.220,3260] successful.
Nov 28 20:32:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:32:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[12917c68-4ba3-41c8-9b91-915ec089926e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaa228b-30f9-499b-bf91-731b9d2ce0e6]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:32:36 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:32:36 user nova-compute[75571]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 (non-flash)
Nov 28 20:32:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:32:36 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:32:36 user nova-compute[75571]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 (non-flash)
Nov 28 20:32:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[522e821d-f0d9-403d-8d33-702e952f2b3e]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:32:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RrDmdGix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:32:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:32:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23337313733393862', 'path': '/dev/sdc'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:32:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337313733393862', 'path': '/dev/sdc'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:32:37 user nova-compute[75571]: DEBUG nova.objects.instance [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'flavor' on Instance uuid 136d54f3-eb9a-46fc-8b5f-318b68500804 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:32:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:32:37 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:32:37 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:32:37 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:32:37 user nova-compute[75571]:   <serial>851647b5-5c40-45e4-bfa4-8dc829d269f4</serial>
Nov 28 20:32:37 user nova-compute[75571]: </disk>
Nov 28 20:32:37 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:32:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-b01879ca-af3d-45e0-bb3d-40f398c483b0 req-6f04cb73-c4aa-4559-9df7-6b34bcc3dc17 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b01879ca-af3d-45e0-bb3d-40f398c483b0 req-6f04cb73-c4aa-4559-9df7-6b34bcc3dc17 service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b01879ca-af3d-45e0-bb3d-40f398c483b0 req-6f04cb73-c4aa-4559-9df7-6b34bcc3dc17 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b01879ca-af3d-45e0-bb3d-40f398c483b0 req-6f04cb73-c4aa-4559-9df7-6b34bcc3dc17 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-b01879ca-af3d-45e0-bb3d-40f398c483b0 req-6f04cb73-c4aa-4559-9df7-6b34bcc3dc17 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:32:37 user nova-compute[75571]: WARNING nova.compute.manager [req-b01879ca-af3d-45e0-bb3d-40f398c483b0 req-6f04cb73-c4aa-4559-9df7-6b34bcc3dc17 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state stopped and task_state None.
Nov 28 20:32:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:32:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:32:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] No VIF found with MAC fa:16:3e:3c:93:46, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:32:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.933s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-4d6ba0a5-184b-482d-a88f-81164165b4b7 req-33e13ee7-7a6a-40b1-85df-1fa13c59fbe0 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received event network-changed-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-4d6ba0a5-184b-482d-a88f-81164165b4b7 req-33e13ee7-7a6a-40b1-85df-1fa13c59fbe0 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Refreshing instance network info cache due to event network-changed-48a201ba-2910-4d94-b7a9-ac3878402adf. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:32:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4d6ba0a5-184b-482d-a88f-81164165b4b7 req-33e13ee7-7a6a-40b1-85df-1fa13c59fbe0 service nova] Acquiring lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:32:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4d6ba0a5-184b-482d-a88f-81164165b4b7 req-33e13ee7-7a6a-40b1-85df-1fa13c59fbe0 service nova] Acquired lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:32:40 user nova-compute[75571]: DEBUG nova.network.neutron [req-4d6ba0a5-184b-482d-a88f-81164165b4b7 req-33e13ee7-7a6a-40b1-85df-1fa13c59fbe0 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Refreshing network info cache for port 48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:32:40 user nova-compute[75571]: DEBUG nova.network.neutron [req-4d6ba0a5-184b-482d-a88f-81164165b4b7 req-33e13ee7-7a6a-40b1-85df-1fa13c59fbe0 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Updated VIF entry in instance network info cache for port 48a201ba-2910-4d94-b7a9-ac3878402adf. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:32:40 user nova-compute[75571]: DEBUG nova.network.neutron [req-4d6ba0a5-184b-482d-a88f-81164165b4b7 req-33e13ee7-7a6a-40b1-85df-1fa13c59fbe0 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Updating instance_info_cache with network_info: [{"id": "48a201ba-2910-4d94-b7a9-ac3878402adf", "address": "fa:16:3e:3c:93:46", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a201ba-29", "ovs_interfaceid": "48a201ba-2910-4d94-b7a9-ac3878402adf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:32:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4d6ba0a5-184b-482d-a88f-81164165b4b7 req-33e13ee7-7a6a-40b1-85df-1fa13c59fbe0 service nova] Releasing lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:32:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-929018f4-7f08-4a52-90a7-5376972ec863 req-e90e3af5-0702-4fc1-a1c0-668dc7df18cc service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received event network-changed-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-929018f4-7f08-4a52-90a7-5376972ec863 req-e90e3af5-0702-4fc1-a1c0-668dc7df18cc service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Refreshing instance network info cache due to event network-changed-48a201ba-2910-4d94-b7a9-ac3878402adf. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:32:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-929018f4-7f08-4a52-90a7-5376972ec863 req-e90e3af5-0702-4fc1-a1c0-668dc7df18cc service nova] Acquiring lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:32:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-929018f4-7f08-4a52-90a7-5376972ec863 req-e90e3af5-0702-4fc1-a1c0-668dc7df18cc service nova] Acquired lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:32:42 user nova-compute[75571]: DEBUG nova.network.neutron [req-929018f4-7f08-4a52-90a7-5376972ec863 req-e90e3af5-0702-4fc1-a1c0-668dc7df18cc service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Refreshing network info cache for port 48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:32:43 user nova-compute[75571]: DEBUG nova.network.neutron [req-929018f4-7f08-4a52-90a7-5376972ec863 req-e90e3af5-0702-4fc1-a1c0-668dc7df18cc service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Updated VIF entry in instance network info cache for port 48a201ba-2910-4d94-b7a9-ac3878402adf. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:32:43 user nova-compute[75571]: DEBUG nova.network.neutron [req-929018f4-7f08-4a52-90a7-5376972ec863 req-e90e3af5-0702-4fc1-a1c0-668dc7df18cc service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Updating instance_info_cache with network_info: [{"id": "48a201ba-2910-4d94-b7a9-ac3878402adf", "address": "fa:16:3e:3c:93:46", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a201ba-29", "ovs_interfaceid": "48a201ba-2910-4d94-b7a9-ac3878402adf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:32:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-929018f4-7f08-4a52-90a7-5376972ec863 req-e90e3af5-0702-4fc1-a1c0-668dc7df18cc service nova] Releasing lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:32:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "136d54f3-eb9a-46fc-8b5f-318b68500804" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:43 user nova-compute[75571]: INFO nova.compute.manager [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Rebooting instance
Nov 28 20:32:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:32:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquired lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:32:43 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:32:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:43 user nova-compute[75571]: DEBUG nova.network.neutron [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Updating instance_info_cache with network_info: [{"id": "48a201ba-2910-4d94-b7a9-ac3878402adf", "address": "fa:16:3e:3c:93:46", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a201ba-29", "ovs_interfaceid": "48a201ba-2910-4d94-b7a9-ac3878402adf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:32:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Releasing lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:32:43 user nova-compute[75571]: DEBUG nova.compute.manager [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:32:44 user nova-compute[75571]: INFO nova.compute.manager [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Unrescuing
Nov 28 20:32:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "refresh_cache-5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:32:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquired lock "refresh_cache-5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:32:44 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:32:44 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Updating instance_info_cache with network_info: [{"id": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "address": "fa:16:3e:a1:20:af", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaded16b1-1b", "ovs_interfaceid": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:32:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Releasing lock "refresh_cache-5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:32:44 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'flavor' on Instance uuid 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:32:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:44 user nova-compute[75571]: DEBUG nova.compute.manager [req-76fffea7-2b69-4a30-96ca-d97fb8c7896e req-389cf9d1-9a65-4320-95f7-6f33bf50c771 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received event network-vif-unplugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-76fffea7-2b69-4a30-96ca-d97fb8c7896e req-389cf9d1-9a65-4320-95f7-6f33bf50c771 service nova] Acquiring lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-76fffea7-2b69-4a30-96ca-d97fb8c7896e req-389cf9d1-9a65-4320-95f7-6f33bf50c771 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-76fffea7-2b69-4a30-96ca-d97fb8c7896e req-389cf9d1-9a65-4320-95f7-6f33bf50c771 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:44 user nova-compute[75571]: DEBUG nova.compute.manager [req-76fffea7-2b69-4a30-96ca-d97fb8c7896e req-389cf9d1-9a65-4320-95f7-6f33bf50c771 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] No waiting events found dispatching network-vif-unplugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:32:44 user nova-compute[75571]: WARNING nova.compute.manager [req-76fffea7-2b69-4a30-96ca-d97fb8c7896e req-389cf9d1-9a65-4320-95f7-6f33bf50c771 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received unexpected event network-vif-unplugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:32:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:45 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Instance destroyed successfully.
Nov 28 20:32:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:46 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Instance shutdown successfully.
Nov 28 20:32:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Acquiring lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] No waiting events found dispatching network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:32:46 user nova-compute[75571]: WARNING nova.compute.manager [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received unexpected event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:32:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received event network-vif-unplugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Acquiring lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] No waiting events found dispatching network-vif-unplugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:32:46 user nova-compute[75571]: WARNING nova.compute.manager [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received unexpected event network-vif-unplugged-48a201ba-2910-4d94-b7a9-ac3878402adf for instance with vm_state active and task_state reboot_started.
Nov 28 20:32:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received event network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Acquiring lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] No waiting events found dispatching network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:32:46 user nova-compute[75571]: WARNING nova.compute.manager [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received unexpected event network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf for instance with vm_state active and task_state reboot_started.
Nov 28 20:32:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Acquiring lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] No waiting events found dispatching network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:32:49 user nova-compute[75571]: WARNING nova.compute.manager [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received unexpected event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:32:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Acquiring lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] No waiting events found dispatching network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:32:49 user nova-compute[75571]: WARNING nova.compute.manager [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received unexpected event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:32:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received event network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Acquiring lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] No waiting events found dispatching network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:32:49 user nova-compute[75571]: WARNING nova.compute.manager [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received unexpected event network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf for instance with vm_state active and task_state reboot_started.
Nov 28 20:32:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received event network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Acquiring lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] No waiting events found dispatching network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:32:49 user nova-compute[75571]: WARNING nova.compute.manager [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received unexpected event network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf for instance with vm_state active and task_state reboot_started.
Nov 28 20:32:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:50 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:32:50 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Instance running successfully.
Nov 28 20:32:50 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Instance soft rebooted successfully.
Nov 28 20:32:50 user nova-compute[75571]: DEBUG nova.compute.manager [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:32:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.523s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:32:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:32:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:33:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:33:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:11 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:33:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:33:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:33:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:33:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:33:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:33:13 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:33:13 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:33:13 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Updating instance_info_cache with network_info: [{"id": "fc196680-3f93-4710-b508-752c9aa39f18", "address": "fa:16:3e:44:80:a9", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc196680-3f", "ovs_interfaceid": "fc196680-3f93-4710-b508-752c9aa39f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:33:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:33:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:33:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:33:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:33:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:33:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:33:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:15 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:33:15 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:33:16 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:33:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:33:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:33:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:33:16 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:33:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:33:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:33:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:33:19 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:33:19 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:33:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8177MB free_disk=24.781394958496094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 313a065e-94f3-4435-97af-6a16de64ca7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e6f2a651-b10a-45f4-8f94-6a4426654a86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 636a8f00-7685-4c1b-9404-cf16359dd08a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 136d54f3-eb9a-46fc-8b5f-318b68500804 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:33:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:33:29 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "93698818-d7ba-4f25-a341-30e5390a829e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "93698818-d7ba-4f25-a341-30e5390a829e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:33:30 user nova-compute[75571]: INFO nova.compute.manager [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Unshelving
Nov 28 20:33:30 user nova-compute[75571]: INFO nova.virt.block_device [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Booting with volume a4ee6c09-63e2-482f-bdbd-db3e6b99273d at /dev/vdc
Nov 28 20:33:30 user nova-compute[75571]: DEBUG os_brick.utils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa487f39-b57d-4665-826c-daa689070202]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ceae4b3-cfea-41a6-9852-6fbb5ad8d914]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2dba46-d152-4a26-8943-79bee29ec840]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b2d63c-dfb0-4135-a63a-6763c588375e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:33:30 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:33:30 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5971b60d-1031-4551-91ff-88ba6ad98a41]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG os_brick.utils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:33:30 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Updating existing volume attachment record: b993e7d4-fe48-433a-b48c-d9df7d77f8ff {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:33:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:33:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:33:37 user nova-compute[75571]: DEBUG nova.objects.instance [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'pci_requests' on Instance uuid 93698818-d7ba-4f25-a341-30e5390a829e {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:33:37 user nova-compute[75571]: DEBUG nova.objects.instance [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'numa_topology' on Instance uuid 93698818-d7ba-4f25-a341-30e5390a829e {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:33:37 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:33:37 user nova-compute[75571]: INFO nova.compute.claims [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Claim successful on node user
Nov 28 20:33:38 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:33:38 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:33:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:33:38 user nova-compute[75571]: INFO nova.network.neutron [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Updating port 4258c97f-0a86-4cf4-ade0-831330204fc8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 20:33:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:33:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:33:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:33:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:33:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:33:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquired lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:33:38 user nova-compute[75571]: DEBUG nova.network.neutron [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:33:38 user nova-compute[75571]: DEBUG nova.compute.manager [req-82eafd4e-a52e-454c-b9c9-ab611b99b690 req-5a09e3a6-714e-4124-9b79-08b7d0d61f7c service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received event network-changed-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:33:38 user nova-compute[75571]: DEBUG nova.compute.manager [req-82eafd4e-a52e-454c-b9c9-ab611b99b690 req-5a09e3a6-714e-4124-9b79-08b7d0d61f7c service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Refreshing instance network info cache due to event network-changed-4258c97f-0a86-4cf4-ade0-831330204fc8. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:33:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-82eafd4e-a52e-454c-b9c9-ab611b99b690 req-5a09e3a6-714e-4124-9b79-08b7d0d61f7c service nova] Acquiring lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:33:39 user nova-compute[75571]: DEBUG nova.network.neutron [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Updating instance_info_cache with network_info: [{"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:33:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Releasing lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:33:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:33:39 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Creating image(s)
Nov 28 20:33:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "/opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:33:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "/opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:33:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "/opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:33:39 user nova-compute[75571]: DEBUG nova.objects.instance [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'trusted_certs' on Instance uuid 93698818-d7ba-4f25-a341-30e5390a829e {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:33:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-82eafd4e-a52e-454c-b9c9-ab611b99b690 req-5a09e3a6-714e-4124-9b79-08b7d0d61f7c service nova] Acquired lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:33:39 user nova-compute[75571]: DEBUG nova.network.neutron [req-82eafd4e-a52e-454c-b9c9-ab611b99b690 req-5a09e3a6-714e-4124-9b79-08b7d0d61f7c service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Refreshing network info cache for port 4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:33:39 user nova-compute[75571]: DEBUG nova.objects.base [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Object Instance<93698818-d7ba-4f25-a341-30e5390a829e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:33:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "0e74b078f3fcca0cfbae7446013bda930cad9fda" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:33:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "0e74b078f3fcca0cfbae7446013bda930cad9fda" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:33:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda.part --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda.part --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:40 user nova-compute[75571]: DEBUG nova.virt.images [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 7a0c8aa3-9cf2-4817-9668-062716fa7e9e was qcow2, converting to raw {{(pid=75571) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 20:33:40 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:33:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda.part /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda.converted {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:40 user nova-compute[75571]: DEBUG nova.network.neutron [req-82eafd4e-a52e-454c-b9c9-ab611b99b690 req-5a09e3a6-714e-4124-9b79-08b7d0d61f7c service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Updated VIF entry in instance network info cache for port 4258c97f-0a86-4cf4-ade0-831330204fc8. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:33:40 user nova-compute[75571]: DEBUG nova.network.neutron [req-82eafd4e-a52e-454c-b9c9-ab611b99b690 req-5a09e3a6-714e-4124-9b79-08b7d0d61f7c service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Updating instance_info_cache with network_info: [{"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:33:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-82eafd4e-a52e-454c-b9c9-ab611b99b690 req-5a09e3a6-714e-4124-9b79-08b7d0d61f7c service nova] Releasing lock "refresh_cache-93698818-d7ba-4f25-a341-30e5390a829e" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:33:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda.part /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda.converted" returned: 0 in 0.544s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda.converted --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "0e74b078f3fcca0cfbae7446013bda930cad9fda" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.900s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda --force-share --output=json" returned: 0 in 0.166s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "0e74b078f3fcca0cfbae7446013bda930cad9fda" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "0e74b078f3fcca0cfbae7446013bda930cad9fda" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda,backing_fmt=raw /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda,backing_fmt=raw /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk 1073741824" returned: 0 in 0.049s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "0e74b078f3fcca0cfbae7446013bda930cad9fda" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG nova.objects.instance [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'migration_context' on Instance uuid 93698818-d7ba-4f25-a341-30e5390a829e {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG nova.objects.base [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Object Instance<93698818-d7ba-4f25-a341-30e5390a829e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:33:41 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Rebasing disk image.
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.168s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b -F raw /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b -F raw /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk" returned: 0 in 2.388s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Ensure instance console log exists: /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Start _get_guest_xml network_info=[{"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='a67bc6bcf540ec94ede3815bbb5a16c8',container_format='bare',created_at=2023-11-28T20:31:38Z,direct_url=<?>,disk_format='qcow2',id=7a0c8aa3-9cf2-4817-9668-062716fa7e9e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-795547296-shelved',owner='292cfffce13446c8963785adfb4b9d22',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T20:31:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRKSfjsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '93698818-d7ba-4f25-a341-30e5390a829e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4ee6c09-63e2-482f-bdbd-db3e6b99273d', 'serial': 'a4ee6c09-63e2-482f-bdbd-db3e6b99273d'}, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'b993e7d4-fe48-433a-b48c-d9df7d77f8ff', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:33:44 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:33:44 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a67bc6bcf540ec94ede3815bbb5a16c8',container_format='bare',created_at=2023-11-28T20:31:38Z,direct_url=<?>,disk_format='qcow2',id=7a0c8aa3-9cf2-4817-9668-062716fa7e9e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-795547296-shelved',owner='292cfffce13446c8963785adfb4b9d22',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T20:31:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.objects.instance [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'vcpu_model' on Instance uuid 93698818-d7ba-4f25-a341-30e5390a829e {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.objects.base [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Object Instance<93698818-d7ba-4f25-a341-30e5390a829e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRKSfjsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:33:44 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:33:44 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:33:44 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[282eb3a1-94aa-4b53-aa61-8008710fe292]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:33:44 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7614b3-b409-4904-ad92-d608c295208b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d] added
Nov 28 20:33:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4608a0e-d12d-4c50-b374-8136e298fbad]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef01b3b-507b-4a45-9df4-4dad3b94444a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zRKSfjsp {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zRKSfjsp" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[df701f6b-7afb-4c79-b8ab-acfc812d21ac]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zRKSfjsp'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.099s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86f0a75-f2e6-4533-beca-9e588917f9bd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cef1abb-27d3-43a4-8a68-c6ca48982552]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:33:44 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:33:44 user nova-compute[75571]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 (non-flash)
Nov 28 20:33:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:33:44 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:33:44 user nova-compute[75571]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 (non-flash)
Nov 28 20:33:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[420c6ce5-fc43-4d68-a18f-c5e76f39265d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d, portal: 172.16.0.220,3260]
Nov 28 20:33:44 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d, portal: 172.16.0.220,3260] successful.
Nov 28 20:33:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.066s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a764b1b5-966f-4100-97e3-700554d617f7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fa8d97-b10e-4492-84dc-082c4241fa2d]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:33:44 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:33:44 user nova-compute[75571]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 (non-flash)
Nov 28 20:33:44 user nova-compute[75571]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d (non-flash)
Nov 28 20:33:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:33:44 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:33:44 user nova-compute[75571]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 (non-flash)
Nov 28 20:33:44 user nova-compute[75571]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d (non-flash)
Nov 28 20:33:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.502s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e370dcac-3122-4d18-adec-cca49d7bd580]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:33:44 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:33:45 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:33:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRKSfjsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:33:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.533s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:33:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] <== connect_volume: return (1534ms) {'type': 'block', 'scsi_wwn': '26561323466353630', 'path': '/dev/sde'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:33:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561323466353630', 'path': '/dev/sde'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:33:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T20:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-795547296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-795547296',id=34,image_ref='7a0c8aa3-9cf2-4817-9668-062716fa7e9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-958726701',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:29:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='292cfffce13446c8963785adfb4b9d22',ramdisk_id='',reservation_id='r-pmqejehf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1442792072',owner_user_name='tempest-AttachVolumeShelveTestJSON-1442792072-project-member',shelved_at='2023-11-28T20:31:42.119587',shelved_host='user',shelved_image_id='7a0c8aa3-9cf2-4817-9668-062716fa7e9e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:33:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e21afd3261f4b1a87f7cbb4348fc9fe',uuid=93698818-d7ba-4f25-a341-30e5390a829e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:33:45 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converting VIF {"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:33:45 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:11:32,bridge_name='br-int',has_traffic_filtering=True,id=4258c97f-0a86-4cf4-ade0-831330204fc8,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4258c97f-0a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:33:45 user nova-compute[75571]: DEBUG nova.objects.instance [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'pci_devices' on Instance uuid 93698818-d7ba-4f25-a341-30e5390a829e {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:33:45 user nova-compute[75571]: DEBUG nova.objects.base [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Object Instance<93698818-d7ba-4f25-a341-30e5390a829e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:33:45 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:33:45 user nova-compute[75571]:   <uuid>93698818-d7ba-4f25-a341-30e5390a829e</uuid>
Nov 28 20:33:45 user nova-compute[75571]:   <name>instance-00000022</name>
Nov 28 20:33:45 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:33:45 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:33:45 user nova-compute[75571]:   <metadata>
Nov 28 20:33:45 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:33:45 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:33:45 user nova-compute[75571]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-795547296</nova:name>
Nov 28 20:33:45 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:33:44</nova:creationTime>
Nov 28 20:33:45 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:33:45 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:33:45 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:33:45 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:33:45 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:33:45 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:33:45 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:33:45 user nova-compute[75571]:       <nova:owner>
Nov 28 20:33:45 user nova-compute[75571]:         <nova:user uuid="9e21afd3261f4b1a87f7cbb4348fc9fe">tempest-AttachVolumeShelveTestJSON-1442792072-project-member</nova:user>
Nov 28 20:33:45 user nova-compute[75571]:         <nova:project uuid="292cfffce13446c8963785adfb4b9d22">tempest-AttachVolumeShelveTestJSON-1442792072</nova:project>
Nov 28 20:33:45 user nova-compute[75571]:       </nova:owner>
Nov 28 20:33:45 user nova-compute[75571]:       <nova:root type="image" uuid="7a0c8aa3-9cf2-4817-9668-062716fa7e9e"/>
Nov 28 20:33:45 user nova-compute[75571]:       <nova:ports>
Nov 28 20:33:45 user nova-compute[75571]:         <nova:port uuid="4258c97f-0a86-4cf4-ade0-831330204fc8">
Nov 28 20:33:45 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 20:33:45 user nova-compute[75571]:         </nova:port>
Nov 28 20:33:45 user nova-compute[75571]:       </nova:ports>
Nov 28 20:33:45 user nova-compute[75571]:     </nova:instance>
Nov 28 20:33:45 user nova-compute[75571]:   </metadata>
Nov 28 20:33:45 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:33:45 user nova-compute[75571]:     <system>
Nov 28 20:33:45 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:33:45 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:33:45 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:33:45 user nova-compute[75571]:       <entry name="serial">93698818-d7ba-4f25-a341-30e5390a829e</entry>
Nov 28 20:33:45 user nova-compute[75571]:       <entry name="uuid">93698818-d7ba-4f25-a341-30e5390a829e</entry>
Nov 28 20:33:45 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:33:45 user nova-compute[75571]:     </system>
Nov 28 20:33:45 user nova-compute[75571]:   </sysinfo>
Nov 28 20:33:45 user nova-compute[75571]:   <os>
Nov 28 20:33:45 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:33:45 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:33:45 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:33:45 user nova-compute[75571]:   </os>
Nov 28 20:33:45 user nova-compute[75571]:   <features>
Nov 28 20:33:45 user nova-compute[75571]:     <acpi/>
Nov 28 20:33:45 user nova-compute[75571]:     <apic/>
Nov 28 20:33:45 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:33:45 user nova-compute[75571]:   </features>
Nov 28 20:33:45 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:33:45 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:33:45 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:33:45 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:33:45 user nova-compute[75571]:   </clock>
Nov 28 20:33:45 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:33:45 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:33:45 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:33:45 user nova-compute[75571]:   </cpu>
Nov 28 20:33:45 user nova-compute[75571]:   <devices>
Nov 28 20:33:45 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:33:45 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:33:45 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk"/>
Nov 28 20:33:45 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:33:45 user nova-compute[75571]:     </disk>
Nov 28 20:33:45 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:33:45 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:33:45 user nova-compute[75571]:       <source dev="/dev/sde"/>
Nov 28 20:33:45 user nova-compute[75571]:       <target dev="vdc" bus="virtio"/>
Nov 28 20:33:45 user nova-compute[75571]:       <serial>a4ee6c09-63e2-482f-bdbd-db3e6b99273d</serial>
Nov 28 20:33:45 user nova-compute[75571]:     </disk>
Nov 28 20:33:45 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:33:45 user nova-compute[75571]:       <mac address="fa:16:3e:a0:11:32"/>
Nov 28 20:33:45 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:33:45 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:33:45 user nova-compute[75571]:       <target dev="tap4258c97f-0a"/>
Nov 28 20:33:45 user nova-compute[75571]:     </interface>
Nov 28 20:33:45 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:33:45 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/console.log" append="off"/>
Nov 28 20:33:45 user nova-compute[75571]:     </serial>
Nov 28 20:33:45 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:33:45 user nova-compute[75571]:     <video>
Nov 28 20:33:45 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:33:45 user nova-compute[75571]:     </video>
Nov 28 20:33:45 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:33:45 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:33:45 user nova-compute[75571]:     </rng>
Nov 28 20:33:45 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:33:45 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:33:45 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:33:45 user nova-compute[75571]:     </memballoon>
Nov 28 20:33:45 user nova-compute[75571]:   </devices>
Nov 28 20:33:45 user nova-compute[75571]: </domain>
Nov 28 20:33:45 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T20:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-795547296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-795547296',id=34,image_ref='7a0c8aa3-9cf2-4817-9668-062716fa7e9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-958726701',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:29:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='292cfffce13446c8963785adfb4b9d22',ramdisk_id='',reservation_id='r-pmqejehf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1442792072',owner_user_name='tempest-AttachVolumeShelveTestJSON-1442792072-project-member',shelved_at='2023-11-28T20:31:42.119587',shelved_host='user',shelved_image_id='7a0c8aa3-9cf2-4817-9668-062716fa7e9e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:33:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e21afd3261f4b1a87f7cbb4348fc9fe',uuid=93698818-d7ba-4f25-a341-30e5390a829e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converting VIF {"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:11:32,bridge_name='br-int',has_traffic_filtering=True,id=4258c97f-0a86-4cf4-ade0-831330204fc8,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4258c97f-0a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG os_vif [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:11:32,bridge_name='br-int',has_traffic_filtering=True,id=4258c97f-0a86-4cf4-ade0-831330204fc8,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4258c97f-0a') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aaa68caf-0e5b-5d50-9dc5-d5659f8e7ee8', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4258c97f-0a, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4258c97f-0a, col_values=(('qos', UUID('3a218622-c5dd-4aba-8f77-3bdf8d4d6895')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4258c97f-0a, col_values=(('external_ids', {'iface-id': '4258c97f-0a86-4cf4-ade0-831330204fc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:11:32', 'vm-uuid': '93698818-d7ba-4f25-a341-30e5390a829e'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:46 user nova-compute[75571]: INFO os_vif [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:11:32,bridge_name='br-int',has_traffic_filtering=True,id=4258c97f-0a86-4cf4-ade0-831330204fc8,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4258c97f-0a')
Nov 28 20:33:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:33:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] No VIF found with MAC fa:16:3e:a0:11:32, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:33:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-2d34e498-9b91-4279-8e7f-83e1e03c1376 req-8f38e096-5af3-4007-96a6-c8ab8b66d7b7 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received event network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:33:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2d34e498-9b91-4279-8e7f-83e1e03c1376 req-8f38e096-5af3-4007-96a6-c8ab8b66d7b7 service nova] Acquiring lock "93698818-d7ba-4f25-a341-30e5390a829e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:33:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2d34e498-9b91-4279-8e7f-83e1e03c1376 req-8f38e096-5af3-4007-96a6-c8ab8b66d7b7 service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:33:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2d34e498-9b91-4279-8e7f-83e1e03c1376 req-8f38e096-5af3-4007-96a6-c8ab8b66d7b7 service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:33:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-2d34e498-9b91-4279-8e7f-83e1e03c1376 req-8f38e096-5af3-4007-96a6-c8ab8b66d7b7 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] No waiting events found dispatching network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:33:47 user nova-compute[75571]: WARNING nova.compute.manager [req-2d34e498-9b91-4279-8e7f-83e1e03c1376 req-8f38e096-5af3-4007-96a6-c8ab8b66d7b7 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received unexpected event network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 20:33:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:33:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:33:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Instance spawned successfully.
Nov 28 20:33:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-3292becf-cf1f-4323-98f2-f4edc0c3bc44 req-b50aa479-7c76-436a-ab1d-901eab03e6e0 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received event network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:33:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3292becf-cf1f-4323-98f2-f4edc0c3bc44 req-b50aa479-7c76-436a-ab1d-901eab03e6e0 service nova] Acquiring lock "93698818-d7ba-4f25-a341-30e5390a829e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:33:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3292becf-cf1f-4323-98f2-f4edc0c3bc44 req-b50aa479-7c76-436a-ab1d-901eab03e6e0 service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:33:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3292becf-cf1f-4323-98f2-f4edc0c3bc44 req-b50aa479-7c76-436a-ab1d-901eab03e6e0 service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:33:49 user nova-compute[75571]: DEBUG nova.compute.manager [req-3292becf-cf1f-4323-98f2-f4edc0c3bc44 req-b50aa479-7c76-436a-ab1d-901eab03e6e0 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] No waiting events found dispatching network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:33:49 user nova-compute[75571]: WARNING nova.compute.manager [req-3292becf-cf1f-4323-98f2-f4edc0c3bc44 req-b50aa479-7c76-436a-ab1d-901eab03e6e0 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received unexpected event network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 20:33:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:33:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "93698818-d7ba-4f25-a341-30e5390a829e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.484s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:33:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:33:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:34:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:11 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:34:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:34:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:34:14 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:34:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:15 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:34:15 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:34:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:34:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:34:15 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Updating instance_info_cache with network_info: [{"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-313a065e-94f3-4435-97af-6a16de64ca7c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:16 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:34:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:34:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:34:19 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:34:19 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:34:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8202MB free_disk=24.75490951538086GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 313a065e-94f3-4435-97af-6a16de64ca7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e6f2a651-b10a-45f4-8f94-6a4426654a86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 636a8f00-7685-4c1b-9404-cf16359dd08a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 136d54f3-eb9a-46fc-8b5f-318b68500804 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 93698818-d7ba-4f25-a341-30e5390a829e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:34:19 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:34:20 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:34:20 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:34:20 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:34:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:34:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:21 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:34:25 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'flavor' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:34:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:34:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquired lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:34:25 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:34:25 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'info_cache' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:34:25 user nova-compute[75571]: DEBUG nova.objects.base [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Object Instance<636a8f00-7685-4c1b-9404-cf16359dd08a> lazy-loaded attributes: flavor,info_cache {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Updating instance_info_cache with network_info: [{"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Releasing lock "refresh_cache-636a8f00-7685-4c1b-9404-cf16359dd08a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:34:26 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Instance destroyed successfully.
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'resources' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.objects.base [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Object Instance<636a8f00-7685-4c1b-9404-cf16359dd08a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:26:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-599565098',display_name='tempest-AttachVolumeTestJSON-server-599565098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-599565098',id=32,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3XwsjqlLJC+H5W8+kliU+liUVxsmiGlirVM1hB3Xvq2TAMksvSwoTdDPqxJDLnMy/epsE7znWc/yERpeFqyVO3BqmqmL465Jtof0GPEtberkTrsDvfTVDra8QzBI4sQ==',key_name='tempest-keypair-1076987994',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:26:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a7d489de217644979c5888d97158a800',ramdisk_id='',reservation_id='r-8ipm7twc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-187128538',owner_user_name='tempest-AttachVolumeTestJSON-187128538-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:32:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d653c87883374ab59768ce28b2b9adfc',uuid=636a8f00-7685-4c1b-9404-cf16359dd08a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converting VIF {"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG os_vif [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23e84680-3a, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58058b89-f959-4363-8f3b-1528be4a18d2) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:26 user nova-compute[75571]: INFO os_vif [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a')
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Start _get_guest_xml network_info=[{"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'numa_topology' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.objects.base [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Object Instance<636a8f00-7685-4c1b-9404-cf16359dd08a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:34:26 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:34:26 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'vcpu_model' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.objects.base [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Object Instance<636a8f00-7685-4c1b-9404-cf16359dd08a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:26:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-599565098',display_name='tempest-AttachVolumeTestJSON-server-599565098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-599565098',id=32,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3XwsjqlLJC+H5W8+kliU+liUVxsmiGlirVM1hB3Xvq2TAMksvSwoTdDPqxJDLnMy/epsE7znWc/yERpeFqyVO3BqmqmL465Jtof0GPEtberkTrsDvfTVDra8QzBI4sQ==',key_name='tempest-keypair-1076987994',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:26:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a7d489de217644979c5888d97158a800',ramdisk_id='',reservation_id='r-8ipm7twc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-187128538',owner_user_name='tempest-AttachVolumeTestJSON-187128538-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:32:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d653c87883374ab59768ce28b2b9adfc',uuid=636a8f00-7685-4c1b-9404-cf16359dd08a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converting VIF {"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'pci_devices' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.objects.base [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Object Instance<636a8f00-7685-4c1b-9404-cf16359dd08a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:34:26 user nova-compute[75571]:   <uuid>636a8f00-7685-4c1b-9404-cf16359dd08a</uuid>
Nov 28 20:34:26 user nova-compute[75571]:   <name>instance-00000020</name>
Nov 28 20:34:26 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:34:26 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:34:26 user nova-compute[75571]:   <metadata>
Nov 28 20:34:26 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:34:26 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:34:26 user nova-compute[75571]:       <nova:name>tempest-AttachVolumeTestJSON-server-599565098</nova:name>
Nov 28 20:34:26 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:34:26</nova:creationTime>
Nov 28 20:34:26 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:34:26 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:34:26 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:34:26 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:34:26 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:34:26 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:34:26 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:34:26 user nova-compute[75571]:       <nova:owner>
Nov 28 20:34:26 user nova-compute[75571]:         <nova:user uuid="d653c87883374ab59768ce28b2b9adfc">tempest-AttachVolumeTestJSON-187128538-project-member</nova:user>
Nov 28 20:34:26 user nova-compute[75571]:         <nova:project uuid="a7d489de217644979c5888d97158a800">tempest-AttachVolumeTestJSON-187128538</nova:project>
Nov 28 20:34:26 user nova-compute[75571]:       </nova:owner>
Nov 28 20:34:26 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:34:26 user nova-compute[75571]:       <nova:ports>
Nov 28 20:34:26 user nova-compute[75571]:         <nova:port uuid="23e84680-3abf-49b8-9750-1a0a3cd8b4cb">
Nov 28 20:34:26 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 20:34:26 user nova-compute[75571]:         </nova:port>
Nov 28 20:34:26 user nova-compute[75571]:       </nova:ports>
Nov 28 20:34:26 user nova-compute[75571]:     </nova:instance>
Nov 28 20:34:26 user nova-compute[75571]:   </metadata>
Nov 28 20:34:26 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:34:26 user nova-compute[75571]:     <system>
Nov 28 20:34:26 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:34:26 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:34:26 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:34:26 user nova-compute[75571]:       <entry name="serial">636a8f00-7685-4c1b-9404-cf16359dd08a</entry>
Nov 28 20:34:26 user nova-compute[75571]:       <entry name="uuid">636a8f00-7685-4c1b-9404-cf16359dd08a</entry>
Nov 28 20:34:26 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:34:26 user nova-compute[75571]:     </system>
Nov 28 20:34:26 user nova-compute[75571]:   </sysinfo>
Nov 28 20:34:26 user nova-compute[75571]:   <os>
Nov 28 20:34:26 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:34:26 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:34:26 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:34:26 user nova-compute[75571]:   </os>
Nov 28 20:34:26 user nova-compute[75571]:   <features>
Nov 28 20:34:26 user nova-compute[75571]:     <acpi/>
Nov 28 20:34:26 user nova-compute[75571]:     <apic/>
Nov 28 20:34:26 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:34:26 user nova-compute[75571]:   </features>
Nov 28 20:34:26 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:34:26 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:34:26 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:34:26 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:34:26 user nova-compute[75571]:   </clock>
Nov 28 20:34:26 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:34:26 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:34:26 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:34:26 user nova-compute[75571]:   </cpu>
Nov 28 20:34:26 user nova-compute[75571]:   <devices>
Nov 28 20:34:26 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:34:26 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:34:26 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk"/>
Nov 28 20:34:26 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:34:26 user nova-compute[75571]:     </disk>
Nov 28 20:34:26 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:34:26 user nova-compute[75571]:       <mac address="fa:16:3e:b0:53:96"/>
Nov 28 20:34:26 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:34:26 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:34:26 user nova-compute[75571]:       <target dev="tap23e84680-3a"/>
Nov 28 20:34:26 user nova-compute[75571]:     </interface>
Nov 28 20:34:26 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:34:26 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/console.log" append="off"/>
Nov 28 20:34:26 user nova-compute[75571]:     </serial>
Nov 28 20:34:26 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:34:26 user nova-compute[75571]:     <video>
Nov 28 20:34:26 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:34:26 user nova-compute[75571]:     </video>
Nov 28 20:34:26 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:34:26 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:34:26 user nova-compute[75571]:     </rng>
Nov 28 20:34:26 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:34:26 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:34:26 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:34:26 user nova-compute[75571]:     </memballoon>
Nov 28 20:34:26 user nova-compute[75571]:   </devices>
Nov 28 20:34:26 user nova-compute[75571]: </domain>
Nov 28 20:34:26 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'trusted_certs' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG nova.objects.base [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Object Instance<636a8f00-7685-4c1b-9404-cf16359dd08a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:34:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Cannot resize image /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'migration_context' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG nova.objects.base [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Object Instance<636a8f00-7685-4c1b-9404-cf16359dd08a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:26:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-599565098',display_name='tempest-AttachVolumeTestJSON-server-599565098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-599565098',id=32,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3XwsjqlLJC+H5W8+kliU+liUVxsmiGlirVM1hB3Xvq2TAMksvSwoTdDPqxJDLnMy/epsE7znWc/yERpeFqyVO3BqmqmL465Jtof0GPEtberkTrsDvfTVDra8QzBI4sQ==',key_name='tempest-keypair-1076987994',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:26:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a7d489de217644979c5888d97158a800',ramdisk_id='',reservation_id='r-8ipm7twc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-187128538',owner_user_name='tempest-AttachVolumeTestJSON-187128538-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:32:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d653c87883374ab59768ce28b2b9adfc',uuid=636a8f00-7685-4c1b-9404-cf16359dd08a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converting VIF {"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG os_vif [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7005d4a2-64b4-5e80-b66f-641e72d73868', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23e84680-3a, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23e84680-3a, col_values=(('qos', UUID('ee1773df-c636-4b50-afd9-bf1e67822429')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23e84680-3a, col_values=(('external_ids', {'iface-id': '23e84680-3abf-49b8-9750-1a0a3cd8b4cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:53:96', 'vm-uuid': '636a8f00-7685-4c1b-9404-cf16359dd08a'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:34:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:27 user nova-compute[75571]: INFO os_vif [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a')
Nov 28 20:34:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-d265075d-bb27-43b5-b692-a4c5c2f923a2 req-4071f852-ca57-4d97-a800-d9cf04aaf586 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:34:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d265075d-bb27-43b5-b692-a4c5c2f923a2 req-4071f852-ca57-4d97-a800-d9cf04aaf586 service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:34:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d265075d-bb27-43b5-b692-a4c5c2f923a2 req-4071f852-ca57-4d97-a800-d9cf04aaf586 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:34:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d265075d-bb27-43b5-b692-a4c5c2f923a2 req-4071f852-ca57-4d97-a800-d9cf04aaf586 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:34:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-d265075d-bb27-43b5-b692-a4c5c2f923a2 req-4071f852-ca57-4d97-a800-d9cf04aaf586 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:34:28 user nova-compute[75571]: WARNING nova.compute.manager [req-d265075d-bb27-43b5-b692-a4c5c2f923a2 req-4071f852-ca57-4d97-a800-d9cf04aaf586 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state stopped and task_state powering-on.
Nov 28 20:34:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:34:30 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Instance rebooted successfully.
Nov 28 20:34:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:34:30 user nova-compute[75571]: DEBUG nova.compute.manager [req-0c2e8d37-ebbc-4097-b291-fc7eaadc3c78 req-55822acd-abe4-477f-8149-9ca0e7cf8149 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:34:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0c2e8d37-ebbc-4097-b291-fc7eaadc3c78 req-55822acd-abe4-477f-8149-9ca0e7cf8149 service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:34:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0c2e8d37-ebbc-4097-b291-fc7eaadc3c78 req-55822acd-abe4-477f-8149-9ca0e7cf8149 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:34:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0c2e8d37-ebbc-4097-b291-fc7eaadc3c78 req-55822acd-abe4-477f-8149-9ca0e7cf8149 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:34:30 user nova-compute[75571]: DEBUG nova.compute.manager [req-0c2e8d37-ebbc-4097-b291-fc7eaadc3c78 req-55822acd-abe4-477f-8149-9ca0e7cf8149 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:34:30 user nova-compute[75571]: WARNING nova.compute.manager [req-0c2e8d37-ebbc-4097-b291-fc7eaadc3c78 req-55822acd-abe4-477f-8149-9ca0e7cf8149 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state stopped and task_state powering-on.
Nov 28 20:34:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:34 user nova-compute[75571]: DEBUG nova.compute.manager [req-338671c7-06e9-49a8-be79-fd14089491c9 req-9eaeec9e-96d3-495d-9db6-7b17819ca75e service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received event network-changed-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:34:34 user nova-compute[75571]: DEBUG nova.compute.manager [req-338671c7-06e9-49a8-be79-fd14089491c9 req-9eaeec9e-96d3-495d-9db6-7b17819ca75e service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Refreshing instance network info cache due to event network-changed-48a201ba-2910-4d94-b7a9-ac3878402adf. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:34:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-338671c7-06e9-49a8-be79-fd14089491c9 req-9eaeec9e-96d3-495d-9db6-7b17819ca75e service nova] Acquiring lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:34:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-338671c7-06e9-49a8-be79-fd14089491c9 req-9eaeec9e-96d3-495d-9db6-7b17819ca75e service nova] Acquired lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:34:34 user nova-compute[75571]: DEBUG nova.network.neutron [req-338671c7-06e9-49a8-be79-fd14089491c9 req-9eaeec9e-96d3-495d-9db6-7b17819ca75e service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Refreshing network info cache for port 48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:34:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:34:35 user nova-compute[75571]: INFO nova.compute.manager [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Terminating instance
Nov 28 20:34:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG nova.network.neutron [req-338671c7-06e9-49a8-be79-fd14089491c9 req-9eaeec9e-96d3-495d-9db6-7b17819ca75e service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Updated VIF entry in instance network info cache for port 48a201ba-2910-4d94-b7a9-ac3878402adf. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG nova.network.neutron [req-338671c7-06e9-49a8-be79-fd14089491c9 req-9eaeec9e-96d3-495d-9db6-7b17819ca75e service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Updating instance_info_cache with network_info: [{"id": "48a201ba-2910-4d94-b7a9-ac3878402adf", "address": "fa:16:3e:3c:93:46", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a201ba-29", "ovs_interfaceid": "48a201ba-2910-4d94-b7a9-ac3878402adf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-338671c7-06e9-49a8-be79-fd14089491c9 req-9eaeec9e-96d3-495d-9db6-7b17819ca75e service nova] Releasing lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:34:35 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Instance destroyed successfully.
Nov 28 20:34:35 user nova-compute[75571]: DEBUG nova.objects.instance [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'resources' on Instance uuid 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-d8f5ba17-bc32-4437-aeae-573d7dbe24fd req-4d0a22f4-7fa3-413c-bd64-5542a46d5245 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received event network-vif-unplugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d8f5ba17-bc32-4437-aeae-573d7dbe24fd req-4d0a22f4-7fa3-413c-bd64-5542a46d5245 service nova] Acquiring lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d8f5ba17-bc32-4437-aeae-573d7dbe24fd req-4d0a22f4-7fa3-413c-bd64-5542a46d5245 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d8f5ba17-bc32-4437-aeae-573d7dbe24fd req-4d0a22f4-7fa3-413c-bd64-5542a46d5245 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-d8f5ba17-bc32-4437-aeae-573d7dbe24fd req-4d0a22f4-7fa3-413c-bd64-5542a46d5245 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] No waiting events found dispatching network-vif-unplugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-d8f5ba17-bc32-4437-aeae-573d7dbe24fd req-4d0a22f4-7fa3-413c-bd64-5542a46d5245 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received event network-vif-unplugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:29:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-773181244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-773181244',id=33,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:31:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd03007966db45f48ae6c22ed6f84871',ramdisk_id='',reservation_id='r-0z1j7bj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-468878',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-468878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:32:50Z,user_data=None,user_id='007af37c9a914cd5863e486c041701be',uuid=5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "address": "fa:16:3e:a1:20:af", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaded16b1-1b", "ovs_interfaceid": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converting VIF {"id": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "address": "fa:16:3e:a1:20:af", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaded16b1-1b", "ovs_interfaceid": "aded16b1-1b80-4e18-ab01-ea36010cc6ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:20:af,bridge_name='br-int',has_traffic_filtering=True,id=aded16b1-1b80-4e18-ab01-ea36010cc6ff,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaded16b1-1b') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG os_vif [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:20:af,bridge_name='br-int',has_traffic_filtering=True,id=aded16b1-1b80-4e18-ab01-ea36010cc6ff,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaded16b1-1b') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaded16b1-1b, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6cc95fc2-9d0a-4f7f-b73d-2aad0aa6c205) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:35 user nova-compute[75571]: INFO os_vif [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:20:af,bridge_name='br-int',has_traffic_filtering=True,id=aded16b1-1b80-4e18-ab01-ea36010cc6ff,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaded16b1-1b')
Nov 28 20:34:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysmcSPHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:34:35 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:34:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbb2ff3-ba10-422b-bd92-12763fdb1103]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:34:35 user nova-compute[75571]: No targets found.
Nov 28 20:34:35 user nova-compute[75571]: iSNS:
Nov 28 20:34:35 user nova-compute[75571]: No targets found.
Nov 28 20:34:35 user nova-compute[75571]: STATIC:
Nov 28 20:34:35 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e
Nov 28 20:34:35 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:34:35 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:34:35 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d
Nov 28 20:34:35 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:34:35 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:34:35 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4
Nov 28 20:34:35 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:34:35 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:34:35 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:34:35 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:34:35 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:34:35 user nova-compute[75571]: FIRMWARE:
Nov 28 20:34:35 user nova-compute[75571]: No targets found.
Nov 28 20:34:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:34:35 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:34:35 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f972c7c6-c582-4eb9-9074-338985eabe0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c63adcd-4fcd-47dc-8d4a-7b1354d7d4fd]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:34:35 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:34:35 user nova-compute[75571]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 (non-flash)
Nov 28 20:34:35 user nova-compute[75571]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d (non-flash)
Nov 28 20:34:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:34:35 user nova-compute[75571]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e (non-flash)
Nov 28 20:34:35 user nova-compute[75571]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 (non-flash)
Nov 28 20:34:35 user nova-compute[75571]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d (non-flash)
Nov 28 20:34:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768135750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1e8b95-6e3c-423a-9ab3-11dd6883bc97]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d2133f-d199-4d9c-b189-f852454efeaa]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fededaed-ac81-4a3f-9128-722f7b5b146f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca49e0ff-28a7-43fb-8b2b-adcdf931f7f4]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23334343830366537', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5cd76f8c', '/dev/disk/by-id/scsi-1SCST_BIO5cd76f8c-344806e7ab6a48e6') {{(pid=86013) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 20:34:36 user nova-compute[75571]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23334343830366537
Nov 28 20:34:36 user nova-compute[75571]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_5cd76f8c
Nov 28 20:34:36 user nova-compute[75571]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO5cd76f8c-344806e7ab6a48e6
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4557bc-c73a-4e45-a37c-594501b3bbb5]: (4, None) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[799b126e-b781-4bee-9a51-6cf676082d23]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c44069-53df-499e-8b92-1c4434228e40]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e, portal: 172.16.0.220,3260]
Nov 28 20:34:36 user nova-compute[75571]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e, portal: 172.16.0.220,3260] successful.
Nov 28 20:34:36 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15c2acb-f787-44e6-aecf-f23dac0b7b0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab1b0c1-46ea-47a5-938b-27bbfc18f3cd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] <== disconnect_volume: return (366ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:34:36 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Deleting instance files /opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867_del
Nov 28 20:34:36 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Deletion of /opt/stack/data/nova/instances/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867_del complete
Nov 28 20:34:36 user nova-compute[75571]: INFO nova.compute.manager [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:34:36 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Took 0.44 seconds to deallocate network for instance.
Nov 28 20:34:36 user nova-compute[75571]: DEBUG nova.compute.manager [req-1fc488bd-f31a-4e5f-8415-ced14c41dc5c req-47290e99-ac61-4505-92fa-8e9cd776d6d9 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received event network-vif-deleted-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "136d54f3-eb9a-46fc-8b5f-318b68500804" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:34:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:34:37 user nova-compute[75571]: INFO nova.compute.manager [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Detaching volume 851647b5-5c40-45e4-bfa4-8dc829d269f4
Nov 28 20:34:37 user nova-compute[75571]: INFO nova.virt.block_device [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Attempting to driver detach volume 851647b5-5c40-45e4-bfa4-8dc829d269f4 from mountpoint /dev/vdb
Nov 28 20:34:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Attempting to detach device vdb from instance 136d54f3-eb9a-46fc-8b5f-318b68500804 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:34:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:34:37 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:34:37 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:34:37 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:34:37 user nova-compute[75571]:   <serial>851647b5-5c40-45e4-bfa4-8dc829d269f4</serial>
Nov 28 20:34:37 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:34:37 user nova-compute[75571]: </disk>
Nov 28 20:34:37 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:34:37 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Successfully detached device vdb from instance 136d54f3-eb9a-46fc-8b5f-318b68500804 from the persistent domain config.
Nov 28 20:34:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 136d54f3-eb9a-46fc-8b5f-318b68500804 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:34:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:34:37 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:34:37 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:34:37 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:34:37 user nova-compute[75571]:   <serial>851647b5-5c40-45e4-bfa4-8dc829d269f4</serial>
Nov 28 20:34:37 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:34:37 user nova-compute[75571]: </disk>
Nov 28 20:34:37 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:34:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 136d54f3-eb9a-46fc-8b5f-318b68500804 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:34:37 user nova-compute[75571]: INFO nova.compute.manager [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Took 0.94 seconds to detach 1 volumes for instance.
Nov 28 20:34:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:34:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:34:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:34:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] Acquiring lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:34:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:34:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:34:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] No waiting events found dispatching network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:34:37 user nova-compute[75571]: WARNING nova.compute.manager [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Received unexpected event network-vif-plugged-aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance with vm_state deleted and task_state None.
Nov 28 20:34:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received event network-changed-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:34:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Refreshing instance network info cache due to event network-changed-48a201ba-2910-4d94-b7a9-ac3878402adf. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:34:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] Acquiring lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:34:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] Acquired lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:34:37 user nova-compute[75571]: DEBUG nova.network.neutron [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Refreshing network info cache for port 48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:34:37 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:34:38 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:34:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:34:38 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Deleted allocations for instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867
Nov 28 20:34:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.130s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:34:38 user nova-compute[75571]: DEBUG nova.network.neutron [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Updated VIF entry in instance network info cache for port 48a201ba-2910-4d94-b7a9-ac3878402adf. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:34:38 user nova-compute[75571]: DEBUG nova.network.neutron [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Updating instance_info_cache with network_info: [{"id": "48a201ba-2910-4d94-b7a9-ac3878402adf", "address": "fa:16:3e:3c:93:46", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a201ba-29", "ovs_interfaceid": "48a201ba-2910-4d94-b7a9-ac3878402adf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:34:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] Releasing lock "refresh_cache-136d54f3-eb9a-46fc-8b5f-318b68500804" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:34:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:34:57 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 136d54f3-eb9a-46fc-8b5f-318b68500804 is timed out.
Nov 28 20:34:57 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Successfully detached device vdb from instance 136d54f3-eb9a-46fc-8b5f-318b68500804 from the live domain config.
Nov 28 20:34:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RrDmdGix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:34:57 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[96196e48-d6a2-444b-a94e-09dc4def0b54]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:34:57 user nova-compute[75571]: No targets found.
Nov 28 20:34:57 user nova-compute[75571]: iSNS:
Nov 28 20:34:57 user nova-compute[75571]: No targets found.
Nov 28 20:34:57 user nova-compute[75571]: STATIC:
Nov 28 20:34:57 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d
Nov 28 20:34:57 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:34:57 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:34:57 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4
Nov 28 20:34:57 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:34:57 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:34:57 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:34:57 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:34:57 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:34:57 user nova-compute[75571]: FIRMWARE:
Nov 28 20:34:57 user nova-compute[75571]: No targets found.
Nov 28 20:34:57 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:34:57 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:34:57 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ebf1b6-50af-46b8-a6a1-bfa8b4687589]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cd6f4f-a8d2-4012-ae86-ed6037c01fea]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:34:57 user nova-compute[75571]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 (non-flash)
Nov 28 20:34:57 user nova-compute[75571]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d (non-flash)
Nov 28 20:34:57 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:34:57 user nova-compute[75571]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 (non-flash)
Nov 28 20:34:57 user nova-compute[75571]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d (non-flash)
Nov 28 20:34:57 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77783383a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4'): ({'sdc'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Removing single pathed devices sdc {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb33f431-ba68-4c23-bf3c-54cd0db01203]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be32bf3-fa75-4a1a-a88c-69bc1cd53298]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Flushing IO for device /dev/sdc {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fd6492-73ae-443d-9056-b39895a0ecd1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6d7f0c-37b3-4fe4-8d6b-a84c3b6e4854]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03b263b-fcce-49f0-a47a-24c3a695defc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efad72b-48d8-46d4-83b1-81fc85724528]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4, portal: 172.16.0.220,3260]
Nov 28 20:34:57 user nova-compute[75571]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4, portal: 172.16.0.220,3260] successful.
Nov 28 20:34:57 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:851647b5-5c40-45e4-bfa4-8dc829d269f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a926dcfb-5eb5-45c9-9961-06d68b8c3c9d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] <== disconnect_volume: return (322ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:34:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:34:58 user nova-compute[75571]: DEBUG nova.objects.instance [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'flavor' on Instance uuid 136d54f3-eb9a-46fc-8b5f-318b68500804 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:34:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.717s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:34:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:03 user nova-compute[75571]: INFO nova.compute.manager [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Rescuing
Nov 28 20:35:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:35:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquired lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:35:03 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:35:03 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Updating instance_info_cache with network_info: [{"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Releasing lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-1a2d9b95-a723-40ab-8fa9-04439462a088 req-42d1c0c5-8533-4466-9dca-7af90fb5be36 service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-unplugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1a2d9b95-a723-40ab-8fa9-04439462a088 req-42d1c0c5-8533-4466-9dca-7af90fb5be36 service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1a2d9b95-a723-40ab-8fa9-04439462a088 req-42d1c0c5-8533-4466-9dca-7af90fb5be36 service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1a2d9b95-a723-40ab-8fa9-04439462a088 req-42d1c0c5-8533-4466-9dca-7af90fb5be36 service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-1a2d9b95-a723-40ab-8fa9-04439462a088 req-42d1c0c5-8533-4466-9dca-7af90fb5be36 service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-unplugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:35:04 user nova-compute[75571]: WARNING nova.compute.manager [req-1a2d9b95-a723-40ab-8fa9-04439462a088 req-42d1c0c5-8533-4466-9dca-7af90fb5be36 service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received unexpected event network-vif-unplugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with vm_state active and task_state rescuing.
Nov 28 20:35:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Instance destroyed successfully.
Nov 28 20:35:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Attempting rescue
Nov 28 20:35:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75571) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Instance directory exists: not creating {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 20:35:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Creating image(s)
Nov 28 20:35:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "/opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "/opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "/opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'trusted_certs' on Instance uuid 29443f30-6d05-4148-9185-a31f78b4a68f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.rescue {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.rescue" returned: 0 in 0.054s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'migration_context' on Instance uuid 29443f30-6d05-4148-9185-a31f78b4a68f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.objects.base [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Object Instance<29443f30-6d05-4148-9185-a31f78b4a68f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Start _get_guest_xml network_info=[{"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "vif_mac": "fa:16:3e:cf:2e:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '77b9e284-7155-4207-b748-934c25ce18d0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'resources' on Instance uuid 29443f30-6d05-4148-9185-a31f78b4a68f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.objects.base [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Object Instance<29443f30-6d05-4148-9185-a31f78b4a68f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'numa_topology' on Instance uuid 29443f30-6d05-4148-9185-a31f78b4a68f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.objects.base [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Object Instance<29443f30-6d05-4148-9185-a31f78b4a68f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:35:05 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:35:05 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'vcpu_model' on Instance uuid 29443f30-6d05-4148-9185-a31f78b4a68f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.objects.base [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Object Instance<29443f30-6d05-4148-9185-a31f78b4a68f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2038069783',display_name='tempest-ServerRescueNegativeTestJSON-server-2038069783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2038069783',id=35,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:30:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d72dc075421c4e7eb9c0ff2bf1641a92',ramdisk_id='',reservation_id='r-vjt3ghjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-506941201',owner_user_name='tempest-ServerRescueNegativeTestJSON-506941201-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:30:27Z,user_data=None,user_id='634123644067453a92f4d43da0b28fa7',uuid=29443f30-6d05-4148-9185-a31f78b4a68f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "vif_mac": "fa:16:3e:cf:2e:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converting VIF {"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "vif_mac": "fa:16:3e:cf:2e:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:2e:94,bridge_name='br-int',has_traffic_filtering=True,id=ff9deee0-3665-4ae4-864e-1da67b83ccd2,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9deee0-36') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'pci_devices' on Instance uuid 29443f30-6d05-4148-9185-a31f78b4a68f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.objects.base [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Object Instance<29443f30-6d05-4148-9185-a31f78b4a68f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:35:05 user nova-compute[75571]:   <uuid>29443f30-6d05-4148-9185-a31f78b4a68f</uuid>
Nov 28 20:35:05 user nova-compute[75571]:   <name>instance-00000023</name>
Nov 28 20:35:05 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:35:05 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:35:05 user nova-compute[75571]:   <metadata>
Nov 28 20:35:05 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:35:05 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:35:05 user nova-compute[75571]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2038069783</nova:name>
Nov 28 20:35:05 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:35:05</nova:creationTime>
Nov 28 20:35:05 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:35:05 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:35:05 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:35:05 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:35:05 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:35:05 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:35:05 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:35:05 user nova-compute[75571]:       <nova:owner>
Nov 28 20:35:05 user nova-compute[75571]:         <nova:user uuid="634123644067453a92f4d43da0b28fa7">tempest-ServerRescueNegativeTestJSON-506941201-project-member</nova:user>
Nov 28 20:35:05 user nova-compute[75571]:         <nova:project uuid="d72dc075421c4e7eb9c0ff2bf1641a92">tempest-ServerRescueNegativeTestJSON-506941201</nova:project>
Nov 28 20:35:05 user nova-compute[75571]:       </nova:owner>
Nov 28 20:35:05 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:35:05 user nova-compute[75571]:       <nova:ports>
Nov 28 20:35:05 user nova-compute[75571]:         <nova:port uuid="ff9deee0-3665-4ae4-864e-1da67b83ccd2">
Nov 28 20:35:05 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:35:05 user nova-compute[75571]:         </nova:port>
Nov 28 20:35:05 user nova-compute[75571]:       </nova:ports>
Nov 28 20:35:05 user nova-compute[75571]:     </nova:instance>
Nov 28 20:35:05 user nova-compute[75571]:   </metadata>
Nov 28 20:35:05 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:35:05 user nova-compute[75571]:     <system>
Nov 28 20:35:05 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:35:05 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:35:05 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:35:05 user nova-compute[75571]:       <entry name="serial">29443f30-6d05-4148-9185-a31f78b4a68f</entry>
Nov 28 20:35:05 user nova-compute[75571]:       <entry name="uuid">29443f30-6d05-4148-9185-a31f78b4a68f</entry>
Nov 28 20:35:05 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:35:05 user nova-compute[75571]:     </system>
Nov 28 20:35:05 user nova-compute[75571]:   </sysinfo>
Nov 28 20:35:05 user nova-compute[75571]:   <os>
Nov 28 20:35:05 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:35:05 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:35:05 user nova-compute[75571]:   </os>
Nov 28 20:35:05 user nova-compute[75571]:   <features>
Nov 28 20:35:05 user nova-compute[75571]:     <acpi/>
Nov 28 20:35:05 user nova-compute[75571]:     <apic/>
Nov 28 20:35:05 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:35:05 user nova-compute[75571]:   </features>
Nov 28 20:35:05 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:35:05 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:35:05 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:35:05 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:35:05 user nova-compute[75571]:   </clock>
Nov 28 20:35:05 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:35:05 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:35:05 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:35:05 user nova-compute[75571]:   </cpu>
Nov 28 20:35:05 user nova-compute[75571]:   <devices>
Nov 28 20:35:05 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:35:05 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:35:05 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.rescue"/>
Nov 28 20:35:05 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:35:05 user nova-compute[75571]:     </disk>
Nov 28 20:35:05 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:35:05 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:35:05 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk"/>
Nov 28 20:35:05 user nova-compute[75571]:       <target dev="vdb" bus="virtio"/>
Nov 28 20:35:05 user nova-compute[75571]:     </disk>
Nov 28 20:35:05 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:35:05 user nova-compute[75571]:       <mac address="fa:16:3e:cf:2e:94"/>
Nov 28 20:35:05 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:35:05 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:35:05 user nova-compute[75571]:       <target dev="tapff9deee0-36"/>
Nov 28 20:35:05 user nova-compute[75571]:     </interface>
Nov 28 20:35:05 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:35:05 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/console.log" append="off"/>
Nov 28 20:35:05 user nova-compute[75571]:     </serial>
Nov 28 20:35:05 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:35:05 user nova-compute[75571]:     <video>
Nov 28 20:35:05 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:35:05 user nova-compute[75571]:     </video>
Nov 28 20:35:05 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:35:05 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:35:05 user nova-compute[75571]:     </rng>
Nov 28 20:35:05 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:35:05 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:35:05 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:35:05 user nova-compute[75571]:     </memballoon>
Nov 28 20:35:05 user nova-compute[75571]:   </devices>
Nov 28 20:35:05 user nova-compute[75571]: </domain>
Nov 28 20:35:05 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:05 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Instance destroyed successfully.
Nov 28 20:35:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No VIF found with MAC fa:16:3e:cf:2e:94, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:35:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:35:06 user nova-compute[75571]: WARNING nova.compute.manager [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received unexpected event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with vm_state active and task_state rescuing.
Nov 28 20:35:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:35:06 user nova-compute[75571]: WARNING nova.compute.manager [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received unexpected event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with vm_state active and task_state rescuing.
Nov 28 20:35:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:35:06 user nova-compute[75571]: WARNING nova.compute.manager [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received unexpected event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with vm_state active and task_state rescuing.
Nov 28 20:35:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-unplugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-unplugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:35:06 user nova-compute[75571]: WARNING nova.compute.manager [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received unexpected event network-vif-unplugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with vm_state active and task_state rescuing.
Nov 28 20:35:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:35:06 user nova-compute[75571]: WARNING nova.compute.manager [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received unexpected event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with vm_state active and task_state rescuing.
Nov 28 20:35:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:35:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:35:08 user nova-compute[75571]: WARNING nova.compute.manager [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received unexpected event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with vm_state active and task_state rescuing.
Nov 28 20:35:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:35:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:35:08 user nova-compute[75571]: WARNING nova.compute.manager [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received unexpected event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with vm_state active and task_state rescuing.
Nov 28 20:35:08 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:35:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:11 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:35:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:35:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:35:14 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:35:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:16 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:35:16 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:35:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-e6f2a651-b10a-45f4-8f94-6a4426654a86" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:35:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-e6f2a651-b10a-45f4-8f94-6a4426654a86" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:35:16 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:35:16 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Updating instance_info_cache with network_info: [{"id": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "address": "fa:16:3e:ba:24:79", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a58452-a5", "ovs_interfaceid": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:35:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-e6f2a651-b10a-45f4-8f94-6a4426654a86" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:35:16 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:35:17 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:35:18 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:35:18 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:35:18 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:35:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:18 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:35:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:35:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:35:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:19 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "93698818-d7ba-4f25-a341-30e5390a829e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "93698818-d7ba-4f25-a341-30e5390a829e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:20 user nova-compute[75571]: INFO nova.compute.manager [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Detaching volume a4ee6c09-63e2-482f-bdbd-db3e6b99273d
Nov 28 20:35:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:35:20 user nova-compute[75571]: INFO nova.virt.block_device [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Attempting to driver detach volume a4ee6c09-63e2-482f-bdbd-db3e6b99273d from mountpoint /dev/vdc
Nov 28 20:35:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Attempting to detach device vdc from instance 93698818-d7ba-4f25-a341-30e5390a829e from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:35:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:35:20 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:35:20 user nova-compute[75571]:   <source dev="/dev/sde"/>
Nov 28 20:35:20 user nova-compute[75571]:   <target dev="vdc" bus="virtio"/>
Nov 28 20:35:20 user nova-compute[75571]:   <serial>a4ee6c09-63e2-482f-bdbd-db3e6b99273d</serial>
Nov 28 20:35:20 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 20:35:20 user nova-compute[75571]: </disk>
Nov 28 20:35:20 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:35:20 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Successfully detached device vdc from instance 93698818-d7ba-4f25-a341-30e5390a829e from the persistent domain config.
Nov 28 20:35:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 93698818-d7ba-4f25-a341-30e5390a829e from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:35:20 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:35:20 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:35:20 user nova-compute[75571]:   <source dev="/dev/sde"/>
Nov 28 20:35:20 user nova-compute[75571]:   <target dev="vdc" bus="virtio"/>
Nov 28 20:35:20 user nova-compute[75571]:   <serial>a4ee6c09-63e2-482f-bdbd-db3e6b99273d</serial>
Nov 28 20:35:20 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 20:35:20 user nova-compute[75571]: </disk>
Nov 28 20:35:20 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:35:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 93698818-d7ba-4f25-a341-30e5390a829e {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:35:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:22 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:35:22 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:35:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8216MB free_disk=24.744136810302734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 313a065e-94f3-4435-97af-6a16de64ca7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e6f2a651-b10a-45f4-8f94-6a4426654a86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 636a8f00-7685-4c1b-9404-cf16359dd08a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 136d54f3-eb9a-46fc-8b5f-318b68500804 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 93698818-d7ba-4f25-a341-30e5390a829e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:35:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "e6f2a651-b10a-45f4-8f94-6a4426654a86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "e6f2a651-b10a-45f4-8f94-6a4426654a86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:26 user nova-compute[75571]: INFO nova.compute.manager [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Terminating instance
Nov 28 20:35:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-4ee27c7f-59a0-4790-9022-b608d56b3f50 req-69ef7046-0650-4e9b-ad96-dad3f85179d7 service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Received event network-vif-unplugged-18a58452-a51f-448e-86d4-d6bdf0ec46cd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4ee27c7f-59a0-4790-9022-b608d56b3f50 req-69ef7046-0650-4e9b-ad96-dad3f85179d7 service nova] Acquiring lock "e6f2a651-b10a-45f4-8f94-6a4426654a86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4ee27c7f-59a0-4790-9022-b608d56b3f50 req-69ef7046-0650-4e9b-ad96-dad3f85179d7 service nova] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4ee27c7f-59a0-4790-9022-b608d56b3f50 req-69ef7046-0650-4e9b-ad96-dad3f85179d7 service nova] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-4ee27c7f-59a0-4790-9022-b608d56b3f50 req-69ef7046-0650-4e9b-ad96-dad3f85179d7 service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] No waiting events found dispatching network-vif-unplugged-18a58452-a51f-448e-86d4-d6bdf0ec46cd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-4ee27c7f-59a0-4790-9022-b608d56b3f50 req-69ef7046-0650-4e9b-ad96-dad3f85179d7 service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Received event network-vif-unplugged-18a58452-a51f-448e-86d4-d6bdf0ec46cd for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:26 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Instance destroyed successfully.
Nov 28 20:35:26 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'resources' on Instance uuid e6f2a651-b10a-45f4-8f94-6a4426654a86 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-364538158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-364538158',id=31,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:26:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd03007966db45f48ae6c22ed6f84871',ramdisk_id='',reservation_id='r-xc01l5mq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-468878',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-468878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:28:01Z,user_data=None,user_id='007af37c9a914cd5863e486c041701be',uuid=e6f2a651-b10a-45f4-8f94-6a4426654a86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "address": "fa:16:3e:ba:24:79", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a58452-a5", "ovs_interfaceid": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converting VIF {"id": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "address": "fa:16:3e:ba:24:79", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a58452-a5", "ovs_interfaceid": "18a58452-a51f-448e-86d4-d6bdf0ec46cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:24:79,bridge_name='br-int',has_traffic_filtering=True,id=18a58452-a51f-448e-86d4-d6bdf0ec46cd,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a58452-a5') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG os_vif [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:24:79,bridge_name='br-int',has_traffic_filtering=True,id=18a58452-a51f-448e-86d4-d6bdf0ec46cd,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a58452-a5') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18a58452-a5, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c98eddb8-80ec-4167-89d6-6431e16ff51d) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:26 user nova-compute[75571]: INFO os_vif [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:24:79,bridge_name='br-int',has_traffic_filtering=True,id=18a58452-a51f-448e-86d4-d6bdf0ec46cd,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a58452-a5')
Nov 28 20:35:26 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Deleting instance files /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86_del
Nov 28 20:35:26 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Deletion of /opt/stack/data/nova/instances/e6f2a651-b10a-45f4-8f94-6a4426654a86_del complete
Nov 28 20:35:26 user nova-compute[75571]: INFO nova.compute.manager [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 28 20:35:26 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:35:26 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:35:27 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:35:27 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Took 0.47 seconds to deallocate network for instance.
Nov 28 20:35:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:27 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:35:27 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:35:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:27 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Deleted allocations for instance e6f2a651-b10a-45f4-8f94-6a4426654a86
Nov 28 20:35:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.564s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-5ea2c44f-d29c-477f-8c09-1ecc7166bab8 req-0fa11b7b-5b32-4d6c-9a1f-c267dba79b68 service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Received event network-vif-plugged-18a58452-a51f-448e-86d4-d6bdf0ec46cd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:35:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5ea2c44f-d29c-477f-8c09-1ecc7166bab8 req-0fa11b7b-5b32-4d6c-9a1f-c267dba79b68 service nova] Acquiring lock "e6f2a651-b10a-45f4-8f94-6a4426654a86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5ea2c44f-d29c-477f-8c09-1ecc7166bab8 req-0fa11b7b-5b32-4d6c-9a1f-c267dba79b68 service nova] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5ea2c44f-d29c-477f-8c09-1ecc7166bab8 req-0fa11b7b-5b32-4d6c-9a1f-c267dba79b68 service nova] Lock "e6f2a651-b10a-45f4-8f94-6a4426654a86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-5ea2c44f-d29c-477f-8c09-1ecc7166bab8 req-0fa11b7b-5b32-4d6c-9a1f-c267dba79b68 service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] No waiting events found dispatching network-vif-plugged-18a58452-a51f-448e-86d4-d6bdf0ec46cd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:35:28 user nova-compute[75571]: WARNING nova.compute.manager [req-5ea2c44f-d29c-477f-8c09-1ecc7166bab8 req-0fa11b7b-5b32-4d6c-9a1f-c267dba79b68 service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Received unexpected event network-vif-plugged-18a58452-a51f-448e-86d4-d6bdf0ec46cd for instance with vm_state deleted and task_state None.
Nov 28 20:35:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-5ea2c44f-d29c-477f-8c09-1ecc7166bab8 req-0fa11b7b-5b32-4d6c-9a1f-c267dba79b68 service nova] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Received event network-vif-deleted-18a58452-a51f-448e-86d4-d6bdf0ec46cd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:35:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "136d54f3-eb9a-46fc-8b5f-318b68500804" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:30 user nova-compute[75571]: INFO nova.compute.manager [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Terminating instance
Nov 28 20:35:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:35:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG nova.compute.manager [req-38ca957d-eafc-485d-9947-93e550d2207b req-4bd4e314-93cd-4acc-bd12-e90b4e57592f service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received event network-vif-unplugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-38ca957d-eafc-485d-9947-93e550d2207b req-4bd4e314-93cd-4acc-bd12-e90b4e57592f service nova] Acquiring lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-38ca957d-eafc-485d-9947-93e550d2207b req-4bd4e314-93cd-4acc-bd12-e90b4e57592f service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-38ca957d-eafc-485d-9947-93e550d2207b req-4bd4e314-93cd-4acc-bd12-e90b4e57592f service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG nova.compute.manager [req-38ca957d-eafc-485d-9947-93e550d2207b req-4bd4e314-93cd-4acc-bd12-e90b4e57592f service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] No waiting events found dispatching network-vif-unplugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG nova.compute.manager [req-38ca957d-eafc-485d-9947-93e550d2207b req-4bd4e314-93cd-4acc-bd12-e90b4e57592f service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received event network-vif-unplugged-48a201ba-2910-4d94-b7a9-ac3878402adf for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:35:31 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Instance destroyed successfully.
Nov 28 20:35:31 user nova-compute[75571]: DEBUG nova.objects.instance [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'resources' on Instance uuid 136d54f3-eb9a-46fc-8b5f-318b68500804 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:30:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1665088042',display_name='tempest-TestMinimumBasicScenario-server-1665088042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1665088042',id=37,image_ref='06d47545-e88b-4137-81e4-ef6283307ebb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEipdzNZLqCPxCJq60u8xUyzkYMqPIO+X9JodtuRNDPqyX9NiH86q4PyHv85XM1J/imVlNMYd4EKsnbTlYoelp/NoQSXOcmQyHMjfmkcvsc+d7/aGGUQrHbku7H28CUfWA==',key_name='tempest-TestMinimumBasicScenario-661508500',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:30:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fb173b085164da1b53412e2948fbdfe',ramdisk_id='',reservation_id='r-qlcpcqq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='06d47545-e88b-4137-81e4-ef6283307ebb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1412958496',owner_user_name='tempest-TestMinimumBasicScenario-1412958496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:32:51Z,user_data=None,user_id='6722115f609e44ccad60d00c89a04ddb',uuid=136d54f3-eb9a-46fc-8b5f-318b68500804,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48a201ba-2910-4d94-b7a9-ac3878402adf", "address": "fa:16:3e:3c:93:46", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a201ba-29", "ovs_interfaceid": "48a201ba-2910-4d94-b7a9-ac3878402adf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converting VIF {"id": "48a201ba-2910-4d94-b7a9-ac3878402adf", "address": "fa:16:3e:3c:93:46", "network": {"id": "e39d0149-8def-41f4-88a9-2b447dd62342", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1622865418-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fb173b085164da1b53412e2948fbdfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a201ba-29", "ovs_interfaceid": "48a201ba-2910-4d94-b7a9-ac3878402adf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:93:46,bridge_name='br-int',has_traffic_filtering=True,id=48a201ba-2910-4d94-b7a9-ac3878402adf,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a201ba-29') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG os_vif [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:93:46,bridge_name='br-int',has_traffic_filtering=True,id=48a201ba-2910-4d94-b7a9-ac3878402adf,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a201ba-29') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48a201ba-29, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7686255-8b45-4fb6-9086-8f74df89d266) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:31 user nova-compute[75571]: INFO os_vif [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:93:46,bridge_name='br-int',has_traffic_filtering=True,id=48a201ba-2910-4d94-b7a9-ac3878402adf,network=Network(e39d0149-8def-41f4-88a9-2b447dd62342),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a201ba-29')
Nov 28 20:35:31 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Deleting instance files /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804_del
Nov 28 20:35:31 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Deletion of /opt/stack/data/nova/instances/136d54f3-eb9a-46fc-8b5f-318b68500804_del complete
Nov 28 20:35:31 user nova-compute[75571]: INFO nova.compute.manager [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 20:35:31 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:35:31 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:35:32 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:35:32 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Took 0.63 seconds to deallocate network for instance.
Nov 28 20:35:32 user nova-compute[75571]: DEBUG nova.compute.manager [req-0684da11-b7aa-4306-a5b1-7c342b0970a1 req-ad8399bc-9207-474c-add0-3bc6292afae3 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received event network-vif-deleted-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:35:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:32 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:35:32 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:35:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:32 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Deleted allocations for instance 136d54f3-eb9a-46fc-8b5f-318b68500804
Nov 28 20:35:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.066s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-a8168baf-524d-41cd-ac99-c280f110f0c0 req-24baa00b-73a9-454a-bc52-2bca24303e33 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received event network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:35:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a8168baf-524d-41cd-ac99-c280f110f0c0 req-24baa00b-73a9-454a-bc52-2bca24303e33 service nova] Acquiring lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:35:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a8168baf-524d-41cd-ac99-c280f110f0c0 req-24baa00b-73a9-454a-bc52-2bca24303e33 service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:35:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a8168baf-524d-41cd-ac99-c280f110f0c0 req-24baa00b-73a9-454a-bc52-2bca24303e33 service nova] Lock "136d54f3-eb9a-46fc-8b5f-318b68500804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-a8168baf-524d-41cd-ac99-c280f110f0c0 req-24baa00b-73a9-454a-bc52-2bca24303e33 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] No waiting events found dispatching network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:35:33 user nova-compute[75571]: WARNING nova.compute.manager [req-a8168baf-524d-41cd-ac99-c280f110f0c0 req-24baa00b-73a9-454a-bc52-2bca24303e33 service nova] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Received unexpected event network-vif-plugged-48a201ba-2910-4d94-b7a9-ac3878402adf for instance with vm_state deleted and task_state None.
Nov 28 20:35:34 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:35:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:41 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 93698818-d7ba-4f25-a341-30e5390a829e is timed out.
Nov 28 20:35:41 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Successfully detached device vdc from instance 93698818-d7ba-4f25-a341-30e5390a829e from the live domain config.
Nov 28 20:35:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRKSfjsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:35:41 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f230aa-ee2c-4cfa-ba93-1564a514a73e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:35:41 user nova-compute[75571]: No targets found.
Nov 28 20:35:41 user nova-compute[75571]: iSNS:
Nov 28 20:35:41 user nova-compute[75571]: No targets found.
Nov 28 20:35:41 user nova-compute[75571]: STATIC:
Nov 28 20:35:41 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d
Nov 28 20:35:41 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:35:41 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:35:41 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:35:41 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:35:41 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:35:41 user nova-compute[75571]: FIRMWARE:
Nov 28 20:35:41 user nova-compute[75571]: No targets found.
Nov 28 20:35:41 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:35:41 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:35:41 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[513274ff-43cf-4e2d-a55b-af756bdc3cda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00f1218-5fd7-4c43-80a3-ec8b77885b2a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:35:41 user nova-compute[75571]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d (non-flash)
Nov 28 20:35:41 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:35:41 user nova-compute[75571]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d (non-flash)
Nov 28 20:35:41 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f776811f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d'): ({'sde'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Removing single pathed devices sde {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50264dd-ac62-419b-895a-50482901b7a5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1df41f6-17fe-4e3f-8993-c76091352529]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Flushing IO for device /dev/sde {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eed9da-7a65-4acf-8d72-69318778b898]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1f7f1b-e3a5-4109-9630-894b269c7232]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] SCSI volumes sde have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7f2d46-cfb4-45f1-b28d-caa5f6d58e60]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[39707714-fe49-4b0e-be87-91adf132d1b7]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d, portal: 172.16.0.220,3260]
Nov 28 20:35:41 user nova-compute[75571]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d, portal: 172.16.0.220,3260] successful.
Nov 28 20:35:41 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ee6c09-63e2-482f-bdbd-db3e6b99273d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5fecb1-35cb-46c0-8fd9-3d950949f389]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] <== disconnect_volume: return (280ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:35:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:35:42 user nova-compute[75571]: DEBUG nova.objects.instance [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'flavor' on Instance uuid 93698818-d7ba-4f25-a341-30e5390a829e {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:35:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "93698818-d7ba-4f25-a341-30e5390a829e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.695s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:35:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:35:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:35:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5007 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:35:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:35:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:35:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:35:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:35:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:35:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:35:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:35:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:36:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:36:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:36:08 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "93698818-d7ba-4f25-a341-30e5390a829e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "93698818-d7ba-4f25-a341-30e5390a829e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "93698818-d7ba-4f25-a341-30e5390a829e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:11 user nova-compute[75571]: INFO nova.compute.manager [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Terminating instance
Nov 28 20:36:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG nova.compute.manager [req-ddcba6cb-73be-493d-97d5-95e188a9936f req-663a98c5-0a8c-4f78-a21b-8f3ac81451e1 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received event network-vif-unplugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ddcba6cb-73be-493d-97d5-95e188a9936f req-663a98c5-0a8c-4f78-a21b-8f3ac81451e1 service nova] Acquiring lock "93698818-d7ba-4f25-a341-30e5390a829e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ddcba6cb-73be-493d-97d5-95e188a9936f req-663a98c5-0a8c-4f78-a21b-8f3ac81451e1 service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ddcba6cb-73be-493d-97d5-95e188a9936f req-663a98c5-0a8c-4f78-a21b-8f3ac81451e1 service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG nova.compute.manager [req-ddcba6cb-73be-493d-97d5-95e188a9936f req-663a98c5-0a8c-4f78-a21b-8f3ac81451e1 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] No waiting events found dispatching network-vif-unplugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG nova.compute.manager [req-ddcba6cb-73be-493d-97d5-95e188a9936f req-663a98c5-0a8c-4f78-a21b-8f3ac81451e1 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received event network-vif-unplugged-4258c97f-0a86-4cf4-ade0-831330204fc8 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:11 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Instance destroyed successfully.
Nov 28 20:36:11 user nova-compute[75571]: DEBUG nova.objects.instance [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'resources' on Instance uuid 93698818-d7ba-4f25-a341-30e5390a829e {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T20:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-795547296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-795547296',id=34,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7x8JUic8LMH/YQT25GlcwZE6wPOyKaJyvQnNWy47RBRoT/KqLjj+kPL9TeFksxFwkD4J4kVT9wKi4NGz2C12ZF7NEOueU54TasYfa+Zk7dRiUyC3kjH5YG1VpVp8Hw2w==',key_name='tempest-keypair-958726701',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:33:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='292cfffce13446c8963785adfb4b9d22',ramdisk_id='',reservation_id='r-pmqejehf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1442792072',owner_user_name='tempest-AttachVolumeShelveTestJSON-1442792072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:33:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e21afd3261f4b1a87f7cbb4348fc9fe',uuid=93698818-d7ba-4f25-a341-30e5390a829e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converting VIF {"id": "4258c97f-0a86-4cf4-ade0-831330204fc8", "address": "fa:16:3e:a0:11:32", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4258c97f-0a", "ovs_interfaceid": "4258c97f-0a86-4cf4-ade0-831330204fc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:11:32,bridge_name='br-int',has_traffic_filtering=True,id=4258c97f-0a86-4cf4-ade0-831330204fc8,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4258c97f-0a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG os_vif [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:11:32,bridge_name='br-int',has_traffic_filtering=True,id=4258c97f-0a86-4cf4-ade0-831330204fc8,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4258c97f-0a') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4258c97f-0a, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a218622-c5dd-4aba-8f77-3bdf8d4d6895) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:11 user nova-compute[75571]: INFO os_vif [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:11:32,bridge_name='br-int',has_traffic_filtering=True,id=4258c97f-0a86-4cf4-ade0-831330204fc8,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4258c97f-0a')
Nov 28 20:36:11 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Deleting instance files /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e_del
Nov 28 20:36:11 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Deletion of /opt/stack/data/nova/instances/93698818-d7ba-4f25-a341-30e5390a829e_del complete
Nov 28 20:36:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:11 user nova-compute[75571]: INFO nova.compute.manager [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 20:36:11 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:36:11 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:36:12 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:36:12 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Took 0.73 seconds to deallocate network for instance.
Nov 28 20:36:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:12 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:36:12 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:36:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:12 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Deleted allocations for instance 93698818-d7ba-4f25-a341-30e5390a829e
Nov 28 20:36:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "93698818-d7ba-4f25-a341-30e5390a829e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.016s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:13 user nova-compute[75571]: DEBUG nova.compute.manager [req-7e9c8bb2-2d04-41e5-a566-2b70997d4a3c req-51cd89c4-76fc-46a0-aaee-d7bd246f6337 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received event network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7e9c8bb2-2d04-41e5-a566-2b70997d4a3c req-51cd89c4-76fc-46a0-aaee-d7bd246f6337 service nova] Acquiring lock "93698818-d7ba-4f25-a341-30e5390a829e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7e9c8bb2-2d04-41e5-a566-2b70997d4a3c req-51cd89c4-76fc-46a0-aaee-d7bd246f6337 service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7e9c8bb2-2d04-41e5-a566-2b70997d4a3c req-51cd89c4-76fc-46a0-aaee-d7bd246f6337 service nova] Lock "93698818-d7ba-4f25-a341-30e5390a829e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:13 user nova-compute[75571]: DEBUG nova.compute.manager [req-7e9c8bb2-2d04-41e5-a566-2b70997d4a3c req-51cd89c4-76fc-46a0-aaee-d7bd246f6337 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] No waiting events found dispatching network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:36:13 user nova-compute[75571]: WARNING nova.compute.manager [req-7e9c8bb2-2d04-41e5-a566-2b70997d4a3c req-51cd89c4-76fc-46a0-aaee-d7bd246f6337 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received unexpected event network-vif-plugged-4258c97f-0a86-4cf4-ade0-831330204fc8 for instance with vm_state deleted and task_state None.
Nov 28 20:36:13 user nova-compute[75571]: DEBUG nova.compute.manager [req-7e9c8bb2-2d04-41e5-a566-2b70997d4a3c req-51cd89c4-76fc-46a0-aaee-d7bd246f6337 service nova] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Received event network-vif-deleted-4258c97f-0a86-4cf4-ade0-831330204fc8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:36:14 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:36:15 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "313a065e-94f3-4435-97af-6a16de64ca7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:16 user nova-compute[75571]: INFO nova.compute.manager [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Terminating instance
Nov 28 20:36:16 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-81ef1414-3d4d-45b3-be1c-849feb92e638 req-1103eb1d-0c38-4159-8fb8-a0003d0e9920 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received event network-vif-unplugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-81ef1414-3d4d-45b3-be1c-849feb92e638 req-1103eb1d-0c38-4159-8fb8-a0003d0e9920 service nova] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-81ef1414-3d4d-45b3-be1c-849feb92e638 req-1103eb1d-0c38-4159-8fb8-a0003d0e9920 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-81ef1414-3d4d-45b3-be1c-849feb92e638 req-1103eb1d-0c38-4159-8fb8-a0003d0e9920 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-81ef1414-3d4d-45b3-be1c-849feb92e638 req-1103eb1d-0c38-4159-8fb8-a0003d0e9920 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] No waiting events found dispatching network-vif-unplugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-81ef1414-3d4d-45b3-be1c-849feb92e638 req-1103eb1d-0c38-4159-8fb8-a0003d0e9920 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received event network-vif-unplugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:16 user nova-compute[75571]: INFO nova.compute.manager [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Terminating instance
Nov 28 20:36:16 user nova-compute[75571]: DEBUG nova.compute.manager [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:36:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Instance destroyed successfully.
Nov 28 20:36:17 user nova-compute[75571]: DEBUG nova.objects.instance [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'resources' on Instance uuid 313a065e-94f3-4435-97af-6a16de64ca7c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:36:17 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Instance destroyed successfully.
Nov 28 20:36:17 user nova-compute[75571]: DEBUG nova.objects.instance [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'resources' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-519855433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-519855433',id=27,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd03007966db45f48ae6c22ed6f84871',ramdisk_id='',reservation_id='r-akcqzo3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-468878',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-468878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:24:17Z,user_data=None,user_id='007af37c9a914cd5863e486c041701be',uuid=313a065e-94f3-4435-97af-6a16de64ca7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converting VIF {"id": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "address": "fa:16:3e:36:86:6a", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b8da62-7c", "ovs_interfaceid": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=d8b8da62-7cf3-4b0d-81b0-181bc7f571bd,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b8da62-7c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_vif [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=d8b8da62-7cf3-4b0d-81b0-181bc7f571bd,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b8da62-7c') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8b8da62-7c, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:26:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-599565098',display_name='tempest-AttachVolumeTestJSON-server-599565098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-599565098',id=32,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3XwsjqlLJC+H5W8+kliU+liUVxsmiGlirVM1hB3Xvq2TAMksvSwoTdDPqxJDLnMy/epsE7znWc/yERpeFqyVO3BqmqmL465Jtof0GPEtberkTrsDvfTVDra8QzBI4sQ==',key_name='tempest-keypair-1076987994',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:26:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7d489de217644979c5888d97158a800',ramdisk_id='',reservation_id='r-8ipm7twc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-187128538',owner_user_name='tempest-AttachVolumeTestJSON-187128538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:34:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d653c87883374ab59768ce28b2b9adfc',uuid=636a8f00-7685-4c1b-9404-cf16359dd08a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converting VIF {"id": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "address": "fa:16:3e:b0:53:96", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e84680-3a", "ovs_interfaceid": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_vif [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23e84680-3a, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7b95eed-a06a-4104-855f-25e2ffe89fdc) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee1773df-c636-4b50-afd9-bf1e67822429) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: INFO os_vif [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=d8b8da62-7cf3-4b0d-81b0-181bc7f571bd,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b8da62-7c')
Nov 28 20:36:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:17 user nova-compute[75571]: INFO os_vif [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:53:96,bridge_name='br-int',has_traffic_filtering=True,id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e84680-3a')
Nov 28 20:36:17 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Deleting instance files /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a_del
Nov 28 20:36:17 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Deletion of /opt/stack/data/nova/instances/636a8f00-7685-4c1b-9404-cf16359dd08a_del complete
Nov 28 20:36:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcwTPVqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:36:17 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4c080a-d3d7-4c79-8584-71d9a30cea92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:36:17 user nova-compute[75571]: No targets found.
Nov 28 20:36:17 user nova-compute[75571]: iSNS:
Nov 28 20:36:17 user nova-compute[75571]: No targets found.
Nov 28 20:36:17 user nova-compute[75571]: STATIC:
Nov 28 20:36:17 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56
Nov 28 20:36:17 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:36:17 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:36:17 user nova-compute[75571]: FIRMWARE:
Nov 28 20:36:17 user nova-compute[75571]: No targets found.
Nov 28 20:36:17 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:36:17 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:36:17 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[78afd2f9-d4f9-4d9e-b196-ca482ca12daf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:17 user nova-compute[75571]: INFO nova.compute.manager [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Took 0.80 seconds to destroy the instance on the hypervisor.
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29fa45b-1cdf-4231-9439-682c622bf783]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:36:17 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 (non-flash)
Nov 28 20:36:17 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f774879bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56'): ({'sdd'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Removing single pathed devices sdd {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76d7cf8-206e-4f6a-a979-5d0f572a8762]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca4dc59-9e83-40e8-9793-5fc72cdc86c8]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flushing IO for device /dev/sdd {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d635c147-1d69-48d7-99b7-798976e7f9b3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[97800f17-9d9d-458f-b145-3ba627ba164f]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] SCSI volumes sdd have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[be17eda6-f057-4151-a268-9be52c20259c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[254255ea-6009-4af5-91e1-1eb214ef402a]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56, portal: 172.16.0.220,3260]
Nov 28 20:36:17 user nova-compute[75571]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56, portal: 172.16.0.220,3260] successful.
Nov 28 20:36:17 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7e2c5b2-c554-44f7-8f54-f55ee81baf56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e2e45c-992e-474e-be1b-5c6869876508]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] <== disconnect_volume: return (310ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:36:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:36:17 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Deleting instance files /opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c_del
Nov 28 20:36:17 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Deletion of /opt/stack/data/nova/instances/313a065e-94f3-4435-97af-6a16de64ca7c_del complete
Nov 28 20:36:18 user nova-compute[75571]: INFO nova.compute.manager [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Took 1.57 seconds to destroy the instance on the hypervisor.
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Skipping network cache update for instance because it is being deleted. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:36:18 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Took 0.78 seconds to deallocate network for instance.
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-bd37268d-abf1-4e37-b271-0199be4e06a6 req-ac825480-3d0f-47ab-b1dc-de35c6577b06 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-deleted-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:18 user nova-compute[75571]: INFO nova.compute.manager [req-bd37268d-abf1-4e37-b271-0199be4e06a6 req-ac825480-3d0f-47ab-b1dc-de35c6577b06 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Neutron deleted interface 23e84680-3abf-49b8-9750-1a0a3cd8b4cb; detaching it from the instance and deleting it from the info cache
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.network.neutron [req-bd37268d-abf1-4e37-b271-0199be4e06a6 req-ac825480-3d0f-47ab-b1dc-de35c6577b06 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-bd37268d-abf1-4e37-b271-0199be4e06a6 req-ac825480-3d0f-47ab-b1dc-de35c6577b06 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Detach interface failed, port_id=23e84680-3abf-49b8-9750-1a0a3cd8b4cb, reason: Instance 636a8f00-7685-4c1b-9404-cf16359dd08a could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:36:18 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Took 0.64 seconds to deallocate network for instance.
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Updating instance_info_cache with network_info: [{"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:36:18 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Deleted allocations for instance 636a8f00-7685-4c1b-9404-cf16359dd08a
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.007s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Acquiring lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "313a065e-94f3-4435-97af-6a16de64ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] No waiting events found dispatching network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:36:18 user nova-compute[75571]: WARNING nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received unexpected event network-vif-plugged-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance with vm_state active and task_state deleting.
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-unplugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-unplugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:36:18 user nova-compute[75571]: WARNING nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-unplugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state deleted and task_state None.
Nov 28 20:36:18 user nova-compute[75571]: DEBUG nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:36:19 user nova-compute[75571]: WARNING nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state deleted and task_state None.
Nov 28 20:36:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:36:19 user nova-compute[75571]: WARNING nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state deleted and task_state None.
Nov 28 20:36:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:36:19 user nova-compute[75571]: WARNING nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state deleted and task_state None.
Nov 28 20:36:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-unplugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-unplugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:36:19 user nova-compute[75571]: WARNING nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-unplugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state deleted and task_state None.
Nov 28 20:36:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Acquiring lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "636a8f00-7685-4c1b-9404-cf16359dd08a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] No waiting events found dispatching network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:36:19 user nova-compute[75571]: WARNING nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Received unexpected event network-vif-plugged-23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance with vm_state deleted and task_state None.
Nov 28 20:36:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Received event network-vif-deleted-d8b8da62-7cf3-4b0d-81b0-181bc7f571bd {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:36:19 user nova-compute[75571]: INFO nova.compute.manager [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Took 0.76 seconds to detach 1 volumes for instance.
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:19 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Deleted allocations for instance 313a065e-94f3-4435-97af-6a16de64ca7c
Nov 28 20:36:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "313a065e-94f3-4435-97af-6a16de64ca7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.389s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:20 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:36:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:20 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:36:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:20 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:36:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:36:22 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:36:22 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:36:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8603MB free_disk=24.951854705810547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:36:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:36:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:36:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:36:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:36:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:36:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:22 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:36:22 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:36:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:36:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:36:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:36:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:36:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:36:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:36:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:36:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:36:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:36:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:36:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:36:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:36:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:36:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:36:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:36:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:36:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:36:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:36:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:36:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:36:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:54 user nova-compute[75571]: INFO nova.compute.manager [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Unrescuing
Nov 28 20:36:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:36:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquired lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:36:54 user nova-compute[75571]: DEBUG nova.network.neutron [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:36:54 user nova-compute[75571]: DEBUG nova.network.neutron [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Updating instance_info_cache with network_info: [{"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:36:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Releasing lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:36:54 user nova-compute[75571]: DEBUG nova.objects.instance [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'flavor' on Instance uuid 29443f30-6d05-4148-9185-a31f78b4a68f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:36:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-74805017-f5d4-4861-8c77-9cb537899fca req-141d937f-431f-4886-b1c7-b745740f9836 service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-unplugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-74805017-f5d4-4861-8c77-9cb537899fca req-141d937f-431f-4886-b1c7-b745740f9836 service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-74805017-f5d4-4861-8c77-9cb537899fca req-141d937f-431f-4886-b1c7-b745740f9836 service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-74805017-f5d4-4861-8c77-9cb537899fca req-141d937f-431f-4886-b1c7-b745740f9836 service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-74805017-f5d4-4861-8c77-9cb537899fca req-141d937f-431f-4886-b1c7-b745740f9836 service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-unplugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:36:55 user nova-compute[75571]: WARNING nova.compute.manager [req-74805017-f5d4-4861-8c77-9cb537899fca req-141d937f-431f-4886-b1c7-b745740f9836 service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received unexpected event network-vif-unplugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:36:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:55 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Instance destroyed successfully.
Nov 28 20:36:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:57 user nova-compute[75571]: DEBUG nova.compute.manager [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:57 user nova-compute[75571]: DEBUG nova.compute.manager [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:36:57 user nova-compute[75571]: WARNING nova.compute.manager [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received unexpected event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:36:57 user nova-compute[75571]: DEBUG nova.compute.manager [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:57 user nova-compute[75571]: DEBUG nova.compute.manager [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:36:57 user nova-compute[75571]: WARNING nova.compute.manager [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received unexpected event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:36:57 user nova-compute[75571]: DEBUG nova.compute.manager [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:36:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:36:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:36:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:36:57 user nova-compute[75571]: DEBUG nova.compute.manager [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:36:57 user nova-compute[75571]: WARNING nova.compute.manager [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received unexpected event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:36:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:36:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:36:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "b2c27e15-6791-4d75-8df0-957c10d7ca42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:37:05 user nova-compute[75571]: INFO nova.compute.claims [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Claim successful on node user
Nov 28 20:37:05 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG nova.network.neutron [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:37:05 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:37:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG nova.policy [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:37:05 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Creating image(s)
Nov 28 20:37:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "/opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "/opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk 1073741824" returned: 0 in 0.049s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:06 user nova-compute[75571]: DEBUG nova.network.neutron [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Successfully created port: bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:37:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:06 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:37:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:06 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Cannot resize image /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:37:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:37:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Ensure instance console log exists: /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:37:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.network.neutron [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Successfully updated port: bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquired lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.network.neutron [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-37bd3382-2b4b-4e3c-9703-0fc43d9276c7 req-5bd9c019-868e-4f38-8408-206caa7344e3 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received event network-changed-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-37bd3382-2b4b-4e3c-9703-0fc43d9276c7 req-5bd9c019-868e-4f38-8408-206caa7344e3 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Refreshing instance network info cache due to event network-changed-bc13ffb2-0ccf-4e86-8502-bea728a1e20f. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-37bd3382-2b4b-4e3c-9703-0fc43d9276c7 req-5bd9c019-868e-4f38-8408-206caa7344e3 service nova] Acquiring lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.network.neutron [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:07 user nova-compute[75571]: INFO nova.compute.manager [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Terminating instance
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.compute.manager [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-439ac0e9-8cb3-4c00-8dd7-7d4f6b578069 req-b6fa7a91-2228-4d41-970a-d23272ddf81a service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Received event network-vif-unplugged-fc196680-3f93-4710-b508-752c9aa39f18 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-439ac0e9-8cb3-4c00-8dd7-7d4f6b578069 req-b6fa7a91-2228-4d41-970a-d23272ddf81a service nova] Acquiring lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-439ac0e9-8cb3-4c00-8dd7-7d4f6b578069 req-b6fa7a91-2228-4d41-970a-d23272ddf81a service nova] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-439ac0e9-8cb3-4c00-8dd7-7d4f6b578069 req-b6fa7a91-2228-4d41-970a-d23272ddf81a service nova] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-439ac0e9-8cb3-4c00-8dd7-7d4f6b578069 req-b6fa7a91-2228-4d41-970a-d23272ddf81a service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] No waiting events found dispatching network-vif-unplugged-fc196680-3f93-4710-b508-752c9aa39f18 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-439ac0e9-8cb3-4c00-8dd7-7d4f6b578069 req-b6fa7a91-2228-4d41-970a-d23272ddf81a service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Received event network-vif-unplugged-fc196680-3f93-4710-b508-752c9aa39f18 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.network.neutron [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Updating instance_info_cache with network_info: [{"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Releasing lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.compute.manager [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Instance network_info: |[{"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-37bd3382-2b4b-4e3c-9703-0fc43d9276c7 req-5bd9c019-868e-4f38-8408-206caa7344e3 service nova] Acquired lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.network.neutron [req-37bd3382-2b4b-4e3c-9703-0fc43d9276c7 req-5bd9c019-868e-4f38-8408-206caa7344e3 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Refreshing network info cache for port bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Start _get_guest_xml network_info=[{"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:37:07 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:37:07 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1654201794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1654201794',id=38,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf7rbfGmkbg9QNV+1Z0B5neiR0PzgqzwGOYvM5FfRWYx4MTDS+q5fQSTS7YZMLSQKaPn3qR8rnvfsfmD+tnK7T3zFPx8mNCJ/Lwe8ouSkwiQJ7T9kBYNHl5Hsq+Bpyrbw==',key_name='tempest-keypair-144574904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='292cfffce13446c8963785adfb4b9d22',ramdisk_id='',reservation_id='r-f7h5ryu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1442792072',owner_user_name='tempest-AttachVolumeShelveTestJSON-1442792072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:37:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e21afd3261f4b1a87f7cbb4348fc9fe',uuid=b2c27e15-6791-4d75-8df0-957c10d7ca42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converting VIF {"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:54:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc13ffb2-0ccf-4e86-8502-bea728a1e20f,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc13ffb2-0c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.objects.instance [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'pci_devices' on Instance uuid b2c27e15-6791-4d75-8df0-957c10d7ca42 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:37:07 user nova-compute[75571]:   <uuid>b2c27e15-6791-4d75-8df0-957c10d7ca42</uuid>
Nov 28 20:37:07 user nova-compute[75571]:   <name>instance-00000026</name>
Nov 28 20:37:07 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:37:07 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:37:07 user nova-compute[75571]:   <metadata>
Nov 28 20:37:07 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:37:07 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:37:07 user nova-compute[75571]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1654201794</nova:name>
Nov 28 20:37:07 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:37:07</nova:creationTime>
Nov 28 20:37:07 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:37:07 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:37:07 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:37:07 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:37:07 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:37:07 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:37:07 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:37:07 user nova-compute[75571]:       <nova:owner>
Nov 28 20:37:07 user nova-compute[75571]:         <nova:user uuid="9e21afd3261f4b1a87f7cbb4348fc9fe">tempest-AttachVolumeShelveTestJSON-1442792072-project-member</nova:user>
Nov 28 20:37:07 user nova-compute[75571]:         <nova:project uuid="292cfffce13446c8963785adfb4b9d22">tempest-AttachVolumeShelveTestJSON-1442792072</nova:project>
Nov 28 20:37:07 user nova-compute[75571]:       </nova:owner>
Nov 28 20:37:07 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:37:07 user nova-compute[75571]:       <nova:ports>
Nov 28 20:37:07 user nova-compute[75571]:         <nova:port uuid="bc13ffb2-0ccf-4e86-8502-bea728a1e20f">
Nov 28 20:37:07 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:37:07 user nova-compute[75571]:         </nova:port>
Nov 28 20:37:07 user nova-compute[75571]:       </nova:ports>
Nov 28 20:37:07 user nova-compute[75571]:     </nova:instance>
Nov 28 20:37:07 user nova-compute[75571]:   </metadata>
Nov 28 20:37:07 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:37:07 user nova-compute[75571]:     <system>
Nov 28 20:37:07 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:37:07 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:37:07 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:37:07 user nova-compute[75571]:       <entry name="serial">b2c27e15-6791-4d75-8df0-957c10d7ca42</entry>
Nov 28 20:37:07 user nova-compute[75571]:       <entry name="uuid">b2c27e15-6791-4d75-8df0-957c10d7ca42</entry>
Nov 28 20:37:07 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:37:07 user nova-compute[75571]:     </system>
Nov 28 20:37:07 user nova-compute[75571]:   </sysinfo>
Nov 28 20:37:07 user nova-compute[75571]:   <os>
Nov 28 20:37:07 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:37:07 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:37:07 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:37:07 user nova-compute[75571]:   </os>
Nov 28 20:37:07 user nova-compute[75571]:   <features>
Nov 28 20:37:07 user nova-compute[75571]:     <acpi/>
Nov 28 20:37:07 user nova-compute[75571]:     <apic/>
Nov 28 20:37:07 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:37:07 user nova-compute[75571]:   </features>
Nov 28 20:37:07 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:37:07 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:37:07 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:37:07 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:37:07 user nova-compute[75571]:   </clock>
Nov 28 20:37:07 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:37:07 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:37:07 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:37:07 user nova-compute[75571]:   </cpu>
Nov 28 20:37:07 user nova-compute[75571]:   <devices>
Nov 28 20:37:07 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:37:07 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:37:07 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk"/>
Nov 28 20:37:07 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:37:07 user nova-compute[75571]:     </disk>
Nov 28 20:37:07 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:37:07 user nova-compute[75571]:       <mac address="fa:16:3e:34:54:0f"/>
Nov 28 20:37:07 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:37:07 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:37:07 user nova-compute[75571]:       <target dev="tapbc13ffb2-0c"/>
Nov 28 20:37:07 user nova-compute[75571]:     </interface>
Nov 28 20:37:07 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:37:07 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/console.log" append="off"/>
Nov 28 20:37:07 user nova-compute[75571]:     </serial>
Nov 28 20:37:07 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:37:07 user nova-compute[75571]:     <video>
Nov 28 20:37:07 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:37:07 user nova-compute[75571]:     </video>
Nov 28 20:37:07 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:37:07 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:37:07 user nova-compute[75571]:     </rng>
Nov 28 20:37:07 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:37:07 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:37:07 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:37:07 user nova-compute[75571]:     </memballoon>
Nov 28 20:37:07 user nova-compute[75571]:   </devices>
Nov 28 20:37:07 user nova-compute[75571]: </domain>
Nov 28 20:37:07 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1654201794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1654201794',id=38,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf7rbfGmkbg9QNV+1Z0B5neiR0PzgqzwGOYvM5FfRWYx4MTDS+q5fQSTS7YZMLSQKaPn3qR8rnvfsfmD+tnK7T3zFPx8mNCJ/Lwe8ouSkwiQJ7T9kBYNHl5Hsq+Bpyrbw==',key_name='tempest-keypair-144574904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='292cfffce13446c8963785adfb4b9d22',ramdisk_id='',reservation_id='r-f7h5ryu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1442792072',owner_user_name='tempest-AttachVolumeShelveTestJSON-1442792072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:37:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e21afd3261f4b1a87f7cbb4348fc9fe',uuid=b2c27e15-6791-4d75-8df0-957c10d7ca42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converting VIF {"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:54:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc13ffb2-0ccf-4e86-8502-bea728a1e20f,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc13ffb2-0c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG os_vif [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:54:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc13ffb2-0ccf-4e86-8502-bea728a1e20f,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc13ffb2-0c') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e95c4b2-4eae-5079-8302-42afca31404c', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc13ffb2-0c, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc13ffb2-0c, col_values=(('qos', UUID('ff47af60-d3a5-490b-a055-845c0e94ccda')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc13ffb2-0c, col_values=(('external_ids', {'iface-id': 'bc13ffb2-0ccf-4e86-8502-bea728a1e20f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:54:0f', 'vm-uuid': 'b2c27e15-6791-4d75-8df0-957c10d7ca42'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:07 user nova-compute[75571]: INFO os_vif [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:54:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc13ffb2-0ccf-4e86-8502-bea728a1e20f,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc13ffb2-0c')
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:37:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] No VIF found with MAC fa:16:3e:34:54:0f, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG nova.network.neutron [req-37bd3382-2b4b-4e3c-9703-0fc43d9276c7 req-5bd9c019-868e-4f38-8408-206caa7344e3 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Updated VIF entry in instance network info cache for port bc13ffb2-0ccf-4e86-8502-bea728a1e20f. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG nova.network.neutron [req-37bd3382-2b4b-4e3c-9703-0fc43d9276c7 req-5bd9c019-868e-4f38-8408-206caa7344e3 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Updating instance_info_cache with network_info: [{"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-37bd3382-2b4b-4e3c-9703-0fc43d9276c7 req-5bd9c019-868e-4f38-8408-206caa7344e3 service nova] Releasing lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:37:08 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Instance destroyed successfully.
Nov 28 20:37:08 user nova-compute[75571]: DEBUG nova.objects.instance [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'resources' on Instance uuid 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-594759002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-594759002',id=19,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:16:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd03007966db45f48ae6c22ed6f84871',ramdisk_id='',reservation_id='r-e5xzkgbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-468878',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-468878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:18:38Z,user_data=None,user_id='007af37c9a914cd5863e486c041701be',uuid=4549e2e1-350f-47ce-80ef-8a2a8a6ef62e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc196680-3f93-4710-b508-752c9aa39f18", "address": "fa:16:3e:44:80:a9", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc196680-3f", "ovs_interfaceid": "fc196680-3f93-4710-b508-752c9aa39f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converting VIF {"id": "fc196680-3f93-4710-b508-752c9aa39f18", "address": "fa:16:3e:44:80:a9", "network": {"id": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1214768546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd03007966db45f48ae6c22ed6f84871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc196680-3f", "ovs_interfaceid": "fc196680-3f93-4710-b508-752c9aa39f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:80:a9,bridge_name='br-int',has_traffic_filtering=True,id=fc196680-3f93-4710-b508-752c9aa39f18,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc196680-3f') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG os_vif [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:80:a9,bridge_name='br-int',has_traffic_filtering=True,id=fc196680-3f93-4710-b508-752c9aa39f18,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc196680-3f') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc196680-3f, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=203d781f-5e54-49c2-bbc6-cb7f6cb64ed3) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:08 user nova-compute[75571]: INFO os_vif [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:80:a9,bridge_name='br-int',has_traffic_filtering=True,id=fc196680-3f93-4710-b508-752c9aa39f18,network=Network(60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc196680-3f')
Nov 28 20:37:08 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Deleting instance files /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e_del
Nov 28 20:37:08 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Deletion of /opt/stack/data/nova/instances/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e_del complete
Nov 28 20:37:08 user nova-compute[75571]: INFO nova.compute.manager [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Took 1.52 seconds to destroy the instance on the hypervisor.
Nov 28 20:37:08 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:37:08 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-ee667d0c-a72a-4581-8d00-65fbe6da0bee req-c739b471-b906-4db9-aff8-595f14f0398f service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Received event network-vif-deleted-fc196680-3f93-4710-b508-752c9aa39f18 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:37:09 user nova-compute[75571]: INFO nova.compute.manager [req-ee667d0c-a72a-4581-8d00-65fbe6da0bee req-c739b471-b906-4db9-aff8-595f14f0398f service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Neutron deleted interface fc196680-3f93-4710-b508-752c9aa39f18; detaching it from the instance and deleting it from the info cache
Nov 28 20:37:09 user nova-compute[75571]: DEBUG nova.network.neutron [req-ee667d0c-a72a-4581-8d00-65fbe6da0bee req-c739b471-b906-4db9-aff8-595f14f0398f service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:37:09 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Took 0.45 seconds to deallocate network for instance.
Nov 28 20:37:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-ee667d0c-a72a-4581-8d00-65fbe6da0bee req-c739b471-b906-4db9-aff8-595f14f0398f service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Detach interface failed, port_id=fc196680-3f93-4710-b508-752c9aa39f18, reason: Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-bee1e470-8a86-4100-ac45-5e8a1f02b93e req-b07cd1d2-94ce-412b-9405-22541d4f97b5 service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Received event network-vif-plugged-fc196680-3f93-4710-b508-752c9aa39f18 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bee1e470-8a86-4100-ac45-5e8a1f02b93e req-b07cd1d2-94ce-412b-9405-22541d4f97b5 service nova] Acquiring lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bee1e470-8a86-4100-ac45-5e8a1f02b93e req-b07cd1d2-94ce-412b-9405-22541d4f97b5 service nova] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-bee1e470-8a86-4100-ac45-5e8a1f02b93e req-b07cd1d2-94ce-412b-9405-22541d4f97b5 service nova] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG nova.compute.manager [req-bee1e470-8a86-4100-ac45-5e8a1f02b93e req-b07cd1d2-94ce-412b-9405-22541d4f97b5 service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] No waiting events found dispatching network-vif-plugged-fc196680-3f93-4710-b508-752c9aa39f18 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:37:09 user nova-compute[75571]: WARNING nova.compute.manager [req-bee1e470-8a86-4100-ac45-5e8a1f02b93e req-b07cd1d2-94ce-412b-9405-22541d4f97b5 service nova] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Received unexpected event network-vif-plugged-fc196680-3f93-4710-b508-752c9aa39f18 for instance with vm_state deleted and task_state None.
Nov 28 20:37:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:09 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Deleted allocations for instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e
Nov 28 20:37:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.489s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:10 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:37:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:37:11 user nova-compute[75571]: INFO nova.compute.claims [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Claim successful on node user
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.network.neutron [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:37:11 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.policy [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:37:11 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Instance spawned successfully.
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:37:11 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Creating image(s)
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "/opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "/opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:11 user nova-compute[75571]: INFO nova.compute.manager [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.compute.manager [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received event network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] Acquiring lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.compute.manager [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] No waiting events found dispatching network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:37:11 user nova-compute[75571]: WARNING nova.compute.manager [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received unexpected event network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance with vm_state building and task_state spawning.
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.compute.manager [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received event network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] Acquiring lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG nova.compute.manager [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] No waiting events found dispatching network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:37:11 user nova-compute[75571]: WARNING nova.compute.manager [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received unexpected event network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance with vm_state building and task_state spawning.
Nov 28 20:37:11 user nova-compute[75571]: INFO nova.compute.manager [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Took 6.67 seconds to build instance.
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.774s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.187s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk 1073741824" returned: 0 in 0.056s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Successfully created port: 3319037b-9d8f-47bd-908f-12f61b7ceea2 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Cannot resize image /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Ensure instance console log exists: /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Successfully updated port: 3319037b-9d8f-47bd-908f-12f61b7ceea2 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "refresh_cache-3a2c4b6b-0fc7-4299-89ca-2d885e893854" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquired lock "refresh_cache-3a2c4b6b-0fc7-4299-89ca-2d885e893854" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-52156f42-e997-417a-8631-c933f45b29ce req-5fa58498-4755-49dc-8048-fe9f21d43f3b service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Received event network-changed-3319037b-9d8f-47bd-908f-12f61b7ceea2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-52156f42-e997-417a-8631-c933f45b29ce req-5fa58498-4755-49dc-8048-fe9f21d43f3b service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Refreshing instance network info cache due to event network-changed-3319037b-9d8f-47bd-908f-12f61b7ceea2. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-52156f42-e997-417a-8631-c933f45b29ce req-5fa58498-4755-49dc-8048-fe9f21d43f3b service nova] Acquiring lock "refresh_cache-3a2c4b6b-0fc7-4299-89ca-2d885e893854" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:37:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.network.neutron [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Updating instance_info_cache with network_info: [{"id": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "address": "fa:16:3e:f5:7d:bb", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319037b-9d", "ovs_interfaceid": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Releasing lock "refresh_cache-3a2c4b6b-0fc7-4299-89ca-2d885e893854" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Instance network_info: |[{"id": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "address": "fa:16:3e:f5:7d:bb", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319037b-9d", "ovs_interfaceid": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-52156f42-e997-417a-8631-c933f45b29ce req-5fa58498-4755-49dc-8048-fe9f21d43f3b service nova] Acquired lock "refresh_cache-3a2c4b6b-0fc7-4299-89ca-2d885e893854" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.network.neutron [req-52156f42-e997-417a-8631-c933f45b29ce req-5fa58498-4755-49dc-8048-fe9f21d43f3b service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Refreshing network info cache for port 3319037b-9d8f-47bd-908f-12f61b7ceea2 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Start _get_guest_xml network_info=[{"id": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "address": "fa:16:3e:f5:7d:bb", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319037b-9d", "ovs_interfaceid": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:37:13 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:37:13 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:37:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1098397521',display_name='tempest-AttachVolumeTestJSON-server-1098397521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1098397521',id=39,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHivpLEFHewBe75hA3vkXVSjm2rcngDMU8MzWAIs9hr82dC1yHwnlNAxOq+tbMixYbmJJZUyNtQZmq1b7++eaR9Vu9hM9QDPdVYXt+qPAysMg305JJHiOKta1HBk/xHvA==',key_name='tempest-keypair-1870450819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7d489de217644979c5888d97158a800',ramdisk_id='',reservation_id='r-cvtd5mta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-187128538',owner_user_name='tempest-AttachVolumeTestJSON-187128538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d653c87883374ab59768ce28b2b9adfc',uuid=3a2c4b6b-0fc7-4299-89ca-2d885e893854,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "address": "fa:16:3e:f5:7d:bb", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319037b-9d", "ovs_interfaceid": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converting VIF {"id": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "address": "fa:16:3e:f5:7d:bb", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319037b-9d", "ovs_interfaceid": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=3319037b-9d8f-47bd-908f-12f61b7ceea2,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319037b-9d') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.objects.instance [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a2c4b6b-0fc7-4299-89ca-2d885e893854 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:37:13 user nova-compute[75571]:   <uuid>3a2c4b6b-0fc7-4299-89ca-2d885e893854</uuid>
Nov 28 20:37:13 user nova-compute[75571]:   <name>instance-00000027</name>
Nov 28 20:37:13 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:37:13 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:37:13 user nova-compute[75571]:   <metadata>
Nov 28 20:37:13 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:37:13 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:37:13 user nova-compute[75571]:       <nova:name>tempest-AttachVolumeTestJSON-server-1098397521</nova:name>
Nov 28 20:37:13 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:37:13</nova:creationTime>
Nov 28 20:37:13 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:37:13 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:37:13 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:37:13 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:37:13 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:37:13 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:37:13 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:37:13 user nova-compute[75571]:       <nova:owner>
Nov 28 20:37:13 user nova-compute[75571]:         <nova:user uuid="d653c87883374ab59768ce28b2b9adfc">tempest-AttachVolumeTestJSON-187128538-project-member</nova:user>
Nov 28 20:37:13 user nova-compute[75571]:         <nova:project uuid="a7d489de217644979c5888d97158a800">tempest-AttachVolumeTestJSON-187128538</nova:project>
Nov 28 20:37:13 user nova-compute[75571]:       </nova:owner>
Nov 28 20:37:13 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:37:13 user nova-compute[75571]:       <nova:ports>
Nov 28 20:37:13 user nova-compute[75571]:         <nova:port uuid="3319037b-9d8f-47bd-908f-12f61b7ceea2">
Nov 28 20:37:13 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 20:37:13 user nova-compute[75571]:         </nova:port>
Nov 28 20:37:13 user nova-compute[75571]:       </nova:ports>
Nov 28 20:37:13 user nova-compute[75571]:     </nova:instance>
Nov 28 20:37:13 user nova-compute[75571]:   </metadata>
Nov 28 20:37:13 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:37:13 user nova-compute[75571]:     <system>
Nov 28 20:37:13 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:37:13 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:37:13 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:37:13 user nova-compute[75571]:       <entry name="serial">3a2c4b6b-0fc7-4299-89ca-2d885e893854</entry>
Nov 28 20:37:13 user nova-compute[75571]:       <entry name="uuid">3a2c4b6b-0fc7-4299-89ca-2d885e893854</entry>
Nov 28 20:37:13 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:37:13 user nova-compute[75571]:     </system>
Nov 28 20:37:13 user nova-compute[75571]:   </sysinfo>
Nov 28 20:37:13 user nova-compute[75571]:   <os>
Nov 28 20:37:13 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:37:13 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:37:13 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:37:13 user nova-compute[75571]:   </os>
Nov 28 20:37:13 user nova-compute[75571]:   <features>
Nov 28 20:37:13 user nova-compute[75571]:     <acpi/>
Nov 28 20:37:13 user nova-compute[75571]:     <apic/>
Nov 28 20:37:13 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:37:13 user nova-compute[75571]:   </features>
Nov 28 20:37:13 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:37:13 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:37:13 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:37:13 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:37:13 user nova-compute[75571]:   </clock>
Nov 28 20:37:13 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:37:13 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:37:13 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:37:13 user nova-compute[75571]:   </cpu>
Nov 28 20:37:13 user nova-compute[75571]:   <devices>
Nov 28 20:37:13 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:37:13 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:37:13 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk"/>
Nov 28 20:37:13 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:37:13 user nova-compute[75571]:     </disk>
Nov 28 20:37:13 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:37:13 user nova-compute[75571]:       <mac address="fa:16:3e:f5:7d:bb"/>
Nov 28 20:37:13 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:37:13 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:37:13 user nova-compute[75571]:       <target dev="tap3319037b-9d"/>
Nov 28 20:37:13 user nova-compute[75571]:     </interface>
Nov 28 20:37:13 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:37:13 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/console.log" append="off"/>
Nov 28 20:37:13 user nova-compute[75571]:     </serial>
Nov 28 20:37:13 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:37:13 user nova-compute[75571]:     <video>
Nov 28 20:37:13 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:37:13 user nova-compute[75571]:     </video>
Nov 28 20:37:13 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:37:13 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:37:13 user nova-compute[75571]:     </rng>
Nov 28 20:37:13 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:37:13 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:37:13 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:37:13 user nova-compute[75571]:     </memballoon>
Nov 28 20:37:13 user nova-compute[75571]:   </devices>
Nov 28 20:37:13 user nova-compute[75571]: </domain>
Nov 28 20:37:13 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:37:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1098397521',display_name='tempest-AttachVolumeTestJSON-server-1098397521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1098397521',id=39,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHivpLEFHewBe75hA3vkXVSjm2rcngDMU8MzWAIs9hr82dC1yHwnlNAxOq+tbMixYbmJJZUyNtQZmq1b7++eaR9Vu9hM9QDPdVYXt+qPAysMg305JJHiOKta1HBk/xHvA==',key_name='tempest-keypair-1870450819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7d489de217644979c5888d97158a800',ramdisk_id='',reservation_id='r-cvtd5mta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-187128538',owner_user_name='tempest-AttachVolumeTestJSON-187128538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d653c87883374ab59768ce28b2b9adfc',uuid=3a2c4b6b-0fc7-4299-89ca-2d885e893854,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "address": "fa:16:3e:f5:7d:bb", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319037b-9d", "ovs_interfaceid": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converting VIF {"id": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "address": "fa:16:3e:f5:7d:bb", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319037b-9d", "ovs_interfaceid": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=3319037b-9d8f-47bd-908f-12f61b7ceea2,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319037b-9d') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG os_vif [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=3319037b-9d8f-47bd-908f-12f61b7ceea2,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319037b-9d') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6c281d0-b3fa-5947-b9c8-8fb9be97fb56', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3319037b-9d, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3319037b-9d, col_values=(('qos', UUID('43f248e3-32eb-4553-846e-af7631298025')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3319037b-9d, col_values=(('external_ids', {'iface-id': '3319037b-9d8f-47bd-908f-12f61b7ceea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:7d:bb', 'vm-uuid': '3a2c4b6b-0fc7-4299-89ca-2d885e893854'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:13 user nova-compute[75571]: INFO os_vif [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=3319037b-9d8f-47bd-908f-12f61b7ceea2,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319037b-9d')
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] No VIF found with MAC fa:16:3e:f5:7d:bb, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.network.neutron [req-52156f42-e997-417a-8631-c933f45b29ce req-5fa58498-4755-49dc-8048-fe9f21d43f3b service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Updated VIF entry in instance network info cache for port 3319037b-9d8f-47bd-908f-12f61b7ceea2. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG nova.network.neutron [req-52156f42-e997-417a-8631-c933f45b29ce req-5fa58498-4755-49dc-8048-fe9f21d43f3b service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Updating instance_info_cache with network_info: [{"id": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "address": "fa:16:3e:f5:7d:bb", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319037b-9d", "ovs_interfaceid": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:37:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-52156f42-e997-417a-8631-c933f45b29ce req-5fa58498-4755-49dc-8048-fe9f21d43f3b service nova] Releasing lock "refresh_cache-3a2c4b6b-0fc7-4299-89ca-2d885e893854" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:37:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:37:14 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:37:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:37:14 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 20:37:14 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] There are 0 instances to clean {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 20:37:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-1389f169-2b02-4953-a86b-08491eea06f5 req-82ae72cf-faf5-4b50-a8d8-8ef830ffbff0 service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Received event network-vif-plugged-3319037b-9d8f-47bd-908f-12f61b7ceea2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:37:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1389f169-2b02-4953-a86b-08491eea06f5 req-82ae72cf-faf5-4b50-a8d8-8ef830ffbff0 service nova] Acquiring lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1389f169-2b02-4953-a86b-08491eea06f5 req-82ae72cf-faf5-4b50-a8d8-8ef830ffbff0 service nova] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1389f169-2b02-4953-a86b-08491eea06f5 req-82ae72cf-faf5-4b50-a8d8-8ef830ffbff0 service nova] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-1389f169-2b02-4953-a86b-08491eea06f5 req-82ae72cf-faf5-4b50-a8d8-8ef830ffbff0 service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] No waiting events found dispatching network-vif-plugged-3319037b-9d8f-47bd-908f-12f61b7ceea2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:37:14 user nova-compute[75571]: WARNING nova.compute.manager [req-1389f169-2b02-4953-a86b-08491eea06f5 req-82ae72cf-faf5-4b50-a8d8-8ef830ffbff0 service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Received unexpected event network-vif-plugged-3319037b-9d8f-47bd-908f-12f61b7ceea2 for instance with vm_state building and task_state spawning.
Nov 28 20:37:15 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:37:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:16 user nova-compute[75571]: DEBUG nova.compute.manager [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:37:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:37:16 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Instance spawned successfully.
Nov 28 20:37:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:37:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:37:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:37:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:37:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:37:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:37:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:37:16 user nova-compute[75571]: INFO nova.compute.manager [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 28 20:37:16 user nova-compute[75571]: DEBUG nova.compute.manager [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:37:17 user nova-compute[75571]: INFO nova.compute.manager [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Took 5.96 seconds to build instance.
Nov 28 20:37:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.053s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-2c26b0c1-a85a-485c-a3fc-d48967ca37a8 req-82c4ff02-4862-49c2-bca9-31ee42cf4146 service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Received event network-vif-plugged-3319037b-9d8f-47bd-908f-12f61b7ceea2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:37:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2c26b0c1-a85a-485c-a3fc-d48967ca37a8 req-82c4ff02-4862-49c2-bca9-31ee42cf4146 service nova] Acquiring lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2c26b0c1-a85a-485c-a3fc-d48967ca37a8 req-82c4ff02-4862-49c2-bca9-31ee42cf4146 service nova] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-2c26b0c1-a85a-485c-a3fc-d48967ca37a8 req-82c4ff02-4862-49c2-bca9-31ee42cf4146 service nova] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-2c26b0c1-a85a-485c-a3fc-d48967ca37a8 req-82c4ff02-4862-49c2-bca9-31ee42cf4146 service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] No waiting events found dispatching network-vif-plugged-3319037b-9d8f-47bd-908f-12f61b7ceea2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:37:17 user nova-compute[75571]: WARNING nova.compute.manager [req-2c26b0c1-a85a-485c-a3fc-d48967ca37a8 req-82c4ff02-4862-49c2-bca9-31ee42cf4146 service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Received unexpected event network-vif-plugged-3319037b-9d8f-47bd-908f-12f61b7ceea2 for instance with vm_state active and task_state None.
Nov 28 20:37:18 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:37:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:37:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:37:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:37:18 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:37:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:18 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Updating instance_info_cache with network_info: [{"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:37:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:37:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:37:18 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:37:19 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:37:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:21 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:37:21 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:37:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:21 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:37:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:21 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:23 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:37:23 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:37:23 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8572MB free_disk=25.112659454345703GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance b2c27e15-6791-4d75-8df0-957c10d7ca42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing inventories for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating ProviderTree inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing aggregate associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, aggregates: None {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing trait associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:37:23 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:37:24 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:37:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:27 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:37:27 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75571) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 20:37:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:34 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:37:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:38 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:37:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid 29443f30-6d05-4148-9185-a31f78b4a68f {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid def2369e-4d57-482b-aef9-dab7c3a7cb84 {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid b2c27e15-6791-4d75-8df0-957c10d7ca42 {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid 3a2c4b6b-0fc7-4299-89ca-2d885e893854 {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "29443f30-6d05-4148-9185-a31f78b4a68f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "def2369e-4d57-482b-aef9-dab7c3a7cb84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "b2c27e15-6791-4d75-8df0-957c10d7ca42" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "29443f30-6d05-4148-9185-a31f78b4a68f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:37:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:37:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:37:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:10 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:38:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:38:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:38:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:38:14 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:38:17 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:38:18 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:38:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:38:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 20:38:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:19 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:38:19 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:22 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:24 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:38:24 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:38:24 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8611MB free_disk=25.054973602294922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:38:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:24 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:38:24 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:38:24 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance b2c27e15-6791-4d75-8df0-957c10d7ca42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:38:24 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:38:24 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:38:24 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:38:24 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:38:24 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:38:24 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:38:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "899045e8-9836-4139-9546-78f57348a234" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "899045e8-9836-4139-9546-78f57348a234" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:31 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:38:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:31 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:38:31 user nova-compute[75571]: INFO nova.compute.claims [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Claim successful on node user
Nov 28 20:38:32 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:38:32 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:38:32 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG nova.policy [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69f82221168549d5a500a9553ed98c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17c476044c24a87bb1e78cba8b2d4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:38:32 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Creating image(s)
Nov 28 20:38:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "/opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "/opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "/opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.195s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk 1073741824" returned: 0 in 0.055s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:32 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Successfully created port: 440b18b0-f9a0-422c-a9a9-1cd0f25af43d {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Cannot resize image /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Ensure instance console log exists: /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Successfully updated port: 440b18b0-f9a0-422c-a9a9-1cd0f25af43d {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-f8e9b5ed-43c9-4fb7-97ed-d78c4024926a req-d310c8c6-c620-4ea9-9228-c766092eebbc service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Received event network-changed-440b18b0-f9a0-422c-a9a9-1cd0f25af43d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-f8e9b5ed-43c9-4fb7-97ed-d78c4024926a req-d310c8c6-c620-4ea9-9228-c766092eebbc service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Refreshing instance network info cache due to event network-changed-440b18b0-f9a0-422c-a9a9-1cd0f25af43d. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f8e9b5ed-43c9-4fb7-97ed-d78c4024926a req-d310c8c6-c620-4ea9-9228-c766092eebbc service nova] Acquiring lock "refresh_cache-899045e8-9836-4139-9546-78f57348a234" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f8e9b5ed-43c9-4fb7-97ed-d78c4024926a req-d310c8c6-c620-4ea9-9228-c766092eebbc service nova] Acquired lock "refresh_cache-899045e8-9836-4139-9546-78f57348a234" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-f8e9b5ed-43c9-4fb7-97ed-d78c4024926a req-d310c8c6-c620-4ea9-9228-c766092eebbc service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Refreshing network info cache for port 440b18b0-f9a0-422c-a9a9-1cd0f25af43d {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "refresh_cache-899045e8-9836-4139-9546-78f57348a234" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-f8e9b5ed-43c9-4fb7-97ed-d78c4024926a req-d310c8c6-c620-4ea9-9228-c766092eebbc service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-f8e9b5ed-43c9-4fb7-97ed-d78c4024926a req-d310c8c6-c620-4ea9-9228-c766092eebbc service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f8e9b5ed-43c9-4fb7-97ed-d78c4024926a req-d310c8c6-c620-4ea9-9228-c766092eebbc service nova] Releasing lock "refresh_cache-899045e8-9836-4139-9546-78f57348a234" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquired lock "refresh_cache-899045e8-9836-4139-9546-78f57348a234" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:38:33 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.network.neutron [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Updating instance_info_cache with network_info: [{"id": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "address": "fa:16:3e:5f:d1:6d", "network": {"id": "e31d602e-932e-4387-bb9b-0c9fb0e0f717", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1335483937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b17c476044c24a87bb1e78cba8b2d4fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440b18b0-f9", "ovs_interfaceid": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Releasing lock "refresh_cache-899045e8-9836-4139-9546-78f57348a234" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Instance network_info: |[{"id": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "address": "fa:16:3e:5f:d1:6d", "network": {"id": "e31d602e-932e-4387-bb9b-0c9fb0e0f717", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1335483937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b17c476044c24a87bb1e78cba8b2d4fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440b18b0-f9", "ovs_interfaceid": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Start _get_guest_xml network_info=[{"id": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "address": "fa:16:3e:5f:d1:6d", "network": {"id": "e31d602e-932e-4387-bb9b-0c9fb0e0f717", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1335483937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b17c476044c24a87bb1e78cba8b2d4fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440b18b0-f9", "ovs_interfaceid": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:38:34 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:38:34 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:38:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1767325736',display_name='tempest-VolumesActionsTest-instance-1767325736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1767325736',id=40,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b17c476044c24a87bb1e78cba8b2d4fe',ramdisk_id='',reservation_id='r-h5ojy2yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1841711590',owner_user_name='tempest-VolumesActionsTest-1841711590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:38:32Z,user_data=None,user_id='69f82221168549d5a500a9553ed98c72',uuid=899045e8-9836-4139-9546-78f57348a234,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "address": "fa:16:3e:5f:d1:6d", "network": {"id": "e31d602e-932e-4387-bb9b-0c9fb0e0f717", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1335483937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b17c476044c24a87bb1e78cba8b2d4fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440b18b0-f9", "ovs_interfaceid": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Converting VIF {"id": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "address": "fa:16:3e:5f:d1:6d", "network": {"id": "e31d602e-932e-4387-bb9b-0c9fb0e0f717", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1335483937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b17c476044c24a87bb1e78cba8b2d4fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440b18b0-f9", "ovs_interfaceid": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d1:6d,bridge_name='br-int',has_traffic_filtering=True,id=440b18b0-f9a0-422c-a9a9-1cd0f25af43d,network=Network(e31d602e-932e-4387-bb9b-0c9fb0e0f717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440b18b0-f9') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.objects.instance [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lazy-loading 'pci_devices' on Instance uuid 899045e8-9836-4139-9546-78f57348a234 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:38:34 user nova-compute[75571]:   <uuid>899045e8-9836-4139-9546-78f57348a234</uuid>
Nov 28 20:38:34 user nova-compute[75571]:   <name>instance-00000028</name>
Nov 28 20:38:34 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:38:34 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:38:34 user nova-compute[75571]:   <metadata>
Nov 28 20:38:34 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:38:34 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:38:34 user nova-compute[75571]:       <nova:name>tempest-VolumesActionsTest-instance-1767325736</nova:name>
Nov 28 20:38:34 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:38:34</nova:creationTime>
Nov 28 20:38:34 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:38:34 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:38:34 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:38:34 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:38:34 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:38:34 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:38:34 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:38:34 user nova-compute[75571]:       <nova:owner>
Nov 28 20:38:34 user nova-compute[75571]:         <nova:user uuid="69f82221168549d5a500a9553ed98c72">tempest-VolumesActionsTest-1841711590-project-member</nova:user>
Nov 28 20:38:34 user nova-compute[75571]:         <nova:project uuid="b17c476044c24a87bb1e78cba8b2d4fe">tempest-VolumesActionsTest-1841711590</nova:project>
Nov 28 20:38:34 user nova-compute[75571]:       </nova:owner>
Nov 28 20:38:34 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:38:34 user nova-compute[75571]:       <nova:ports>
Nov 28 20:38:34 user nova-compute[75571]:         <nova:port uuid="440b18b0-f9a0-422c-a9a9-1cd0f25af43d">
Nov 28 20:38:34 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 20:38:34 user nova-compute[75571]:         </nova:port>
Nov 28 20:38:34 user nova-compute[75571]:       </nova:ports>
Nov 28 20:38:34 user nova-compute[75571]:     </nova:instance>
Nov 28 20:38:34 user nova-compute[75571]:   </metadata>
Nov 28 20:38:34 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:38:34 user nova-compute[75571]:     <system>
Nov 28 20:38:34 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:38:34 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:38:34 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:38:34 user nova-compute[75571]:       <entry name="serial">899045e8-9836-4139-9546-78f57348a234</entry>
Nov 28 20:38:34 user nova-compute[75571]:       <entry name="uuid">899045e8-9836-4139-9546-78f57348a234</entry>
Nov 28 20:38:34 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:38:34 user nova-compute[75571]:     </system>
Nov 28 20:38:34 user nova-compute[75571]:   </sysinfo>
Nov 28 20:38:34 user nova-compute[75571]:   <os>
Nov 28 20:38:34 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:38:34 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:38:34 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:38:34 user nova-compute[75571]:   </os>
Nov 28 20:38:34 user nova-compute[75571]:   <features>
Nov 28 20:38:34 user nova-compute[75571]:     <acpi/>
Nov 28 20:38:34 user nova-compute[75571]:     <apic/>
Nov 28 20:38:34 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:38:34 user nova-compute[75571]:   </features>
Nov 28 20:38:34 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:38:34 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:38:34 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:38:34 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:38:34 user nova-compute[75571]:   </clock>
Nov 28 20:38:34 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:38:34 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:38:34 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:38:34 user nova-compute[75571]:   </cpu>
Nov 28 20:38:34 user nova-compute[75571]:   <devices>
Nov 28 20:38:34 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:38:34 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:38:34 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk"/>
Nov 28 20:38:34 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:38:34 user nova-compute[75571]:     </disk>
Nov 28 20:38:34 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:38:34 user nova-compute[75571]:       <mac address="fa:16:3e:5f:d1:6d"/>
Nov 28 20:38:34 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:38:34 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:38:34 user nova-compute[75571]:       <target dev="tap440b18b0-f9"/>
Nov 28 20:38:34 user nova-compute[75571]:     </interface>
Nov 28 20:38:34 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:38:34 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/console.log" append="off"/>
Nov 28 20:38:34 user nova-compute[75571]:     </serial>
Nov 28 20:38:34 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:38:34 user nova-compute[75571]:     <video>
Nov 28 20:38:34 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:38:34 user nova-compute[75571]:     </video>
Nov 28 20:38:34 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:38:34 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:38:34 user nova-compute[75571]:     </rng>
Nov 28 20:38:34 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:38:34 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:38:34 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:38:34 user nova-compute[75571]:     </memballoon>
Nov 28 20:38:34 user nova-compute[75571]:   </devices>
Nov 28 20:38:34 user nova-compute[75571]: </domain>
Nov 28 20:38:34 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:38:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1767325736',display_name='tempest-VolumesActionsTest-instance-1767325736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1767325736',id=40,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b17c476044c24a87bb1e78cba8b2d4fe',ramdisk_id='',reservation_id='r-h5ojy2yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1841711590',owner_user_name='tempest-VolumesActionsTest-1841711590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:38:32Z,user_data=None,user_id='69f82221168549d5a500a9553ed98c72',uuid=899045e8-9836-4139-9546-78f57348a234,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "address": "fa:16:3e:5f:d1:6d", "network": {"id": "e31d602e-932e-4387-bb9b-0c9fb0e0f717", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1335483937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b17c476044c24a87bb1e78cba8b2d4fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440b18b0-f9", "ovs_interfaceid": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Converting VIF {"id": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "address": "fa:16:3e:5f:d1:6d", "network": {"id": "e31d602e-932e-4387-bb9b-0c9fb0e0f717", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1335483937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b17c476044c24a87bb1e78cba8b2d4fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440b18b0-f9", "ovs_interfaceid": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d1:6d,bridge_name='br-int',has_traffic_filtering=True,id=440b18b0-f9a0-422c-a9a9-1cd0f25af43d,network=Network(e31d602e-932e-4387-bb9b-0c9fb0e0f717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440b18b0-f9') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG os_vif [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d1:6d,bridge_name='br-int',has_traffic_filtering=True,id=440b18b0-f9a0-422c-a9a9-1cd0f25af43d,network=Network(e31d602e-932e-4387-bb9b-0c9fb0e0f717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440b18b0-f9') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0d50bbe-fe97-5e9b-ae48-c329a401acc8', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap440b18b0-f9, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap440b18b0-f9, col_values=(('qos', UUID('82f48aa2-1367-4d51-845d-df5955b4f350')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap440b18b0-f9, col_values=(('external_ids', {'iface-id': '440b18b0-f9a0-422c-a9a9-1cd0f25af43d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:d1:6d', 'vm-uuid': '899045e8-9836-4139-9546-78f57348a234'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:34 user nova-compute[75571]: INFO os_vif [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d1:6d,bridge_name='br-int',has_traffic_filtering=True,id=440b18b0-f9a0-422c-a9a9-1cd0f25af43d,network=Network(e31d602e-932e-4387-bb9b-0c9fb0e0f717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440b18b0-f9')
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] No VIF found with MAC fa:16:3e:5f:d1:6d, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:38:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-fa1ba15d-5265-4d69-a3d3-9f278a29b7a7 req-605c9b79-f364-4657-8c26-3f3ed946381f service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Received event network-vif-plugged-440b18b0-f9a0-422c-a9a9-1cd0f25af43d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:38:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fa1ba15d-5265-4d69-a3d3-9f278a29b7a7 req-605c9b79-f364-4657-8c26-3f3ed946381f service nova] Acquiring lock "899045e8-9836-4139-9546-78f57348a234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fa1ba15d-5265-4d69-a3d3-9f278a29b7a7 req-605c9b79-f364-4657-8c26-3f3ed946381f service nova] Lock "899045e8-9836-4139-9546-78f57348a234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fa1ba15d-5265-4d69-a3d3-9f278a29b7a7 req-605c9b79-f364-4657-8c26-3f3ed946381f service nova] Lock "899045e8-9836-4139-9546-78f57348a234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-fa1ba15d-5265-4d69-a3d3-9f278a29b7a7 req-605c9b79-f364-4657-8c26-3f3ed946381f service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] No waiting events found dispatching network-vif-plugged-440b18b0-f9a0-422c-a9a9-1cd0f25af43d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:38:35 user nova-compute[75571]: WARNING nova.compute.manager [req-fa1ba15d-5265-4d69-a3d3-9f278a29b7a7 req-605c9b79-f364-4657-8c26-3f3ed946381f service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Received unexpected event network-vif-plugged-440b18b0-f9a0-422c-a9a9-1cd0f25af43d for instance with vm_state building and task_state spawning.
Nov 28 20:38:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:38:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:38:37 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 899045e8-9836-4139-9546-78f57348a234] Instance spawned successfully.
Nov 28 20:38:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:38:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:38:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:38:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:38:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:38:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:38:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:38:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-ed34d36b-7a4d-48a7-9951-a9c06d8a414d req-cb3497dc-59de-4372-9441-0a62e8d185d0 service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Received event network-vif-plugged-440b18b0-f9a0-422c-a9a9-1cd0f25af43d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:38:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ed34d36b-7a4d-48a7-9951-a9c06d8a414d req-cb3497dc-59de-4372-9441-0a62e8d185d0 service nova] Acquiring lock "899045e8-9836-4139-9546-78f57348a234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ed34d36b-7a4d-48a7-9951-a9c06d8a414d req-cb3497dc-59de-4372-9441-0a62e8d185d0 service nova] Lock "899045e8-9836-4139-9546-78f57348a234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ed34d36b-7a4d-48a7-9951-a9c06d8a414d req-cb3497dc-59de-4372-9441-0a62e8d185d0 service nova] Lock "899045e8-9836-4139-9546-78f57348a234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-ed34d36b-7a4d-48a7-9951-a9c06d8a414d req-cb3497dc-59de-4372-9441-0a62e8d185d0 service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] No waiting events found dispatching network-vif-plugged-440b18b0-f9a0-422c-a9a9-1cd0f25af43d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:38:37 user nova-compute[75571]: WARNING nova.compute.manager [req-ed34d36b-7a4d-48a7-9951-a9c06d8a414d req-cb3497dc-59de-4372-9441-0a62e8d185d0 service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Received unexpected event network-vif-plugged-440b18b0-f9a0-422c-a9a9-1cd0f25af43d for instance with vm_state building and task_state spawning.
Nov 28 20:38:37 user nova-compute[75571]: INFO nova.compute.manager [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 28 20:38:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:38:37 user nova-compute[75571]: INFO nova.compute.manager [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Took 6.15 seconds to build instance.
Nov 28 20:38:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "899045e8-9836-4139-9546-78f57348a234" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.263s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:38:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:49 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:38:49 user nova-compute[75571]: INFO nova.compute.claims [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Claim successful on node user
Nov 28 20:38:49 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:38:49 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:38:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:38:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:38:49 user nova-compute[75571]: DEBUG nova.network.neutron [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:38:50 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:38:50 user nova-compute[75571]: DEBUG nova.compute.manager [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG nova.policy [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG nova.compute.manager [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:38:50 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Creating image(s)
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "/opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "/opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "/opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.183s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk 1073741824" returned: 0 in 0.052s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.211s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG nova.network.neutron [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Successfully created port: 7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Cannot resize image /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Ensure instance console log exists: /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.network.neutron [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Successfully updated port: 7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquired lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.network.neutron [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.network.neutron [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.compute.manager [req-789e263e-0d95-456e-9335-de074a7e8664 req-788efc88-32d9-4fe1-867e-016e8ab970f6 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-changed-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.compute.manager [req-789e263e-0d95-456e-9335-de074a7e8664 req-788efc88-32d9-4fe1-867e-016e8ab970f6 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Refreshing instance network info cache due to event network-changed-7354a1a8-41e9-4a3c-9d08-fa55997c917a. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-789e263e-0d95-456e-9335-de074a7e8664 req-788efc88-32d9-4fe1-867e-016e8ab970f6 service nova] Acquiring lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.network.neutron [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updating instance_info_cache with network_info: [{"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Releasing lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Instance network_info: |[{"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-789e263e-0d95-456e-9335-de074a7e8664 req-788efc88-32d9-4fe1-867e-016e8ab970f6 service nova] Acquired lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.network.neutron [req-789e263e-0d95-456e-9335-de074a7e8664 req-788efc88-32d9-4fe1-867e-016e8ab970f6 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Refreshing network info cache for port 7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Start _get_guest_xml network_info=[{"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:38:51 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:38:51 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1401374666',display_name='tempest-ServerRescueNegativeTestJSON-server-1401374666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1401374666',id=41,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWg6YbMlebQ5V+UbkiDrrgElaYoiXY9oYImEppuaL6/Oo5HZCbiLccGXYvygaEUJySbNh/P4i1kz+O1q3We6pyWNWE9nV6EgEtTcw+bkFNGx5lVpre5FiMuKcW99C0YaA==',key_name='tempest-keypair-249978267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d72dc075421c4e7eb9c0ff2bf1641a92',ramdisk_id='',reservation_id='r-zhhy1al0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-506941201',owner_user_name='tempest-ServerRescueNegativeTestJSON-506941201-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:38:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='634123644067453a92f4d43da0b28fa7',uuid=f23739ef-322e-4a8f-9df3-2a06e42b6a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converting VIF {"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8b:70,bridge_name='br-int',has_traffic_filtering=True,id=7354a1a8-41e9-4a3c-9d08-fa55997c917a,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7354a1a8-41') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.objects.instance [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'pci_devices' on Instance uuid f23739ef-322e-4a8f-9df3-2a06e42b6a35 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:38:51 user nova-compute[75571]:   <uuid>f23739ef-322e-4a8f-9df3-2a06e42b6a35</uuid>
Nov 28 20:38:51 user nova-compute[75571]:   <name>instance-00000029</name>
Nov 28 20:38:51 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:38:51 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:38:51 user nova-compute[75571]:   <metadata>
Nov 28 20:38:51 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:38:51 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:38:51 user nova-compute[75571]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1401374666</nova:name>
Nov 28 20:38:51 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:38:51</nova:creationTime>
Nov 28 20:38:51 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:38:51 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:38:51 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:38:51 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:38:51 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:38:51 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:38:51 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:38:51 user nova-compute[75571]:       <nova:owner>
Nov 28 20:38:51 user nova-compute[75571]:         <nova:user uuid="634123644067453a92f4d43da0b28fa7">tempest-ServerRescueNegativeTestJSON-506941201-project-member</nova:user>
Nov 28 20:38:51 user nova-compute[75571]:         <nova:project uuid="d72dc075421c4e7eb9c0ff2bf1641a92">tempest-ServerRescueNegativeTestJSON-506941201</nova:project>
Nov 28 20:38:51 user nova-compute[75571]:       </nova:owner>
Nov 28 20:38:51 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:38:51 user nova-compute[75571]:       <nova:ports>
Nov 28 20:38:51 user nova-compute[75571]:         <nova:port uuid="7354a1a8-41e9-4a3c-9d08-fa55997c917a">
Nov 28 20:38:51 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 20:38:51 user nova-compute[75571]:         </nova:port>
Nov 28 20:38:51 user nova-compute[75571]:       </nova:ports>
Nov 28 20:38:51 user nova-compute[75571]:     </nova:instance>
Nov 28 20:38:51 user nova-compute[75571]:   </metadata>
Nov 28 20:38:51 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:38:51 user nova-compute[75571]:     <system>
Nov 28 20:38:51 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:38:51 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:38:51 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:38:51 user nova-compute[75571]:       <entry name="serial">f23739ef-322e-4a8f-9df3-2a06e42b6a35</entry>
Nov 28 20:38:51 user nova-compute[75571]:       <entry name="uuid">f23739ef-322e-4a8f-9df3-2a06e42b6a35</entry>
Nov 28 20:38:51 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:38:51 user nova-compute[75571]:     </system>
Nov 28 20:38:51 user nova-compute[75571]:   </sysinfo>
Nov 28 20:38:51 user nova-compute[75571]:   <os>
Nov 28 20:38:51 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:38:51 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:38:51 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:38:51 user nova-compute[75571]:   </os>
Nov 28 20:38:51 user nova-compute[75571]:   <features>
Nov 28 20:38:51 user nova-compute[75571]:     <acpi/>
Nov 28 20:38:51 user nova-compute[75571]:     <apic/>
Nov 28 20:38:51 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:38:51 user nova-compute[75571]:   </features>
Nov 28 20:38:51 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:38:51 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:38:51 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:38:51 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:38:51 user nova-compute[75571]:   </clock>
Nov 28 20:38:51 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:38:51 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:38:51 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:38:51 user nova-compute[75571]:   </cpu>
Nov 28 20:38:51 user nova-compute[75571]:   <devices>
Nov 28 20:38:51 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:38:51 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:38:51 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk"/>
Nov 28 20:38:51 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:38:51 user nova-compute[75571]:     </disk>
Nov 28 20:38:51 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:38:51 user nova-compute[75571]:       <mac address="fa:16:3e:a8:8b:70"/>
Nov 28 20:38:51 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:38:51 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:38:51 user nova-compute[75571]:       <target dev="tap7354a1a8-41"/>
Nov 28 20:38:51 user nova-compute[75571]:     </interface>
Nov 28 20:38:51 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:38:51 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/console.log" append="off"/>
Nov 28 20:38:51 user nova-compute[75571]:     </serial>
Nov 28 20:38:51 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:38:51 user nova-compute[75571]:     <video>
Nov 28 20:38:51 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:38:51 user nova-compute[75571]:     </video>
Nov 28 20:38:51 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:38:51 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:38:51 user nova-compute[75571]:     </rng>
Nov 28 20:38:51 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:38:51 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:38:51 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:38:51 user nova-compute[75571]:     </memballoon>
Nov 28 20:38:51 user nova-compute[75571]:   </devices>
Nov 28 20:38:51 user nova-compute[75571]: </domain>
Nov 28 20:38:51 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1401374666',display_name='tempest-ServerRescueNegativeTestJSON-server-1401374666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1401374666',id=41,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWg6YbMlebQ5V+UbkiDrrgElaYoiXY9oYImEppuaL6/Oo5HZCbiLccGXYvygaEUJySbNh/P4i1kz+O1q3We6pyWNWE9nV6EgEtTcw+bkFNGx5lVpre5FiMuKcW99C0YaA==',key_name='tempest-keypair-249978267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d72dc075421c4e7eb9c0ff2bf1641a92',ramdisk_id='',reservation_id='r-zhhy1al0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-506941201',owner_user_name='tempest-ServerRescueNegativeTestJSON-506941201-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:38:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='634123644067453a92f4d43da0b28fa7',uuid=f23739ef-322e-4a8f-9df3-2a06e42b6a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converting VIF {"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8b:70,bridge_name='br-int',has_traffic_filtering=True,id=7354a1a8-41e9-4a3c-9d08-fa55997c917a,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7354a1a8-41') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG os_vif [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8b:70,bridge_name='br-int',has_traffic_filtering=True,id=7354a1a8-41e9-4a3c-9d08-fa55997c917a,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7354a1a8-41') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2525ada4-f0c2-5fd1-b722-c6dc7481ee70', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7354a1a8-41, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7354a1a8-41, col_values=(('qos', UUID('1364f2f2-5c4f-48a4-924f-f0e576b5e836')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7354a1a8-41, col_values=(('external_ids', {'iface-id': '7354a1a8-41e9-4a3c-9d08-fa55997c917a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:8b:70', 'vm-uuid': 'f23739ef-322e-4a8f-9df3-2a06e42b6a35'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:51 user nova-compute[75571]: INFO os_vif [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8b:70,bridge_name='br-int',has_traffic_filtering=True,id=7354a1a8-41e9-4a3c-9d08-fa55997c917a,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7354a1a8-41')
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:38:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No VIF found with MAC fa:16:3e:a8:8b:70, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:38:52 user nova-compute[75571]: DEBUG nova.network.neutron [req-789e263e-0d95-456e-9335-de074a7e8664 req-788efc88-32d9-4fe1-867e-016e8ab970f6 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updated VIF entry in instance network info cache for port 7354a1a8-41e9-4a3c-9d08-fa55997c917a. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:38:52 user nova-compute[75571]: DEBUG nova.network.neutron [req-789e263e-0d95-456e-9335-de074a7e8664 req-788efc88-32d9-4fe1-867e-016e8ab970f6 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updating instance_info_cache with network_info: [{"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:38:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-789e263e-0d95-456e-9335-de074a7e8664 req-788efc88-32d9-4fe1-867e-016e8ab970f6 service nova] Releasing lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:38:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:53 user nova-compute[75571]: DEBUG nova.compute.manager [req-e4d19330-082c-4cda-b9bc-a234f974d37d req-383cf3aa-0c53-4ca8-94bd-c59725eb5711 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:38:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e4d19330-082c-4cda-b9bc-a234f974d37d req-383cf3aa-0c53-4ca8-94bd-c59725eb5711 service nova] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e4d19330-082c-4cda-b9bc-a234f974d37d req-383cf3aa-0c53-4ca8-94bd-c59725eb5711 service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e4d19330-082c-4cda-b9bc-a234f974d37d req-383cf3aa-0c53-4ca8-94bd-c59725eb5711 service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:53 user nova-compute[75571]: DEBUG nova.compute.manager [req-e4d19330-082c-4cda-b9bc-a234f974d37d req-383cf3aa-0c53-4ca8-94bd-c59725eb5711 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] No waiting events found dispatching network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:38:53 user nova-compute[75571]: WARNING nova.compute.manager [req-e4d19330-082c-4cda-b9bc-a234f974d37d req-383cf3aa-0c53-4ca8-94bd-c59725eb5711 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received unexpected event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance with vm_state building and task_state spawning.
Nov 28 20:38:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:38:55 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Instance spawned successfully.
Nov 28 20:38:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-3c763641-edf3-4f71-874e-e695b8b63322 req-067589fd-e84e-4350-bb54-342faf0ce0b0 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3c763641-edf3-4f71-874e-e695b8b63322 req-067589fd-e84e-4350-bb54-342faf0ce0b0 service nova] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3c763641-edf3-4f71-874e-e695b8b63322 req-067589fd-e84e-4350-bb54-342faf0ce0b0 service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3c763641-edf3-4f71-874e-e695b8b63322 req-067589fd-e84e-4350-bb54-342faf0ce0b0 service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-3c763641-edf3-4f71-874e-e695b8b63322 req-067589fd-e84e-4350-bb54-342faf0ce0b0 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] No waiting events found dispatching network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:38:55 user nova-compute[75571]: WARNING nova.compute.manager [req-3c763641-edf3-4f71-874e-e695b8b63322 req-067589fd-e84e-4350-bb54-342faf0ce0b0 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received unexpected event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance with vm_state building and task_state spawning.
Nov 28 20:38:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:38:55 user nova-compute[75571]: INFO nova.compute.manager [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 28 20:38:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:38:55 user nova-compute[75571]: INFO nova.compute.manager [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Took 6.16 seconds to build instance.
Nov 28 20:38:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.262s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-ef6d1d4a-76bc-4c0f-9578-b18c7d5945bf req-0fe8d21d-dc48-4c1c-b919-809dc092f4ad service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received event network-changed-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-ef6d1d4a-76bc-4c0f-9578-b18c7d5945bf req-0fe8d21d-dc48-4c1c-b919-809dc092f4ad service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Refreshing instance network info cache due to event network-changed-bc13ffb2-0ccf-4e86-8502-bea728a1e20f. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ef6d1d4a-76bc-4c0f-9578-b18c7d5945bf req-0fe8d21d-dc48-4c1c-b919-809dc092f4ad service nova] Acquiring lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ef6d1d4a-76bc-4c0f-9578-b18c7d5945bf req-0fe8d21d-dc48-4c1c-b919-809dc092f4ad service nova] Acquired lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:38:55 user nova-compute[75571]: DEBUG nova.network.neutron [req-ef6d1d4a-76bc-4c0f-9578-b18c7d5945bf req-0fe8d21d-dc48-4c1c-b919-809dc092f4ad service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Refreshing network info cache for port bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:38:56 user nova-compute[75571]: DEBUG nova.network.neutron [req-ef6d1d4a-76bc-4c0f-9578-b18c7d5945bf req-0fe8d21d-dc48-4c1c-b919-809dc092f4ad service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Updated VIF entry in instance network info cache for port bc13ffb2-0ccf-4e86-8502-bea728a1e20f. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:38:56 user nova-compute[75571]: DEBUG nova.network.neutron [req-ef6d1d4a-76bc-4c0f-9578-b18c7d5945bf req-0fe8d21d-dc48-4c1c-b919-809dc092f4ad service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Updating instance_info_cache with network_info: [{"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:38:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ef6d1d4a-76bc-4c0f-9578-b18c7d5945bf req-0fe8d21d-dc48-4c1c-b919-809dc092f4ad service nova] Releasing lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:38:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "b2c27e15-6791-4d75-8df0-957c10d7ca42" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:38:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:38:59 user nova-compute[75571]: INFO nova.compute.manager [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Shelving
Nov 28 20:38:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:38:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-14056685-f2c2-48f2-9e87-ab024450919e req-f1ad58d5-97eb-4457-a79c-06d8f7b0eeb3 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received event network-vif-unplugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:39:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-14056685-f2c2-48f2-9e87-ab024450919e req-f1ad58d5-97eb-4457-a79c-06d8f7b0eeb3 service nova] Acquiring lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:39:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-14056685-f2c2-48f2-9e87-ab024450919e req-f1ad58d5-97eb-4457-a79c-06d8f7b0eeb3 service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:39:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-14056685-f2c2-48f2-9e87-ab024450919e req-f1ad58d5-97eb-4457-a79c-06d8f7b0eeb3 service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:39:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-14056685-f2c2-48f2-9e87-ab024450919e req-f1ad58d5-97eb-4457-a79c-06d8f7b0eeb3 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] No waiting events found dispatching network-vif-unplugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:39:00 user nova-compute[75571]: WARNING nova.compute.manager [req-14056685-f2c2-48f2-9e87-ab024450919e req-f1ad58d5-97eb-4457-a79c-06d8f7b0eeb3 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received unexpected event network-vif-unplugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance with vm_state active and task_state shelving.
Nov 28 20:39:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:00 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Instance destroyed successfully.
Nov 28 20:39:00 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Beginning cold snapshot process
Nov 28 20:39:00 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:39:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk /opt/stack/data/nova/instances/snapshots/tmpur2yl8ig/52c7e360d7dd4005ac28ac91013918e3 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk /opt/stack/data/nova/instances/snapshots/tmpur2yl8ig/52c7e360d7dd4005ac28ac91013918e3" returned: 0 in 0.609s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:01 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Snapshot extracted, beginning image upload
Nov 28 20:39:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received event network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:39:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] Acquiring lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:39:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:39:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:39:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] No waiting events found dispatching network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:39:02 user nova-compute[75571]: WARNING nova.compute.manager [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received unexpected event network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 20:39:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Received event network-changed-3319037b-9d8f-47bd-908f-12f61b7ceea2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:39:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Refreshing instance network info cache due to event network-changed-3319037b-9d8f-47bd-908f-12f61b7ceea2. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:39:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] Acquiring lock "refresh_cache-3a2c4b6b-0fc7-4299-89ca-2d885e893854" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:39:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] Acquired lock "refresh_cache-3a2c4b6b-0fc7-4299-89ca-2d885e893854" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:39:02 user nova-compute[75571]: DEBUG nova.network.neutron [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Refreshing network info cache for port 3319037b-9d8f-47bd-908f-12f61b7ceea2 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:39:02 user nova-compute[75571]: DEBUG nova.network.neutron [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Updated VIF entry in instance network info cache for port 3319037b-9d8f-47bd-908f-12f61b7ceea2. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:39:02 user nova-compute[75571]: DEBUG nova.network.neutron [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Updating instance_info_cache with network_info: [{"id": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "address": "fa:16:3e:f5:7d:bb", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319037b-9d", "ovs_interfaceid": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:39:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] Releasing lock "refresh_cache-3a2c4b6b-0fc7-4299-89ca-2d885e893854" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:39:03 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Snapshot image upload complete
Nov 28 20:39:03 user nova-compute[75571]: DEBUG nova.compute.manager [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:39:04 user nova-compute[75571]: INFO nova.compute.manager [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Shelve offloading
Nov 28 20:39:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Instance destroyed successfully.
Nov 28 20:39:04 user nova-compute[75571]: DEBUG nova.compute.manager [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:39:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:39:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquired lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:39:04 user nova-compute[75571]: DEBUG nova.network.neutron [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:39:04 user nova-compute[75571]: DEBUG nova.network.neutron [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Updating instance_info_cache with network_info: [{"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:39:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Releasing lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:39:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:05 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Instance destroyed successfully.
Nov 28 20:39:05 user nova-compute[75571]: DEBUG nova.objects.instance [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'resources' on Instance uuid b2c27e15-6791-4d75-8df0-957c10d7ca42 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1654201794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1654201794',id=38,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf7rbfGmkbg9QNV+1Z0B5neiR0PzgqzwGOYvM5FfRWYx4MTDS+q5fQSTS7YZMLSQKaPn3qR8rnvfsfmD+tnK7T3zFPx8mNCJ/Lwe8ouSkwiQJ7T9kBYNHl5Hsq+Bpyrbw==',key_name='tempest-keypair-144574904',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:37:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='292cfffce13446c8963785adfb4b9d22',ramdisk_id='',reservation_id='r-f7h5ryu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1442792072',owner_user_name='tempest-AttachVolumeShelveTestJSON-1442792072-project-member',shelved_at='2023-11-28T20:39:03.955403',shelved_host='user',shelved_image_id='ec62c902-d8a3-4762-a884-3cce07baff1a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:39:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e21afd3261f4b1a87f7cbb4348fc9fe',uuid=b2c27e15-6791-4d75-8df0-957c10d7ca42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converting VIF {"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:54:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc13ffb2-0ccf-4e86-8502-bea728a1e20f,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc13ffb2-0c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG os_vif [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:54:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc13ffb2-0ccf-4e86-8502-bea728a1e20f,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc13ffb2-0c') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc13ffb2-0c, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-5af0dd4d-61ee-4b56-aaa7-435d667b2926 req-76d7cd9c-c943-476b-bb87-e7e3f870d5e0 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received event network-changed-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-5af0dd4d-61ee-4b56-aaa7-435d667b2926 req-76d7cd9c-c943-476b-bb87-e7e3f870d5e0 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Refreshing instance network info cache due to event network-changed-bc13ffb2-0ccf-4e86-8502-bea728a1e20f. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5af0dd4d-61ee-4b56-aaa7-435d667b2926 req-76d7cd9c-c943-476b-bb87-e7e3f870d5e0 service nova] Acquiring lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5af0dd4d-61ee-4b56-aaa7-435d667b2926 req-76d7cd9c-c943-476b-bb87-e7e3f870d5e0 service nova] Acquired lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG nova.network.neutron [req-5af0dd4d-61ee-4b56-aaa7-435d667b2926 req-76d7cd9c-c943-476b-bb87-e7e3f870d5e0 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Refreshing network info cache for port bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff47af60-d3a5-490b-a055-845c0e94ccda) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:39:05 user nova-compute[75571]: INFO os_vif [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:54:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc13ffb2-0ccf-4e86-8502-bea728a1e20f,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc13ffb2-0c')
Nov 28 20:39:05 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Deleting instance files /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42_del
Nov 28 20:39:05 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Deletion of /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42_del complete
Nov 28 20:39:05 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Deleted allocations for instance b2c27e15-6791-4d75-8df0-957c10d7ca42
Nov 28 20:39:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG nova.objects.instance [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'numa_topology' on Instance uuid b2c27e15-6791-4d75-8df0-957c10d7ca42 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG nova.objects.base [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Object Instance<b2c27e15-6791-4d75-8df0-957c10d7ca42> lazy-loaded attributes: resources,numa_topology {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG nova.network.neutron [req-5af0dd4d-61ee-4b56-aaa7-435d667b2926 req-76d7cd9c-c943-476b-bb87-e7e3f870d5e0 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Updated VIF entry in instance network info cache for port bc13ffb2-0ccf-4e86-8502-bea728a1e20f. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG nova.network.neutron [req-5af0dd4d-61ee-4b56-aaa7-435d667b2926 req-76d7cd9c-c943-476b-bb87-e7e3f870d5e0 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Updating instance_info_cache with network_info: [{"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5af0dd4d-61ee-4b56-aaa7-435d667b2926 req-76d7cd9c-c943-476b-bb87-e7e3f870d5e0 service nova] Releasing lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.744s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG nova.objects.instance [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'flavor' on Instance uuid 3a2c4b6b-0fc7-4299-89ca-2d885e893854 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:39:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:39:05 user nova-compute[75571]: INFO nova.compute.manager [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Attaching volume 46ebfac3-6175-4b54-82dd-641171e96f2a to /dev/vdb
Nov 28 20:39:06 user nova-compute[75571]: DEBUG os_brick.utils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[705ba648-9569-4592-8bb8-854864a1d36e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[daea5f23-c4c1-4a1b-bef5-252df9216e74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[402bf4f6-f073-4d37-8527-f10e0f4a4931]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99e42e2-52ad-40f2-8d93-a7a344bd1f2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:39:06 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:39:06 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d939ce7-35fc-475f-82fa-2f9c22b18b95]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG os_brick.utils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:39:06 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Updating existing volume attachment record: bdd8da21-e75f-483d-9449-37edd17f4eaa {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:39:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuGRprXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:39:12 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:39:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:39:12 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:39:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:39:12 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:39:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d881ae3e-4f0e-445f-834c-28f3ed31a790]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:39:12 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5e4e86-ed43-4b46-80c1-8d2f4e647000]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a] added
Nov 28 20:39:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c279436-d694-4266-926e-c4919f3f3254]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd63039-42be-49b8-a669-575ed5df73b5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FuGRprXf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FuGRprXf" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[656ad810-efe0-46ca-82db-c76108cbda63]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FuGRprXf'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2d98bf-6339-49ec-9750-8a33c378eef6]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[40786e84-f7c2-45e3-8dfe-4b57e2d9a019]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:39:13 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:39:13 user nova-compute[75571]:  {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:39:13 user nova-compute[75571]: WARNING os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 20:39:13 user nova-compute[75571]: 
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1de5789-1e25-493d-b2ed-b36157e7942a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a, portal: 172.16.0.220,3260]
Nov 28 20:39:13 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a, portal: 172.16.0.220,3260] successful.
Nov 28 20:39:13 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[70464ef9-234f-48d9-ae51-bda6b0c61d14]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb99994-10d8-4572-8a91-fff3160a2f6c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a (non-flash)
Nov 28 20:39:13 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a (non-flash)
Nov 28 20:39:13 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7bb60d-87d2-47ac-868a-d115048e69c7]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuGRprXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:39:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:39:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:39:14 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:39:14 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26638623332303738', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:39:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638623332303738', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:39:14 user nova-compute[75571]: DEBUG nova.objects.instance [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'flavor' on Instance uuid 3a2c4b6b-0fc7-4299-89ca-2d885e893854 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:39:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:39:14 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:39:14 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:39:14 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:39:14 user nova-compute[75571]:   <serial>46ebfac3-6175-4b54-82dd-641171e96f2a</serial>
Nov 28 20:39:14 user nova-compute[75571]: </disk>
Nov 28 20:39:14 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:39:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:39:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:39:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] No VIF found with MAC fa:16:3e:f5:7d:bb, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:39:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.775s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:39:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:16 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:39:16 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 29443f30-6d05-4148-9185-a31f78b4a68f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG nova.objects.instance [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'flavor' on Instance uuid 3a2c4b6b-0fc7-4299-89ca-2d885e893854 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:39:18 user nova-compute[75571]: INFO nova.compute.manager [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Attaching volume c703bb11-9d24-4f99-a851-84a95413edcb to /dev/vdc
Nov 28 20:39:18 user nova-compute[75571]: DEBUG os_brick.utils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e4c912-77a3-4812-8820-6e1b9dcad779]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba63e89-4f8a-42e4-a10b-6aa1d12f80dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f656d343-5d8f-474b-82bc-8a5418447df9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa05c02-7200-4342-ab48-cd8956947865]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Updating instance_info_cache with network_info: [{"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:39:18 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:39:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[af31618c-6800-4cfb-9bbd-548e5113660b]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG os_brick.utils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:39:18 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Updating existing volume attachment record: 674f5f0f-5b44-4d19-ac9a-637529f77680 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:39:19 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:39:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:21 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:39:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:39:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:39:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:39:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:39:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:39:23 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:39:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:23 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:39:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gaFBPGIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:39:25 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:39:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:39:25 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:39:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:39:25 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:39:25 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:39:25 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:39:25 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8386MB free_disk=24.966476440429688GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f8ffc0-8205-4a0a-8038-425fe7e9f8fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:39:25 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6559a802-0730-42a3-8af8-1482dca5e8ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb] added
Nov 28 20:39:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d767908-fa60-4cae-8d2c-841abae03301]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[efae8d51-1e31-4723-92c7-582f7a13b7f2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gaFBPGIY {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gaFBPGIY" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0921da3f-c4d5-42f6-bf95-75af59298d0a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gaFBPGIY'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 899045e8-9836-4139-9546-78f57348a234 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0d75ca-3c26-41f2-9740-f19651ef1bdb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e9a2f0-16d7-48ff-8024-16c3d1a11e67]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a (non-flash)
Nov 28 20:39:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a (non-flash)
Nov 28 20:39:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:39:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86cf22a-cbfe-4213-a257-d527b3c3d454]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb, portal: 172.16.0.220,3260]
Nov 28 20:39:26 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb, portal: 172.16.0.220,3260] successful.
Nov 28 20:39:26 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d5292c-01cc-47aa-8d20-918f6d0fa5bd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f654c17-8e51-4dc7-abd7-d542da1d54b2]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a (non-flash)
Nov 28 20:39:26 user nova-compute[75571]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb (non-flash)
Nov 28 20:39:26 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a (non-flash)
Nov 28 20:39:26 user nova-compute[75571]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb (non-flash)
Nov 28 20:39:26 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acf5d28-ec74-4f77-ae17-a25bb5f66a6a]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gaFBPGIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:39:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:39:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:39:27 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26439633834666338', 'path': '/dev/sdc'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:39:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439633834666338', 'path': '/dev/sdc'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:39:27 user nova-compute[75571]: DEBUG nova.objects.instance [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'flavor' on Instance uuid 3a2c4b6b-0fc7-4299-89ca-2d885e893854 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:39:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:39:27 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:39:27 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:39:27 user nova-compute[75571]:   <target dev="vdc" bus="virtio"/>
Nov 28 20:39:27 user nova-compute[75571]:   <serial>c703bb11-9d24-4f99-a851-84a95413edcb</serial>
Nov 28 20:39:27 user nova-compute[75571]: </disk>
Nov 28 20:39:27 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:39:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:39:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:39:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:39:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] No VIF found with MAC fa:16:3e:f5:7d:bb, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:39:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.124s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:39:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:39:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:39:28 user nova-compute[75571]: INFO nova.compute.manager [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Detaching volume 46ebfac3-6175-4b54-82dd-641171e96f2a
Nov 28 20:39:28 user nova-compute[75571]: INFO nova.virt.block_device [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Attempting to driver detach volume 46ebfac3-6175-4b54-82dd-641171e96f2a from mountpoint /dev/vdb
Nov 28 20:39:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Attempting to detach device vdb from instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:39:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:39:28 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:39:28 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:39:28 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:39:28 user nova-compute[75571]:   <serial>46ebfac3-6175-4b54-82dd-641171e96f2a</serial>
Nov 28 20:39:28 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:39:28 user nova-compute[75571]: </disk>
Nov 28 20:39:28 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:39:28 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Successfully detached device vdb from instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 from the persistent domain config.
Nov 28 20:39:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:39:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:39:28 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:39:28 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:39:28 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:39:28 user nova-compute[75571]:   <serial>46ebfac3-6175-4b54-82dd-641171e96f2a</serial>
Nov 28 20:39:28 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:39:28 user nova-compute[75571]: </disk>
Nov 28 20:39:28 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:39:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:39:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:42 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:39:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:49 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 is timed out.
Nov 28 20:39:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Successfully detached device vdb from instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 from the live domain config.
Nov 28 20:39:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuGRprXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:39:49 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f558adf-2830-4d62-abef-701d549ad104]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:39:49 user nova-compute[75571]: No targets found.
Nov 28 20:39:49 user nova-compute[75571]: iSNS:
Nov 28 20:39:49 user nova-compute[75571]: No targets found.
Nov 28 20:39:49 user nova-compute[75571]: STATIC:
Nov 28 20:39:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a
Nov 28 20:39:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:39:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:39:49 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb
Nov 28 20:39:49 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:39:49 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:39:49 user nova-compute[75571]: FIRMWARE:
Nov 28 20:39:49 user nova-compute[75571]: No targets found.
Nov 28 20:39:49 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:39:49 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:39:49 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64efcd5-b094-4865-ab3d-3306122f28cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1b117f-c474-4b38-8903-6dfbf6a856d3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a (non-flash)
Nov 28 20:39:49 user nova-compute[75571]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb (non-flash)
Nov 28 20:39:49 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a (non-flash)
Nov 28 20:39:49 user nova-compute[75571]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb (non-flash)
Nov 28 20:39:49 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77487cba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cf04e8-265f-499b-b038-7cbb32d66b6d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0484c9e9-e4d8-428d-b121-cd393b2a2af4]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b186b6-b45f-485f-aee6-70b20a026519]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d85d070-8758-4462-a589-885ca69d2850]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d35585-ad95-4c3d-9110-75e46212ca0a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[befb929f-6e94-47b6-8b19-f4c72843cfc5]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a, portal: 172.16.0.220,3260]
Nov 28 20:39:49 user nova-compute[75571]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a, portal: 172.16.0.220,3260] successful.
Nov 28 20:39:49 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ebfac3-6175-4b54-82dd-641171e96f2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef7c9f6-3e5d-44c5-8781-0d64d48e249f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] <== disconnect_volume: return (293ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:39:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:39:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:39:50 user nova-compute[75571]: DEBUG nova.objects.instance [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'flavor' on Instance uuid 3a2c4b6b-0fc7-4299-89ca-2d885e893854 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:39:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.709s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:39:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:39:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:39:51 user nova-compute[75571]: INFO nova.compute.manager [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Detaching volume c703bb11-9d24-4f99-a851-84a95413edcb
Nov 28 20:39:51 user nova-compute[75571]: INFO nova.virt.block_device [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Attempting to driver detach volume c703bb11-9d24-4f99-a851-84a95413edcb from mountpoint /dev/vdc
Nov 28 20:39:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Attempting to detach device vdc from instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:39:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:39:51 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:39:51 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:39:51 user nova-compute[75571]:   <target dev="vdc" bus="virtio"/>
Nov 28 20:39:51 user nova-compute[75571]:   <serial>c703bb11-9d24-4f99-a851-84a95413edcb</serial>
Nov 28 20:39:51 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 20:39:51 user nova-compute[75571]: </disk>
Nov 28 20:39:51 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:39:51 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Successfully detached device vdc from instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 from the persistent domain config.
Nov 28 20:39:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:39:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:39:51 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:39:51 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:39:51 user nova-compute[75571]:   <target dev="vdc" bus="virtio"/>
Nov 28 20:39:51 user nova-compute[75571]:   <serial>c703bb11-9d24-4f99-a851-84a95413edcb</serial>
Nov 28 20:39:51 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 20:39:51 user nova-compute[75571]: </disk>
Nov 28 20:39:51 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:39:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:39:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:40:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:40:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:40:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:40:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:40:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:12 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 is timed out.
Nov 28 20:40:12 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Successfully detached device vdc from instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 from the live domain config.
Nov 28 20:40:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gaFBPGIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:40:12 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[193075c0-e0af-4fc7-abcb-7703887fe045]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:40:12 user nova-compute[75571]: No targets found.
Nov 28 20:40:12 user nova-compute[75571]: iSNS:
Nov 28 20:40:12 user nova-compute[75571]: No targets found.
Nov 28 20:40:12 user nova-compute[75571]: STATIC:
Nov 28 20:40:12 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb
Nov 28 20:40:12 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:40:12 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:40:12 user nova-compute[75571]: FIRMWARE:
Nov 28 20:40:12 user nova-compute[75571]: No targets found.
Nov 28 20:40:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:40:12 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:40:12 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fb81f3-69fe-4806-b3e3-b779c878fc30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86a0f3d-37b0-40bd-9645-428a28d5dee6]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb (non-flash)
Nov 28 20:40:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb (non-flash)
Nov 28 20:40:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f776878a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb'): ({'sdc'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Removing single pathed devices sdc {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[96de195d-2d7f-46d1-b1a2-7f7b0c64cb11]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8310b1-1ab1-4fd1-94aa-c5c8150d7e2b]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flushing IO for device /dev/sdc {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c662c1e-05d6-4769-bbc5-69fca3898b6f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea17dd6a-1dac-4fcc-a66b-e8139d4bbd32]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d96528-cf54-40f9-af5d-886e95fc9b39]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e68b038-e8c7-4ce5-9645-508507b33610]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb, portal: 172.16.0.220,3260]
Nov 28 20:40:12 user nova-compute[75571]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb, portal: 172.16.0.220,3260] successful.
Nov 28 20:40:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c703bb11-9d24-4f99-a851-84a95413edcb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1080db6-1ffd-44a8-a33b-65f10eea447e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] <== disconnect_volume: return (290ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:40:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:40:13 user nova-compute[75571]: DEBUG nova.objects.instance [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'flavor' on Instance uuid 3a2c4b6b-0fc7-4299-89ca-2d885e893854 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.670s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:14 user nova-compute[75571]: INFO nova.compute.manager [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Terminating instance
Nov 28 20:40:14 user nova-compute[75571]: DEBUG nova.compute.manager [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-602cf0b4-2013-4f8a-a375-07a4f96e1190 req-5f88a88d-9289-45c5-a098-1043de57ce1f service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Received event network-vif-unplugged-3319037b-9d8f-47bd-908f-12f61b7ceea2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-602cf0b4-2013-4f8a-a375-07a4f96e1190 req-5f88a88d-9289-45c5-a098-1043de57ce1f service nova] Acquiring lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-602cf0b4-2013-4f8a-a375-07a4f96e1190 req-5f88a88d-9289-45c5-a098-1043de57ce1f service nova] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-602cf0b4-2013-4f8a-a375-07a4f96e1190 req-5f88a88d-9289-45c5-a098-1043de57ce1f service nova] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-602cf0b4-2013-4f8a-a375-07a4f96e1190 req-5f88a88d-9289-45c5-a098-1043de57ce1f service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] No waiting events found dispatching network-vif-unplugged-3319037b-9d8f-47bd-908f-12f61b7ceea2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-602cf0b4-2013-4f8a-a375-07a4f96e1190 req-5f88a88d-9289-45c5-a098-1043de57ce1f service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Received event network-vif-unplugged-3319037b-9d8f-47bd-908f-12f61b7ceea2 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:14 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Instance destroyed successfully.
Nov 28 20:40:14 user nova-compute[75571]: DEBUG nova.objects.instance [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'resources' on Instance uuid 3a2c4b6b-0fc7-4299-89ca-2d885e893854 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:37:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1098397521',display_name='tempest-AttachVolumeTestJSON-server-1098397521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1098397521',id=39,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHivpLEFHewBe75hA3vkXVSjm2rcngDMU8MzWAIs9hr82dC1yHwnlNAxOq+tbMixYbmJJZUyNtQZmq1b7++eaR9Vu9hM9QDPdVYXt+qPAysMg305JJHiOKta1HBk/xHvA==',key_name='tempest-keypair-1870450819',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:37:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7d489de217644979c5888d97158a800',ramdisk_id='',reservation_id='r-cvtd5mta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-187128538',owner_user_name='tempest-AttachVolumeTestJSON-187128538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d653c87883374ab59768ce28b2b9adfc',uuid=3a2c4b6b-0fc7-4299-89ca-2d885e893854,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "address": "fa:16:3e:f5:7d:bb", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319037b-9d", "ovs_interfaceid": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converting VIF {"id": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "address": "fa:16:3e:f5:7d:bb", "network": {"id": "0c40204c-6e11-4188-ac50-9e10214d9a08", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1613210884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7d489de217644979c5888d97158a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3319037b-9d", "ovs_interfaceid": "3319037b-9d8f-47bd-908f-12f61b7ceea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=3319037b-9d8f-47bd-908f-12f61b7ceea2,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319037b-9d') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG os_vif [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=3319037b-9d8f-47bd-908f-12f61b7ceea2,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319037b-9d') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3319037b-9d, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43f248e3-32eb-4553-846e-af7631298025) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:40:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:40:14 user nova-compute[75571]: INFO os_vif [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:7d:bb,bridge_name='br-int',has_traffic_filtering=True,id=3319037b-9d8f-47bd-908f-12f61b7ceea2,network=Network(0c40204c-6e11-4188-ac50-9e10214d9a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3319037b-9d')
Nov 28 20:40:14 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Deleting instance files /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854_del
Nov 28 20:40:14 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Deletion of /opt/stack/data/nova/instances/3a2c4b6b-0fc7-4299-89ca-2d885e893854_del complete
Nov 28 20:40:15 user nova-compute[75571]: INFO nova.compute.manager [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 28 20:40:15 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:40:15 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:40:15 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:40:15 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:40:15 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Took 0.82 seconds to deallocate network for instance.
Nov 28 20:40:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:16 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:40:16 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:40:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:16 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:40:16 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Deleted allocations for instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854
Nov 28 20:40:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.040s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-5cbe9456-fa39-4599-9459-b0debf62ee5b req-8f17d086-7024-40bd-a682-a3b9f94b73f2 service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Received event network-vif-plugged-3319037b-9d8f-47bd-908f-12f61b7ceea2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:40:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5cbe9456-fa39-4599-9459-b0debf62ee5b req-8f17d086-7024-40bd-a682-a3b9f94b73f2 service nova] Acquiring lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5cbe9456-fa39-4599-9459-b0debf62ee5b req-8f17d086-7024-40bd-a682-a3b9f94b73f2 service nova] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-5cbe9456-fa39-4599-9459-b0debf62ee5b req-8f17d086-7024-40bd-a682-a3b9f94b73f2 service nova] Lock "3a2c4b6b-0fc7-4299-89ca-2d885e893854-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-5cbe9456-fa39-4599-9459-b0debf62ee5b req-8f17d086-7024-40bd-a682-a3b9f94b73f2 service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] No waiting events found dispatching network-vif-plugged-3319037b-9d8f-47bd-908f-12f61b7ceea2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:40:16 user nova-compute[75571]: WARNING nova.compute.manager [req-5cbe9456-fa39-4599-9459-b0debf62ee5b req-8f17d086-7024-40bd-a682-a3b9f94b73f2 service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Received unexpected event network-vif-plugged-3319037b-9d8f-47bd-908f-12f61b7ceea2 for instance with vm_state deleted and task_state None.
Nov 28 20:40:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-5cbe9456-fa39-4599-9459-b0debf62ee5b req-8f17d086-7024-40bd-a682-a3b9f94b73f2 service nova] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Received event network-vif-deleted-3319037b-9d8f-47bd-908f-12f61b7ceea2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:40:18 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:40:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:40:19 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:40:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:20 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:40:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:40:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:40:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:40:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:40:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Updating instance_info_cache with network_info: [{"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:40:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:40:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:40:21 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:40:21 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:40:24 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:40:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:24 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:40:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:26 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:40:26 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:40:26 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8593MB free_disk=24.992752075195312GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:40:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:26 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:40:26 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:40:26 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 899045e8-9836-4139-9546-78f57348a234 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:40:26 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:40:26 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:40:26 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:40:26 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:40:26 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:40:26 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:40:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:27 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:40:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "899045e8-9836-4139-9546-78f57348a234" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "899045e8-9836-4139-9546-78f57348a234" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "899045e8-9836-4139-9546-78f57348a234-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "899045e8-9836-4139-9546-78f57348a234-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "899045e8-9836-4139-9546-78f57348a234-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:28 user nova-compute[75571]: INFO nova.compute.manager [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Terminating instance
Nov 28 20:40:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:40:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-a6388d54-7eba-41cf-954d-82af3819256f req-1e7ae8c5-ce18-46f9-b317-33ee77bbb74c service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Received event network-vif-unplugged-440b18b0-f9a0-422c-a9a9-1cd0f25af43d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:40:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a6388d54-7eba-41cf-954d-82af3819256f req-1e7ae8c5-ce18-46f9-b317-33ee77bbb74c service nova] Acquiring lock "899045e8-9836-4139-9546-78f57348a234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a6388d54-7eba-41cf-954d-82af3819256f req-1e7ae8c5-ce18-46f9-b317-33ee77bbb74c service nova] Lock "899045e8-9836-4139-9546-78f57348a234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a6388d54-7eba-41cf-954d-82af3819256f req-1e7ae8c5-ce18-46f9-b317-33ee77bbb74c service nova] Lock "899045e8-9836-4139-9546-78f57348a234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-a6388d54-7eba-41cf-954d-82af3819256f req-1e7ae8c5-ce18-46f9-b317-33ee77bbb74c service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] No waiting events found dispatching network-vif-unplugged-440b18b0-f9a0-422c-a9a9-1cd0f25af43d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:40:28 user nova-compute[75571]: DEBUG nova.compute.manager [req-a6388d54-7eba-41cf-954d-82af3819256f req-1e7ae8c5-ce18-46f9-b317-33ee77bbb74c service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Received event network-vif-unplugged-440b18b0-f9a0-422c-a9a9-1cd0f25af43d for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:40:29 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 899045e8-9836-4139-9546-78f57348a234] Instance destroyed successfully.
Nov 28 20:40:29 user nova-compute[75571]: DEBUG nova.objects.instance [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lazy-loading 'resources' on Instance uuid 899045e8-9836-4139-9546-78f57348a234 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:38:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1767325736',display_name='tempest-VolumesActionsTest-instance-1767325736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1767325736',id=40,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b17c476044c24a87bb1e78cba8b2d4fe',ramdisk_id='',reservation_id='r-h5ojy2yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1841711590',owner_user_name='tempest-VolumesActionsTest-1841711590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:38:38Z,user_data=None,user_id='69f82221168549d5a500a9553ed98c72',uuid=899045e8-9836-4139-9546-78f57348a234,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "address": "fa:16:3e:5f:d1:6d", "network": {"id": "e31d602e-932e-4387-bb9b-0c9fb0e0f717", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1335483937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b17c476044c24a87bb1e78cba8b2d4fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440b18b0-f9", "ovs_interfaceid": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Converting VIF {"id": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "address": "fa:16:3e:5f:d1:6d", "network": {"id": "e31d602e-932e-4387-bb9b-0c9fb0e0f717", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1335483937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b17c476044c24a87bb1e78cba8b2d4fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440b18b0-f9", "ovs_interfaceid": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d1:6d,bridge_name='br-int',has_traffic_filtering=True,id=440b18b0-f9a0-422c-a9a9-1cd0f25af43d,network=Network(e31d602e-932e-4387-bb9b-0c9fb0e0f717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440b18b0-f9') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG os_vif [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d1:6d,bridge_name='br-int',has_traffic_filtering=True,id=440b18b0-f9a0-422c-a9a9-1cd0f25af43d,network=Network(e31d602e-932e-4387-bb9b-0c9fb0e0f717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440b18b0-f9') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap440b18b0-f9, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82f48aa2-1367-4d51-845d-df5955b4f350) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:40:29 user nova-compute[75571]: INFO os_vif [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d1:6d,bridge_name='br-int',has_traffic_filtering=True,id=440b18b0-f9a0-422c-a9a9-1cd0f25af43d,network=Network(e31d602e-932e-4387-bb9b-0c9fb0e0f717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440b18b0-f9')
Nov 28 20:40:29 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Deleting instance files /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234_del
Nov 28 20:40:29 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Deletion of /opt/stack/data/nova/instances/899045e8-9836-4139-9546-78f57348a234_del complete
Nov 28 20:40:29 user nova-compute[75571]: INFO nova.compute.manager [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 20:40:29 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 899045e8-9836-4139-9546-78f57348a234] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 899045e8-9836-4139-9546-78f57348a234] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 899045e8-9836-4139-9546-78f57348a234] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-ff7d3c81-84c8-4909-9750-ed3fd7617329 req-95216527-70c5-46ce-bf4f-813f27f7e67a service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Received event network-vif-deleted-440b18b0-f9a0-422c-a9a9-1cd0f25af43d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:40:29 user nova-compute[75571]: INFO nova.compute.manager [req-ff7d3c81-84c8-4909-9750-ed3fd7617329 req-95216527-70c5-46ce-bf4f-813f27f7e67a service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Neutron deleted interface 440b18b0-f9a0-422c-a9a9-1cd0f25af43d; detaching it from the instance and deleting it from the info cache
Nov 28 20:40:29 user nova-compute[75571]: DEBUG nova.network.neutron [req-ff7d3c81-84c8-4909-9750-ed3fd7617329 req-95216527-70c5-46ce-bf4f-813f27f7e67a service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:40:29 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 899045e8-9836-4139-9546-78f57348a234] Took 0.49 seconds to deallocate network for instance.
Nov 28 20:40:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-ff7d3c81-84c8-4909-9750-ed3fd7617329 req-95216527-70c5-46ce-bf4f-813f27f7e67a service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Detach interface failed, port_id=440b18b0-f9a0-422c-a9a9-1cd0f25af43d, reason: Instance 899045e8-9836-4139-9546-78f57348a234 could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:30 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:40:30 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:40:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:30 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Deleted allocations for instance 899045e8-9836-4139-9546-78f57348a234
Nov 28 20:40:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "899045e8-9836-4139-9546-78f57348a234" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.748s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:30 user nova-compute[75571]: DEBUG nova.compute.manager [req-f3ac1efe-ae9f-42a3-a555-aec7a676f22e req-9c77e51a-e0b0-43e7-a3b3-55da3eb8e37f service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Received event network-vif-plugged-440b18b0-f9a0-422c-a9a9-1cd0f25af43d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:40:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f3ac1efe-ae9f-42a3-a555-aec7a676f22e req-9c77e51a-e0b0-43e7-a3b3-55da3eb8e37f service nova] Acquiring lock "899045e8-9836-4139-9546-78f57348a234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f3ac1efe-ae9f-42a3-a555-aec7a676f22e req-9c77e51a-e0b0-43e7-a3b3-55da3eb8e37f service nova] Lock "899045e8-9836-4139-9546-78f57348a234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f3ac1efe-ae9f-42a3-a555-aec7a676f22e req-9c77e51a-e0b0-43e7-a3b3-55da3eb8e37f service nova] Lock "899045e8-9836-4139-9546-78f57348a234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:30 user nova-compute[75571]: DEBUG nova.compute.manager [req-f3ac1efe-ae9f-42a3-a555-aec7a676f22e req-9c77e51a-e0b0-43e7-a3b3-55da3eb8e37f service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] No waiting events found dispatching network-vif-plugged-440b18b0-f9a0-422c-a9a9-1cd0f25af43d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:40:30 user nova-compute[75571]: WARNING nova.compute.manager [req-f3ac1efe-ae9f-42a3-a555-aec7a676f22e req-9c77e51a-e0b0-43e7-a3b3-55da3eb8e37f service nova] [instance: 899045e8-9836-4139-9546-78f57348a234] Received unexpected event network-vif-plugged-440b18b0-f9a0-422c-a9a9-1cd0f25af43d for instance with vm_state deleted and task_state None.
Nov 28 20:40:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-3eb5ce27-decf-40b8-87f3-07ac6dd8c183 req-ed6ff85c-25a4-4dc2-adf7-56dcbed391cc service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-changed-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-3eb5ce27-decf-40b8-87f3-07ac6dd8c183 req-ed6ff85c-25a4-4dc2-adf7-56dcbed391cc service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Refreshing instance network info cache due to event network-changed-7354a1a8-41e9-4a3c-9d08-fa55997c917a. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3eb5ce27-decf-40b8-87f3-07ac6dd8c183 req-ed6ff85c-25a4-4dc2-adf7-56dcbed391cc service nova] Acquiring lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3eb5ce27-decf-40b8-87f3-07ac6dd8c183 req-ed6ff85c-25a4-4dc2-adf7-56dcbed391cc service nova] Acquired lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG nova.network.neutron [req-3eb5ce27-decf-40b8-87f3-07ac6dd8c183 req-ed6ff85c-25a4-4dc2-adf7-56dcbed391cc service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Refreshing network info cache for port 7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG nova.objects.instance [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'flavor' on Instance uuid f23739ef-322e-4a8f-9df3-2a06e42b6a35 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG nova.network.neutron [req-3eb5ce27-decf-40b8-87f3-07ac6dd8c183 req-ed6ff85c-25a4-4dc2-adf7-56dcbed391cc service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updated VIF entry in instance network info cache for port 7354a1a8-41e9-4a3c-9d08-fa55997c917a. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG nova.network.neutron [req-3eb5ce27-decf-40b8-87f3-07ac6dd8c183 req-ed6ff85c-25a4-4dc2-adf7-56dcbed391cc service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updating instance_info_cache with network_info: [{"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3eb5ce27-decf-40b8-87f3-07ac6dd8c183 req-ed6ff85c-25a4-4dc2-adf7-56dcbed391cc service nova] Releasing lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:40 user nova-compute[75571]: INFO nova.compute.manager [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Attaching volume d9d0bf49-e1ad-4031-9ad6-10aade724351 to /dev/vdb
Nov 28 20:40:40 user nova-compute[75571]: DEBUG os_brick.utils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[06471b71-37f2-44ec-8c7c-602e6ada496e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60b2a59-fc1d-4e8c-8dd6-9e8bfed44861]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad6c3c4-ad3f-413f-abee-ef3d84a5e3e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[54115fbe-9f4e-48ea-8f7b-5d8a00e497e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:40:40 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:40:40 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de40a4b-bf8a-4b22-8c95-9b140cd32f7c]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:40:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:40:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:40:41 user nova-compute[75571]: DEBUG os_brick.utils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:40:41 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updating existing volume attachment record: d0aa6778-03c9-4b18-9025-475dbfa3841c {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:40:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:40:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDkiMuCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:40:47 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:40:47 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:40:47 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[97336328-694e-4e89-a617-9e44bcd45f19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:40:47 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5909f4f3-ffb3-40b8-a884-8be30213e28a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351] added
Nov 28 20:40:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee0648d-c6b1-467e-822d-d4b3bf50f6d4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[230d4a6d-e7b0-406b-80ab-b2b1dfdce934]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eDkiMuCh {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eDkiMuCh" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f392035-6c7b-4399-9432-8b55279227f5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eDkiMuCh'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b4a243-76c1-40f0-90cd-57636a6eb201]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c7616f-a73b-4587-9c1e-461d8234ca68]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:40:47 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:40:47 user nova-compute[75571]:  {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:40:47 user nova-compute[75571]: WARNING os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 20:40:47 user nova-compute[75571]: 
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18f6013-db79-40af-a41d-97688b1d8105]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351, portal: 172.16.0.220,3260]
Nov 28 20:40:47 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351, portal: 172.16.0.220,3260] successful.
Nov 28 20:40:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cf4add-e360-4ce5-af92-914b615efc1c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e045044a-a379-4369-8046-4f62118ae848]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 (non-flash)
Nov 28 20:40:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 (non-flash)
Nov 28 20:40:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbe6b93-e0cf-43bc-a1fe-ee96cc6c41b2]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:40:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:40:48 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:40:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDkiMuCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:40:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:40:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23463663634613866', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:40:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463663634613866', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:40:48 user nova-compute[75571]: DEBUG nova.objects.instance [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'flavor' on Instance uuid f23739ef-322e-4a8f-9df3-2a06e42b6a35 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:40:48 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:40:48 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:40:48 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:40:48 user nova-compute[75571]:   <serial>d9d0bf49-e1ad-4031-9ad6-10aade724351</serial>
Nov 28 20:40:48 user nova-compute[75571]: </disk>
Nov 28 20:40:48 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:40:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:40:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:40:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No VIF found with MAC fa:16:3e:a8:8b:70, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:40:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.675s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:50 user nova-compute[75571]: INFO nova.compute.manager [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Rescuing
Nov 28 20:40:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:40:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquired lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:40:50 user nova-compute[75571]: DEBUG nova.network.neutron [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:40:51 user nova-compute[75571]: DEBUG nova.network.neutron [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updating instance_info_cache with network_info: [{"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:40:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Releasing lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:40:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.compute.manager [req-126e4cba-3c8d-4db3-ab9a-8b4bb3aaeca4 req-26fd5e6e-409f-4fdf-995e-0f1f2571fa0e service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-vif-unplugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-126e4cba-3c8d-4db3-ab9a-8b4bb3aaeca4 req-26fd5e6e-409f-4fdf-995e-0f1f2571fa0e service nova] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-126e4cba-3c8d-4db3-ab9a-8b4bb3aaeca4 req-26fd5e6e-409f-4fdf-995e-0f1f2571fa0e service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-126e4cba-3c8d-4db3-ab9a-8b4bb3aaeca4 req-26fd5e6e-409f-4fdf-995e-0f1f2571fa0e service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.compute.manager [req-126e4cba-3c8d-4db3-ab9a-8b4bb3aaeca4 req-26fd5e6e-409f-4fdf-995e-0f1f2571fa0e service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] No waiting events found dispatching network-vif-unplugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:40:52 user nova-compute[75571]: WARNING nova.compute.manager [req-126e4cba-3c8d-4db3-ab9a-8b4bb3aaeca4 req-26fd5e6e-409f-4fdf-995e-0f1f2571fa0e service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received unexpected event network-vif-unplugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance with vm_state active and task_state rescuing.
Nov 28 20:40:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "b2c27e15-6791-4d75-8df0-957c10d7ca42" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:52 user nova-compute[75571]: INFO nova.compute.manager [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Unshelving
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'pci_requests' on Instance uuid b2c27e15-6791-4d75-8df0-957c10d7ca42 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'numa_topology' on Instance uuid b2c27e15-6791-4d75-8df0-957c10d7ca42 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:40:52 user nova-compute[75571]: INFO nova.compute.claims [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Claim successful on node user
Nov 28 20:40:52 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Instance destroyed successfully.
Nov 28 20:40:52 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Attempting rescue
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75571) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Instance directory exists: not creating {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 20:40:52 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Creating image(s)
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "/opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "/opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "/opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.objects.instance [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'trusted_certs' on Instance uuid f23739ef-322e-4a8f-9df3-2a06e42b6a35 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.rescue {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.rescue" returned: 0 in 0.064s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.objects.instance [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'migration_context' on Instance uuid f23739ef-322e-4a8f-9df3-2a06e42b6a35 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.objects.base [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Object Instance<f23739ef-322e-4a8f-9df3-2a06e42b6a35> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Start _get_guest_xml network_info=[{"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "vif_mac": "fa:16:3e:a8:8b:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '77b9e284-7155-4207-b748-934c25ce18d0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.objects.instance [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'resources' on Instance uuid f23739ef-322e-4a8f-9df3-2a06e42b6a35 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.objects.base [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Object Instance<f23739ef-322e-4a8f-9df3-2a06e42b6a35> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.objects.instance [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'numa_topology' on Instance uuid f23739ef-322e-4a8f-9df3-2a06e42b6a35 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:52 user nova-compute[75571]: DEBUG nova.objects.base [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Object Instance<f23739ef-322e-4a8f-9df3-2a06e42b6a35> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:40:52 user nova-compute[75571]: INFO nova.network.neutron [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Updating port bc13ffb2-0ccf-4e86-8502-bea728a1e20f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 20:40:52 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:40:52 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.objects.instance [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'vcpu_model' on Instance uuid f23739ef-322e-4a8f-9df3-2a06e42b6a35 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.objects.base [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Object Instance<f23739ef-322e-4a8f-9df3-2a06e42b6a35> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1401374666',display_name='tempest-ServerRescueNegativeTestJSON-server-1401374666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1401374666',id=41,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWg6YbMlebQ5V+UbkiDrrgElaYoiXY9oYImEppuaL6/Oo5HZCbiLccGXYvygaEUJySbNh/P4i1kz+O1q3We6pyWNWE9nV6EgEtTcw+bkFNGx5lVpre5FiMuKcW99C0YaA==',key_name='tempest-keypair-249978267',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:38:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d72dc075421c4e7eb9c0ff2bf1641a92',ramdisk_id='',reservation_id='r-zhhy1al0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-506941201',owner_user_name='tempest-ServerRescueNegativeTestJSON-506941201-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:38:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='634123644067453a92f4d43da0b28fa7',uuid=f23739ef-322e-4a8f-9df3-2a06e42b6a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "vif_mac": "fa:16:3e:a8:8b:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converting VIF {"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "vif_mac": "fa:16:3e:a8:8b:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:8b:70,bridge_name='br-int',has_traffic_filtering=True,id=7354a1a8-41e9-4a3c-9d08-fa55997c917a,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7354a1a8-41') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.objects.instance [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'pci_devices' on Instance uuid f23739ef-322e-4a8f-9df3-2a06e42b6a35 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.objects.base [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Object Instance<f23739ef-322e-4a8f-9df3-2a06e42b6a35> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:40:53 user nova-compute[75571]:   <uuid>f23739ef-322e-4a8f-9df3-2a06e42b6a35</uuid>
Nov 28 20:40:53 user nova-compute[75571]:   <name>instance-00000029</name>
Nov 28 20:40:53 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:40:53 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:40:53 user nova-compute[75571]:   <metadata>
Nov 28 20:40:53 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:40:53 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:40:53 user nova-compute[75571]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1401374666</nova:name>
Nov 28 20:40:53 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:40:53</nova:creationTime>
Nov 28 20:40:53 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:40:53 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:40:53 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:40:53 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:40:53 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:40:53 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:40:53 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:40:53 user nova-compute[75571]:       <nova:owner>
Nov 28 20:40:53 user nova-compute[75571]:         <nova:user uuid="634123644067453a92f4d43da0b28fa7">tempest-ServerRescueNegativeTestJSON-506941201-project-member</nova:user>
Nov 28 20:40:53 user nova-compute[75571]:         <nova:project uuid="d72dc075421c4e7eb9c0ff2bf1641a92">tempest-ServerRescueNegativeTestJSON-506941201</nova:project>
Nov 28 20:40:53 user nova-compute[75571]:       </nova:owner>
Nov 28 20:40:53 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:40:53 user nova-compute[75571]:       <nova:ports>
Nov 28 20:40:53 user nova-compute[75571]:         <nova:port uuid="7354a1a8-41e9-4a3c-9d08-fa55997c917a">
Nov 28 20:40:53 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 20:40:53 user nova-compute[75571]:         </nova:port>
Nov 28 20:40:53 user nova-compute[75571]:       </nova:ports>
Nov 28 20:40:53 user nova-compute[75571]:     </nova:instance>
Nov 28 20:40:53 user nova-compute[75571]:   </metadata>
Nov 28 20:40:53 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:40:53 user nova-compute[75571]:     <system>
Nov 28 20:40:53 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:40:53 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:40:53 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:40:53 user nova-compute[75571]:       <entry name="serial">f23739ef-322e-4a8f-9df3-2a06e42b6a35</entry>
Nov 28 20:40:53 user nova-compute[75571]:       <entry name="uuid">f23739ef-322e-4a8f-9df3-2a06e42b6a35</entry>
Nov 28 20:40:53 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:40:53 user nova-compute[75571]:     </system>
Nov 28 20:40:53 user nova-compute[75571]:   </sysinfo>
Nov 28 20:40:53 user nova-compute[75571]:   <os>
Nov 28 20:40:53 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:40:53 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:40:53 user nova-compute[75571]:   </os>
Nov 28 20:40:53 user nova-compute[75571]:   <features>
Nov 28 20:40:53 user nova-compute[75571]:     <acpi/>
Nov 28 20:40:53 user nova-compute[75571]:     <apic/>
Nov 28 20:40:53 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:40:53 user nova-compute[75571]:   </features>
Nov 28 20:40:53 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:40:53 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:40:53 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:40:53 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:40:53 user nova-compute[75571]:   </clock>
Nov 28 20:40:53 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:40:53 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:40:53 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:40:53 user nova-compute[75571]:   </cpu>
Nov 28 20:40:53 user nova-compute[75571]:   <devices>
Nov 28 20:40:53 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:40:53 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:40:53 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.rescue"/>
Nov 28 20:40:53 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:40:53 user nova-compute[75571]:     </disk>
Nov 28 20:40:53 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:40:53 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:40:53 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk"/>
Nov 28 20:40:53 user nova-compute[75571]:       <target dev="vdb" bus="virtio"/>
Nov 28 20:40:53 user nova-compute[75571]:     </disk>
Nov 28 20:40:53 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:40:53 user nova-compute[75571]:       <mac address="fa:16:3e:a8:8b:70"/>
Nov 28 20:40:53 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:40:53 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:40:53 user nova-compute[75571]:       <target dev="tap7354a1a8-41"/>
Nov 28 20:40:53 user nova-compute[75571]:     </interface>
Nov 28 20:40:53 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:40:53 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/console.log" append="off"/>
Nov 28 20:40:53 user nova-compute[75571]:     </serial>
Nov 28 20:40:53 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:40:53 user nova-compute[75571]:     <video>
Nov 28 20:40:53 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:40:53 user nova-compute[75571]:     </video>
Nov 28 20:40:53 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:40:53 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:40:53 user nova-compute[75571]:     </rng>
Nov 28 20:40:53 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:40:53 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:40:53 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:40:53 user nova-compute[75571]:     </memballoon>
Nov 28 20:40:53 user nova-compute[75571]:   </devices>
Nov 28 20:40:53 user nova-compute[75571]: </domain>
Nov 28 20:40:53 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:40:53 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Instance destroyed successfully.
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] No VIF found with MAC fa:16:3e:a8:8b:70, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquired lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.compute.manager [req-165ecce1-2174-43b9-9a68-ddaf9dfdced3 req-a6ad9579-4488-4586-b5b4-84835eb25a45 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received event network-changed-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.compute.manager [req-165ecce1-2174-43b9-9a68-ddaf9dfdced3 req-a6ad9579-4488-4586-b5b4-84835eb25a45 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Refreshing instance network info cache due to event network-changed-bc13ffb2-0ccf-4e86-8502-bea728a1e20f. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-165ecce1-2174-43b9-9a68-ddaf9dfdced3 req-a6ad9579-4488-4586-b5b4-84835eb25a45 service nova] Acquiring lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Updating instance_info_cache with network_info: [{"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Releasing lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:40:53 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Creating image(s)
Nov 28 20:40:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "/opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "/opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'trusted_certs' on Instance uuid b2c27e15-6791-4d75-8df0-957c10d7ca42 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-165ecce1-2174-43b9-9a68-ddaf9dfdced3 req-a6ad9579-4488-4586-b5b4-84835eb25a45 service nova] Acquired lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.network.neutron [req-165ecce1-2174-43b9-9a68-ddaf9dfdced3 req-a6ad9579-4488-4586-b5b4-84835eb25a45 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Refreshing network info cache for port bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG nova.objects.base [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Object Instance<b2c27e15-6791-4d75-8df0-957c10d7ca42> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "432b1c7e7f8b0a78df25a87577c0ea191dbf62f8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "432b1c7e7f8b0a78df25a87577c0ea191dbf62f8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:54 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8.part --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:54 user nova-compute[75571]: DEBUG nova.compute.manager [req-20aebaad-600d-456c-8655-b267ea1705ce req-bc49f483-7a9d-48c9-b716-44830cd387ba service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:40:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-20aebaad-600d-456c-8655-b267ea1705ce req-bc49f483-7a9d-48c9-b716-44830cd387ba service nova] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-20aebaad-600d-456c-8655-b267ea1705ce req-bc49f483-7a9d-48c9-b716-44830cd387ba service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-20aebaad-600d-456c-8655-b267ea1705ce req-bc49f483-7a9d-48c9-b716-44830cd387ba service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:54 user nova-compute[75571]: DEBUG nova.compute.manager [req-20aebaad-600d-456c-8655-b267ea1705ce req-bc49f483-7a9d-48c9-b716-44830cd387ba service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] No waiting events found dispatching network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:40:54 user nova-compute[75571]: WARNING nova.compute.manager [req-20aebaad-600d-456c-8655-b267ea1705ce req-bc49f483-7a9d-48c9-b716-44830cd387ba service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received unexpected event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance with vm_state active and task_state rescuing.
Nov 28 20:40:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG nova.virt.images [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] ec62c902-d8a3-4762-a884-3cce07baff1a was qcow2, converting to raw {{(pid=75571) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG nova.privsep.utils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75571) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8.part /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8.converted {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG nova.network.neutron [req-165ecce1-2174-43b9-9a68-ddaf9dfdced3 req-a6ad9579-4488-4586-b5b4-84835eb25a45 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Updated VIF entry in instance network info cache for port bc13ffb2-0ccf-4e86-8502-bea728a1e20f. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG nova.network.neutron [req-165ecce1-2174-43b9-9a68-ddaf9dfdced3 req-a6ad9579-4488-4586-b5b4-84835eb25a45 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Updating instance_info_cache with network_info: [{"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-165ecce1-2174-43b9-9a68-ddaf9dfdced3 req-a6ad9579-4488-4586-b5b4-84835eb25a45 service nova] Releasing lock "refresh_cache-b2c27e15-6791-4d75-8df0-957c10d7ca42" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8.part /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8.converted" returned: 0 in 0.444s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8.converted --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "432b1c7e7f8b0a78df25a87577c0ea191dbf62f8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.753s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8 --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8 --force-share --output=json" returned: 0 in 0.182s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "432b1c7e7f8b0a78df25a87577c0ea191dbf62f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "432b1c7e7f8b0a78df25a87577c0ea191dbf62f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8 --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8 --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8,backing_fmt=raw /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8,backing_fmt=raw /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk 1073741824" returned: 0 in 0.049s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "432b1c7e7f8b0a78df25a87577c0ea191dbf62f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8 --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG nova.compute.manager [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG nova.compute.manager [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] No waiting events found dispatching network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:40:56 user nova-compute[75571]: WARNING nova.compute.manager [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received unexpected event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance with vm_state active and task_state rescuing.
Nov 28 20:40:56 user nova-compute[75571]: DEBUG nova.compute.manager [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG nova.compute.manager [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] No waiting events found dispatching network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:40:56 user nova-compute[75571]: WARNING nova.compute.manager [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received unexpected event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance with vm_state active and task_state rescuing.
Nov 28 20:40:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8 --force-share --output=json" returned: 0 in 0.167s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'migration_context' on Instance uuid b2c27e15-6791-4d75-8df0-957c10d7ca42 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG nova.objects.base [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Object Instance<b2c27e15-6791-4d75-8df0-957c10d7ca42> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:40:56 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Rebasing disk image.
Nov 28 20:40:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.168s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b -F raw /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:40:56 user nova-compute[75571]: DEBUG nova.compute.manager [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b -F raw /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk" returned: 0 in 2.542s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Ensure instance console log exists: /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Start _get_guest_xml network_info=[{"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='75ad503fa48d730d74bf495ffd04966b',container_format='bare',created_at=2023-11-28T20:39:00Z,direct_url=<?>,disk_format='qcow2',id=ec62c902-d8a3-4762-a884-3cce07baff1a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1654201794-shelved',owner='292cfffce13446c8963785adfb4b9d22',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T20:39:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:40:59 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:40:59 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='75ad503fa48d730d74bf495ffd04966b',container_format='bare',created_at=2023-11-28T20:39:00Z,direct_url=<?>,disk_format='qcow2',id=ec62c902-d8a3-4762-a884-3cce07baff1a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1654201794-shelved',owner='292cfffce13446c8963785adfb4b9d22',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T20:39:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'vcpu_model' on Instance uuid b2c27e15-6791-4d75-8df0-957c10d7ca42 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.objects.base [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Object Instance<b2c27e15-6791-4d75-8df0-957c10d7ca42> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T20:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1654201794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1654201794',id=38,image_ref='ec62c902-d8a3-4762-a884-3cce07baff1a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-144574904',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:37:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='292cfffce13446c8963785adfb4b9d22',ramdisk_id='',reservation_id='r-f7h5ryu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1442792072',owner_user_name='tempest-AttachVolumeShelveTestJSON-1442792072-project-member',shelved_at='2023-11-28T20:39:03.955403',shelved_host='user',shelved_image_id='ec62c902-d8a3-4762-a884-3cce07baff1a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:40:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e21afd3261f4b1a87f7cbb4348fc9fe',uuid=b2c27e15-6791-4d75-8df0-957c10d7ca42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converting VIF {"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:54:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc13ffb2-0ccf-4e86-8502-bea728a1e20f,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc13ffb2-0c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'pci_devices' on Instance uuid b2c27e15-6791-4d75-8df0-957c10d7ca42 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.objects.base [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Object Instance<b2c27e15-6791-4d75-8df0-957c10d7ca42> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75571) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:40:59 user nova-compute[75571]:   <uuid>b2c27e15-6791-4d75-8df0-957c10d7ca42</uuid>
Nov 28 20:40:59 user nova-compute[75571]:   <name>instance-00000026</name>
Nov 28 20:40:59 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:40:59 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:40:59 user nova-compute[75571]:   <metadata>
Nov 28 20:40:59 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:40:59 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:40:59 user nova-compute[75571]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1654201794</nova:name>
Nov 28 20:40:59 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:40:59</nova:creationTime>
Nov 28 20:40:59 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:40:59 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:40:59 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:40:59 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:40:59 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:40:59 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:40:59 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:40:59 user nova-compute[75571]:       <nova:owner>
Nov 28 20:40:59 user nova-compute[75571]:         <nova:user uuid="9e21afd3261f4b1a87f7cbb4348fc9fe">tempest-AttachVolumeShelveTestJSON-1442792072-project-member</nova:user>
Nov 28 20:40:59 user nova-compute[75571]:         <nova:project uuid="292cfffce13446c8963785adfb4b9d22">tempest-AttachVolumeShelveTestJSON-1442792072</nova:project>
Nov 28 20:40:59 user nova-compute[75571]:       </nova:owner>
Nov 28 20:40:59 user nova-compute[75571]:       <nova:root type="image" uuid="ec62c902-d8a3-4762-a884-3cce07baff1a"/>
Nov 28 20:40:59 user nova-compute[75571]:       <nova:ports>
Nov 28 20:40:59 user nova-compute[75571]:         <nova:port uuid="bc13ffb2-0ccf-4e86-8502-bea728a1e20f">
Nov 28 20:40:59 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:40:59 user nova-compute[75571]:         </nova:port>
Nov 28 20:40:59 user nova-compute[75571]:       </nova:ports>
Nov 28 20:40:59 user nova-compute[75571]:     </nova:instance>
Nov 28 20:40:59 user nova-compute[75571]:   </metadata>
Nov 28 20:40:59 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:40:59 user nova-compute[75571]:     <system>
Nov 28 20:40:59 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:40:59 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:40:59 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:40:59 user nova-compute[75571]:       <entry name="serial">b2c27e15-6791-4d75-8df0-957c10d7ca42</entry>
Nov 28 20:40:59 user nova-compute[75571]:       <entry name="uuid">b2c27e15-6791-4d75-8df0-957c10d7ca42</entry>
Nov 28 20:40:59 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:40:59 user nova-compute[75571]:     </system>
Nov 28 20:40:59 user nova-compute[75571]:   </sysinfo>
Nov 28 20:40:59 user nova-compute[75571]:   <os>
Nov 28 20:40:59 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:40:59 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:40:59 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:40:59 user nova-compute[75571]:   </os>
Nov 28 20:40:59 user nova-compute[75571]:   <features>
Nov 28 20:40:59 user nova-compute[75571]:     <acpi/>
Nov 28 20:40:59 user nova-compute[75571]:     <apic/>
Nov 28 20:40:59 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:40:59 user nova-compute[75571]:   </features>
Nov 28 20:40:59 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:40:59 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:40:59 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:40:59 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:40:59 user nova-compute[75571]:   </clock>
Nov 28 20:40:59 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:40:59 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:40:59 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:40:59 user nova-compute[75571]:   </cpu>
Nov 28 20:40:59 user nova-compute[75571]:   <devices>
Nov 28 20:40:59 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:40:59 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:40:59 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk"/>
Nov 28 20:40:59 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:40:59 user nova-compute[75571]:     </disk>
Nov 28 20:40:59 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:40:59 user nova-compute[75571]:       <mac address="fa:16:3e:34:54:0f"/>
Nov 28 20:40:59 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:40:59 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:40:59 user nova-compute[75571]:       <target dev="tapbc13ffb2-0c"/>
Nov 28 20:40:59 user nova-compute[75571]:     </interface>
Nov 28 20:40:59 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:40:59 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/console.log" append="off"/>
Nov 28 20:40:59 user nova-compute[75571]:     </serial>
Nov 28 20:40:59 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:40:59 user nova-compute[75571]:     <video>
Nov 28 20:40:59 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:40:59 user nova-compute[75571]:     </video>
Nov 28 20:40:59 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:40:59 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:40:59 user nova-compute[75571]:     </rng>
Nov 28 20:40:59 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:40:59 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:40:59 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:40:59 user nova-compute[75571]:     </memballoon>
Nov 28 20:40:59 user nova-compute[75571]:   </devices>
Nov 28 20:40:59 user nova-compute[75571]: </domain>
Nov 28 20:40:59 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T20:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1654201794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1654201794',id=38,image_ref='ec62c902-d8a3-4762-a884-3cce07baff1a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-144574904',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:37:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='292cfffce13446c8963785adfb4b9d22',ramdisk_id='',reservation_id='r-f7h5ryu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1442792072',owner_user_name='tempest-AttachVolumeShelveTestJSON-1442792072-project-member',shelved_at='2023-11-28T20:39:03.955403',shelved_host='user',shelved_image_id='ec62c902-d8a3-4762-a884-3cce07baff1a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:40:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e21afd3261f4b1a87f7cbb4348fc9fe',uuid=b2c27e15-6791-4d75-8df0-957c10d7ca42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converting VIF {"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:54:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc13ffb2-0ccf-4e86-8502-bea728a1e20f,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc13ffb2-0c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG os_vif [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:54:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc13ffb2-0ccf-4e86-8502-bea728a1e20f,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc13ffb2-0c') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e95c4b2-4eae-5079-8302-42afca31404c', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc13ffb2-0c, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc13ffb2-0c, col_values=(('qos', UUID('61989870-d1b3-49aa-88fc-672c8b1a0c2d')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc13ffb2-0c, col_values=(('external_ids', {'iface-id': 'bc13ffb2-0ccf-4e86-8502-bea728a1e20f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:54:0f', 'vm-uuid': 'b2c27e15-6791-4d75-8df0-957c10d7ca42'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:40:59 user nova-compute[75571]: INFO os_vif [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:54:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc13ffb2-0ccf-4e86-8502-bea728a1e20f,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc13ffb2-0c')
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:40:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] No VIF found with MAC fa:16:3e:34:54:0f, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:41:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-326698cb-aab9-49a9-884d-4e73309daaea req-f607bc57-db90-4c80-9c21-86e9fddb9928 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received event network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:41:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-326698cb-aab9-49a9-884d-4e73309daaea req-f607bc57-db90-4c80-9c21-86e9fddb9928 service nova] Acquiring lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:41:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-326698cb-aab9-49a9-884d-4e73309daaea req-f607bc57-db90-4c80-9c21-86e9fddb9928 service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:41:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-326698cb-aab9-49a9-884d-4e73309daaea req-f607bc57-db90-4c80-9c21-86e9fddb9928 service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:41:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-326698cb-aab9-49a9-884d-4e73309daaea req-f607bc57-db90-4c80-9c21-86e9fddb9928 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] No waiting events found dispatching network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:41:00 user nova-compute[75571]: WARNING nova.compute.manager [req-326698cb-aab9-49a9-884d-4e73309daaea req-f607bc57-db90-4c80-9c21-86e9fddb9928 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received unexpected event network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 20:41:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-99a7621f-b490-4c4e-bb29-a03a75d6c6f6 req-07e722bb-6e65-4b6d-b498-030015e4993b service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received event network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:41:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-99a7621f-b490-4c4e-bb29-a03a75d6c6f6 req-07e722bb-6e65-4b6d-b498-030015e4993b service nova] Acquiring lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:41:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-99a7621f-b490-4c4e-bb29-a03a75d6c6f6 req-07e722bb-6e65-4b6d-b498-030015e4993b service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:41:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-99a7621f-b490-4c4e-bb29-a03a75d6c6f6 req-07e722bb-6e65-4b6d-b498-030015e4993b service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:41:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-99a7621f-b490-4c4e-bb29-a03a75d6c6f6 req-07e722bb-6e65-4b6d-b498-030015e4993b service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] No waiting events found dispatching network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:41:02 user nova-compute[75571]: WARNING nova.compute.manager [req-99a7621f-b490-4c4e-bb29-a03a75d6c6f6 req-07e722bb-6e65-4b6d-b498-030015e4993b service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received unexpected event network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 20:41:03 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:41:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:41:03 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Instance spawned successfully.
Nov 28 20:41:03 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:41:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.208s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:41:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:14 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:41:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:41:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:41:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:41:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:41:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:17 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:41:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:20 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:41:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:41:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:41:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:41:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:41:20 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updating instance_info_cache with network_info: [{"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:41:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:41:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:41:20 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:41:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:41:21 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:41:22 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:41:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:41:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:26 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:41:26 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:41:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:41:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:41:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:41:26 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:41:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:41:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:41:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:41:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:41:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:41:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:41:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:41:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:41:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:41:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:41:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:41:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:41:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:41:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:41:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:41:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:41:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:41:28 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:41:28 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:41:28 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8522MB free_disk=24.976036071777344GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance b2c27e15-6791-4d75-8df0-957c10d7ca42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:41:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:41:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "31463852-d5bb-4840-aa04-3bc48f95e03a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:41:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:41:40 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:41:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:41:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:41:40 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:41:40 user nova-compute[75571]: INFO nova.compute.claims [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Claim successful on node user
Nov 28 20:41:41 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:41:41 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:41:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG nova.policy [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a9546b6c4e84a5890b690340c414506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d61798b224867b31a4c78fcc33d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:41:41 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Creating image(s)
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "/opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "/opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "/opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk 1073741824" returned: 0 in 0.068s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Successfully created port: 8a1dec1a-8918-4a7d-b090-5716c5b433e5 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.196s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:41:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Cannot resize image /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Ensure instance console log exists: /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Successfully updated port: 8a1dec1a-8918-4a7d-b090-5716c5b433e5 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-3b8e0c46-d727-405f-9247-1aa8ddcaccd8 req-39724dc0-b733-499c-8e94-77adc2263e55 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Received event network-changed-8a1dec1a-8918-4a7d-b090-5716c5b433e5 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-3b8e0c46-d727-405f-9247-1aa8ddcaccd8 req-39724dc0-b733-499c-8e94-77adc2263e55 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Refreshing instance network info cache due to event network-changed-8a1dec1a-8918-4a7d-b090-5716c5b433e5. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3b8e0c46-d727-405f-9247-1aa8ddcaccd8 req-39724dc0-b733-499c-8e94-77adc2263e55 service nova] Acquiring lock "refresh_cache-31463852-d5bb-4840-aa04-3bc48f95e03a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3b8e0c46-d727-405f-9247-1aa8ddcaccd8 req-39724dc0-b733-499c-8e94-77adc2263e55 service nova] Acquired lock "refresh_cache-31463852-d5bb-4840-aa04-3bc48f95e03a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG nova.network.neutron [req-3b8e0c46-d727-405f-9247-1aa8ddcaccd8 req-39724dc0-b733-499c-8e94-77adc2263e55 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Refreshing network info cache for port 8a1dec1a-8918-4a7d-b090-5716c5b433e5 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG nova.network.neutron [req-3b8e0c46-d727-405f-9247-1aa8ddcaccd8 req-39724dc0-b733-499c-8e94-77adc2263e55 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "refresh_cache-31463852-d5bb-4840-aa04-3bc48f95e03a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG nova.network.neutron [req-3b8e0c46-d727-405f-9247-1aa8ddcaccd8 req-39724dc0-b733-499c-8e94-77adc2263e55 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3b8e0c46-d727-405f-9247-1aa8ddcaccd8 req-39724dc0-b733-499c-8e94-77adc2263e55 service nova] Releasing lock "refresh_cache-31463852-d5bb-4840-aa04-3bc48f95e03a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquired lock "refresh_cache-31463852-d5bb-4840-aa04-3bc48f95e03a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:41:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Updating instance_info_cache with network_info: [{"id": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "address": "fa:16:3e:be:0e:26", "network": {"id": "4e671b0b-2ab3-4d0a-aa29-33b492f38b43", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1165036513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d61798b224867b31a4c78fcc33d83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1dec1a-89", "ovs_interfaceid": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Releasing lock "refresh_cache-31463852-d5bb-4840-aa04-3bc48f95e03a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Instance network_info: |[{"id": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "address": "fa:16:3e:be:0e:26", "network": {"id": "4e671b0b-2ab3-4d0a-aa29-33b492f38b43", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1165036513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d61798b224867b31a4c78fcc33d83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1dec1a-89", "ovs_interfaceid": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Start _get_guest_xml network_info=[{"id": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "address": "fa:16:3e:be:0e:26", "network": {"id": "4e671b0b-2ab3-4d0a-aa29-33b492f38b43", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1165036513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d61798b224867b31a4c78fcc33d83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1dec1a-89", "ovs_interfaceid": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:41:43 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:41:43 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-325300438',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-325300438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3253004',id=42,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNW2Ol1IiPRGYOvr8k5pIvcbfcrOd7C7P2kNo49zDE60g5fhSRy+NlgnDBmQy85DvdPH/mTRWv2S80dFNjCrhw/dFimPWoqVAZVWu2Jd6crzaEjPsqKrUPbxEHhDG802A==',key_name='tempest-keypair-232633400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335d61798b224867b31a4c78fcc33d83',ramdisk_id='',reservation_id='r-l3fa36ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2043532910',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:41:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a9546b6c4e84a5890b690340c414506',uuid=31463852-d5bb-4840-aa04-3bc48f95e03a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "address": "fa:16:3e:be:0e:26", "network": {"id": "4e671b0b-2ab3-4d0a-aa29-33b492f38b43", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1165036513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d61798b224867b31a4c78fcc33d83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1dec1a-89", "ovs_interfaceid": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Converting VIF {"id": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "address": "fa:16:3e:be:0e:26", "network": {"id": "4e671b0b-2ab3-4d0a-aa29-33b492f38b43", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1165036513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d61798b224867b31a4c78fcc33d83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1dec1a-89", "ovs_interfaceid": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0e:26,bridge_name='br-int',has_traffic_filtering=True,id=8a1dec1a-8918-4a7d-b090-5716c5b433e5,network=Network(4e671b0b-2ab3-4d0a-aa29-33b492f38b43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1dec1a-89') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.objects.instance [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lazy-loading 'pci_devices' on Instance uuid 31463852-d5bb-4840-aa04-3bc48f95e03a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:41:43 user nova-compute[75571]:   <uuid>31463852-d5bb-4840-aa04-3bc48f95e03a</uuid>
Nov 28 20:41:43 user nova-compute[75571]:   <name>instance-0000002a</name>
Nov 28 20:41:43 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:41:43 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:41:43 user nova-compute[75571]:   <metadata>
Nov 28 20:41:43 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:41:43 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:41:43 user nova-compute[75571]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-325300438</nova:name>
Nov 28 20:41:43 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:41:43</nova:creationTime>
Nov 28 20:41:43 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:41:43 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:41:43 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:41:43 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:41:43 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:41:43 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:41:43 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:41:43 user nova-compute[75571]:       <nova:owner>
Nov 28 20:41:43 user nova-compute[75571]:         <nova:user uuid="5a9546b6c4e84a5890b690340c414506">tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member</nova:user>
Nov 28 20:41:43 user nova-compute[75571]:         <nova:project uuid="335d61798b224867b31a4c78fcc33d83">tempest-TestServerVolumeAttachScenarioOldVersion-2043532910</nova:project>
Nov 28 20:41:43 user nova-compute[75571]:       </nova:owner>
Nov 28 20:41:43 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:41:43 user nova-compute[75571]:       <nova:ports>
Nov 28 20:41:43 user nova-compute[75571]:         <nova:port uuid="8a1dec1a-8918-4a7d-b090-5716c5b433e5">
Nov 28 20:41:43 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 20:41:43 user nova-compute[75571]:         </nova:port>
Nov 28 20:41:43 user nova-compute[75571]:       </nova:ports>
Nov 28 20:41:43 user nova-compute[75571]:     </nova:instance>
Nov 28 20:41:43 user nova-compute[75571]:   </metadata>
Nov 28 20:41:43 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:41:43 user nova-compute[75571]:     <system>
Nov 28 20:41:43 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:41:43 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:41:43 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:41:43 user nova-compute[75571]:       <entry name="serial">31463852-d5bb-4840-aa04-3bc48f95e03a</entry>
Nov 28 20:41:43 user nova-compute[75571]:       <entry name="uuid">31463852-d5bb-4840-aa04-3bc48f95e03a</entry>
Nov 28 20:41:43 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:41:43 user nova-compute[75571]:     </system>
Nov 28 20:41:43 user nova-compute[75571]:   </sysinfo>
Nov 28 20:41:43 user nova-compute[75571]:   <os>
Nov 28 20:41:43 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:41:43 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:41:43 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:41:43 user nova-compute[75571]:   </os>
Nov 28 20:41:43 user nova-compute[75571]:   <features>
Nov 28 20:41:43 user nova-compute[75571]:     <acpi/>
Nov 28 20:41:43 user nova-compute[75571]:     <apic/>
Nov 28 20:41:43 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:41:43 user nova-compute[75571]:   </features>
Nov 28 20:41:43 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:41:43 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:41:43 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:41:43 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:41:43 user nova-compute[75571]:   </clock>
Nov 28 20:41:43 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:41:43 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:41:43 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:41:43 user nova-compute[75571]:   </cpu>
Nov 28 20:41:43 user nova-compute[75571]:   <devices>
Nov 28 20:41:43 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:41:43 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:41:43 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk"/>
Nov 28 20:41:43 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:41:43 user nova-compute[75571]:     </disk>
Nov 28 20:41:43 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:41:43 user nova-compute[75571]:       <mac address="fa:16:3e:be:0e:26"/>
Nov 28 20:41:43 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:41:43 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:41:43 user nova-compute[75571]:       <target dev="tap8a1dec1a-89"/>
Nov 28 20:41:43 user nova-compute[75571]:     </interface>
Nov 28 20:41:43 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:41:43 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/console.log" append="off"/>
Nov 28 20:41:43 user nova-compute[75571]:     </serial>
Nov 28 20:41:43 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:41:43 user nova-compute[75571]:     <video>
Nov 28 20:41:43 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:41:43 user nova-compute[75571]:     </video>
Nov 28 20:41:43 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:41:43 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:41:43 user nova-compute[75571]:     </rng>
Nov 28 20:41:43 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:41:43 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:41:43 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:41:43 user nova-compute[75571]:     </memballoon>
Nov 28 20:41:43 user nova-compute[75571]:   </devices>
Nov 28 20:41:43 user nova-compute[75571]: </domain>
Nov 28 20:41:43 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-325300438',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-325300438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3253004',id=42,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNW2Ol1IiPRGYOvr8k5pIvcbfcrOd7C7P2kNo49zDE60g5fhSRy+NlgnDBmQy85DvdPH/mTRWv2S80dFNjCrhw/dFimPWoqVAZVWu2Jd6crzaEjPsqKrUPbxEHhDG802A==',key_name='tempest-keypair-232633400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335d61798b224867b31a4c78fcc33d83',ramdisk_id='',reservation_id='r-l3fa36ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2043532910',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:41:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a9546b6c4e84a5890b690340c414506',uuid=31463852-d5bb-4840-aa04-3bc48f95e03a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "address": "fa:16:3e:be:0e:26", "network": {"id": "4e671b0b-2ab3-4d0a-aa29-33b492f38b43", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1165036513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d61798b224867b31a4c78fcc33d83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1dec1a-89", "ovs_interfaceid": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Converting VIF {"id": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "address": "fa:16:3e:be:0e:26", "network": {"id": "4e671b0b-2ab3-4d0a-aa29-33b492f38b43", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1165036513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d61798b224867b31a4c78fcc33d83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1dec1a-89", "ovs_interfaceid": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0e:26,bridge_name='br-int',has_traffic_filtering=True,id=8a1dec1a-8918-4a7d-b090-5716c5b433e5,network=Network(4e671b0b-2ab3-4d0a-aa29-33b492f38b43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1dec1a-89') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG os_vif [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0e:26,bridge_name='br-int',has_traffic_filtering=True,id=8a1dec1a-8918-4a7d-b090-5716c5b433e5,network=Network(4e671b0b-2ab3-4d0a-aa29-33b492f38b43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1dec1a-89') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9abfb1c4-986c-5585-9fd5-e1a5cf2851cf', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a1dec1a-89, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a1dec1a-89, col_values=(('qos', UUID('79181ae7-9b01-416d-911b-972901e9fed4')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a1dec1a-89, col_values=(('external_ids', {'iface-id': '8a1dec1a-8918-4a7d-b090-5716c5b433e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:0e:26', 'vm-uuid': '31463852-d5bb-4840-aa04-3bc48f95e03a'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:43 user nova-compute[75571]: INFO os_vif [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0e:26,bridge_name='br-int',has_traffic_filtering=True,id=8a1dec1a-8918-4a7d-b090-5716c5b433e5,network=Network(4e671b0b-2ab3-4d0a-aa29-33b492f38b43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1dec1a-89')
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:41:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] No VIF found with MAC fa:16:3e:be:0e:26, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:41:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:44 user nova-compute[75571]: DEBUG nova.compute.manager [req-ede5c425-c1e9-4613-95f2-0f697c2664ff req-4aa5a972-637b-4338-952e-6dd61a3d1838 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Received event network-vif-plugged-8a1dec1a-8918-4a7d-b090-5716c5b433e5 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:41:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ede5c425-c1e9-4613-95f2-0f697c2664ff req-4aa5a972-637b-4338-952e-6dd61a3d1838 service nova] Acquiring lock "31463852-d5bb-4840-aa04-3bc48f95e03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:41:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ede5c425-c1e9-4613-95f2-0f697c2664ff req-4aa5a972-637b-4338-952e-6dd61a3d1838 service nova] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:41:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ede5c425-c1e9-4613-95f2-0f697c2664ff req-4aa5a972-637b-4338-952e-6dd61a3d1838 service nova] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:41:44 user nova-compute[75571]: DEBUG nova.compute.manager [req-ede5c425-c1e9-4613-95f2-0f697c2664ff req-4aa5a972-637b-4338-952e-6dd61a3d1838 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] No waiting events found dispatching network-vif-plugged-8a1dec1a-8918-4a7d-b090-5716c5b433e5 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:41:44 user nova-compute[75571]: WARNING nova.compute.manager [req-ede5c425-c1e9-4613-95f2-0f697c2664ff req-4aa5a972-637b-4338-952e-6dd61a3d1838 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Received unexpected event network-vif-plugged-8a1dec1a-8918-4a7d-b090-5716c5b433e5 for instance with vm_state building and task_state spawning.
Nov 28 20:41:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:41:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:41:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-847f8786-e67b-4e01-84cc-f6ff5d8716ca req-71c6cbd1-1ffc-4112-a1be-9df354986d3b service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Received event network-vif-plugged-8a1dec1a-8918-4a7d-b090-5716c5b433e5 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:41:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-847f8786-e67b-4e01-84cc-f6ff5d8716ca req-71c6cbd1-1ffc-4112-a1be-9df354986d3b service nova] Acquiring lock "31463852-d5bb-4840-aa04-3bc48f95e03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:41:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-847f8786-e67b-4e01-84cc-f6ff5d8716ca req-71c6cbd1-1ffc-4112-a1be-9df354986d3b service nova] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:41:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-847f8786-e67b-4e01-84cc-f6ff5d8716ca req-71c6cbd1-1ffc-4112-a1be-9df354986d3b service nova] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:41:46 user nova-compute[75571]: DEBUG nova.compute.manager [req-847f8786-e67b-4e01-84cc-f6ff5d8716ca req-71c6cbd1-1ffc-4112-a1be-9df354986d3b service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] No waiting events found dispatching network-vif-plugged-8a1dec1a-8918-4a7d-b090-5716c5b433e5 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:41:46 user nova-compute[75571]: WARNING nova.compute.manager [req-847f8786-e67b-4e01-84cc-f6ff5d8716ca req-71c6cbd1-1ffc-4112-a1be-9df354986d3b service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Received unexpected event network-vif-plugged-8a1dec1a-8918-4a7d-b090-5716c5b433e5 for instance with vm_state building and task_state spawning.
Nov 28 20:41:46 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Instance spawned successfully.
Nov 28 20:41:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:41:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:41:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:41:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:41:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:41:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:41:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:41:46 user nova-compute[75571]: INFO nova.compute.manager [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 28 20:41:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:41:46 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:41:47 user nova-compute[75571]: INFO nova.compute.manager [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Took 6.27 seconds to build instance.
Nov 28 20:41:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.375s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:41:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:41:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:15 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:42:18 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:42:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:21 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:42:21 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:42:22 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:42:22 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:42:22 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:42:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:42:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:42:22 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:42:22 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 29443f30-6d05-4148-9185-a31f78b4a68f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:42:22 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Updating instance_info_cache with network_info: [{"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:42:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:42:22 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:42:22 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:42:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:42:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:42:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:42:26 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:42:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:42:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:42:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:42:26 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:42:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:42:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:42:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:42:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:42:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:42:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:42:26 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:42:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:42:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:42:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:42:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:42:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:42:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:42:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:42:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:42:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:42:27 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:42:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:42:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:42:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:42:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:42:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:42:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:42:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:42:28 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:42:28 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:42:28 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:42:28 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8529MB free_disk=24.93570327758789GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:42:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:42:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance b2c27e15-6791-4d75-8df0-957c10d7ca42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 31463852-d5bb-4840-aa04-3bc48f95e03a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing inventories for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating ProviderTree inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing aggregate associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, aggregates: None {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing trait associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 20:42:29 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] There are 0 instances to clean {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 20:42:30 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:42:30 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:42:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75571) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 20:42:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:42 user nova-compute[75571]: INFO nova.compute.manager [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Unrescuing
Nov 28 20:42:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquired lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "b2c27e15-6791-4d75-8df0-957c10d7ca42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:42:42 user nova-compute[75571]: INFO nova.compute.manager [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Terminating instance
Nov 28 20:42:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-6cf6d149-8c24-4b38-8d48-ae07ccb1d91b req-d77824a4-e162-4459-bf34-9780ad154007 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received event network-vif-unplugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6cf6d149-8c24-4b38-8d48-ae07ccb1d91b req-d77824a4-e162-4459-bf34-9780ad154007 service nova] Acquiring lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6cf6d149-8c24-4b38-8d48-ae07ccb1d91b req-d77824a4-e162-4459-bf34-9780ad154007 service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6cf6d149-8c24-4b38-8d48-ae07ccb1d91b req-d77824a4-e162-4459-bf34-9780ad154007 service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-6cf6d149-8c24-4b38-8d48-ae07ccb1d91b req-d77824a4-e162-4459-bf34-9780ad154007 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] No waiting events found dispatching network-vif-unplugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:42:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-6cf6d149-8c24-4b38-8d48-ae07ccb1d91b req-d77824a4-e162-4459-bf34-9780ad154007 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received event network-vif-unplugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:43 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Instance destroyed successfully.
Nov 28 20:42:43 user nova-compute[75571]: DEBUG nova.objects.instance [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'resources' on Instance uuid b2c27e15-6791-4d75-8df0-957c10d7ca42 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T20:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1654201794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1654201794',id=38,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf7rbfGmkbg9QNV+1Z0B5neiR0PzgqzwGOYvM5FfRWYx4MTDS+q5fQSTS7YZMLSQKaPn3qR8rnvfsfmD+tnK7T3zFPx8mNCJ/Lwe8ouSkwiQJ7T9kBYNHl5Hsq+Bpyrbw==',key_name='tempest-keypair-144574904',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:41:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='292cfffce13446c8963785adfb4b9d22',ramdisk_id='',reservation_id='r-f7h5ryu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1442792072',owner_user_name='tempest-AttachVolumeShelveTestJSON-1442792072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e21afd3261f4b1a87f7cbb4348fc9fe',uuid=b2c27e15-6791-4d75-8df0-957c10d7ca42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converting VIF {"id": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "address": "fa:16:3e:34:54:0f", "network": {"id": "5889ef34-4490-429e-b51e-1d7d050c1ee7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1621257908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292cfffce13446c8963785adfb4b9d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc13ffb2-0c", "ovs_interfaceid": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:54:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc13ffb2-0ccf-4e86-8502-bea728a1e20f,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc13ffb2-0c') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG os_vif [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:54:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc13ffb2-0ccf-4e86-8502-bea728a1e20f,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc13ffb2-0c') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc13ffb2-0c, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61989870-d1b3-49aa-88fc-672c8b1a0c2d) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:42:43 user nova-compute[75571]: INFO os_vif [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:54:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc13ffb2-0ccf-4e86-8502-bea728a1e20f,network=Network(5889ef34-4490-429e-b51e-1d7d050c1ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc13ffb2-0c')
Nov 28 20:42:43 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Deleting instance files /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42_del
Nov 28 20:42:43 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Deletion of /opt/stack/data/nova/instances/b2c27e15-6791-4d75-8df0-957c10d7ca42_del complete
Nov 28 20:42:43 user nova-compute[75571]: INFO nova.compute.manager [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 20:42:43 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updating instance_info_cache with network_info: [{"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Releasing lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'flavor' on Instance uuid f23739ef-322e-4a8f-9df3-2a06e42b6a35 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-fa03833c-19d1-4341-a91b-294e7a9ecdaa req-bb2bfcf8-97a3-4b43-91eb-a7d234cbb64b service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-vif-unplugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fa03833c-19d1-4341-a91b-294e7a9ecdaa req-bb2bfcf8-97a3-4b43-91eb-a7d234cbb64b service nova] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fa03833c-19d1-4341-a91b-294e7a9ecdaa req-bb2bfcf8-97a3-4b43-91eb-a7d234cbb64b service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fa03833c-19d1-4341-a91b-294e7a9ecdaa req-bb2bfcf8-97a3-4b43-91eb-a7d234cbb64b service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG nova.compute.manager [req-fa03833c-19d1-4341-a91b-294e7a9ecdaa req-bb2bfcf8-97a3-4b43-91eb-a7d234cbb64b service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] No waiting events found dispatching network-vif-unplugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:42:43 user nova-compute[75571]: WARNING nova.compute.manager [req-fa03833c-19d1-4341-a91b-294e7a9ecdaa req-bb2bfcf8-97a3-4b43-91eb-a7d234cbb64b service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received unexpected event network-vif-unplugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:42:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:42:44 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Instance destroyed successfully.
Nov 28 20:42:44 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:42:44 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Took 0.79 seconds to deallocate network for instance.
Nov 28 20:42:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:42:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:42:44 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:42:44 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:42:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:42:44 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Deleted allocations for instance b2c27e15-6791-4d75-8df0-957c10d7ca42
Nov 28 20:42:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.114s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-4f7a319b-4ee3-40e4-a865-5b5988dd4254 req-e3533dc9-3cc6-47d0-8db6-002d128f6c74 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received event network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4f7a319b-4ee3-40e4-a865-5b5988dd4254 req-e3533dc9-3cc6-47d0-8db6-002d128f6c74 service nova] Acquiring lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4f7a319b-4ee3-40e4-a865-5b5988dd4254 req-e3533dc9-3cc6-47d0-8db6-002d128f6c74 service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4f7a319b-4ee3-40e4-a865-5b5988dd4254 req-e3533dc9-3cc6-47d0-8db6-002d128f6c74 service nova] Lock "b2c27e15-6791-4d75-8df0-957c10d7ca42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-4f7a319b-4ee3-40e4-a865-5b5988dd4254 req-e3533dc9-3cc6-47d0-8db6-002d128f6c74 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] No waiting events found dispatching network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:42:45 user nova-compute[75571]: WARNING nova.compute.manager [req-4f7a319b-4ee3-40e4-a865-5b5988dd4254 req-e3533dc9-3cc6-47d0-8db6-002d128f6c74 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received unexpected event network-vif-plugged-bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance with vm_state deleted and task_state None.
Nov 28 20:42:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-4f7a319b-4ee3-40e4-a865-5b5988dd4254 req-e3533dc9-3cc6-47d0-8db6-002d128f6c74 service nova] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Received event network-vif-deleted-bc13ffb2-0ccf-4e86-8502-bea728a1e20f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] No waiting events found dispatching network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:42:45 user nova-compute[75571]: WARNING nova.compute.manager [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received unexpected event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:42:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] No waiting events found dispatching network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:42:45 user nova-compute[75571]: WARNING nova.compute.manager [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received unexpected event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:42:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:42:45 user nova-compute[75571]: DEBUG nova.compute.manager [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] No waiting events found dispatching network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:42:45 user nova-compute[75571]: WARNING nova.compute.manager [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received unexpected event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance with vm_state rescued and task_state unrescuing.
Nov 28 20:42:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:42:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:42:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:16 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:43:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:19 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Updating instance_info_cache with network_info: [{"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-def2369e-4d57-482b-aef9-dab7c3a7cb84" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:43:23 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:43:25 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:43:28 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:43:28 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:43:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:43:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:43:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:43:28 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:43:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:30 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:43:30 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:43:30 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:43:30 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8633MB free_disk=24.96094512939453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:43:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:43:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:43:30 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:43:30 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:43:30 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:43:30 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 31463852-d5bb-4840-aa04-3bc48f95e03a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:43:30 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:43:30 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:43:30 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:43:30 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:43:30 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:43:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:43:31 user nova-compute[75571]: DEBUG nova.compute.manager [req-3621f422-0a80-463d-b0c0-d4bcf151d4e0 req-9107e70b-8cad-4e2c-a20d-dff23ce4e628 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Received event network-changed-8a1dec1a-8918-4a7d-b090-5716c5b433e5 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:43:31 user nova-compute[75571]: DEBUG nova.compute.manager [req-3621f422-0a80-463d-b0c0-d4bcf151d4e0 req-9107e70b-8cad-4e2c-a20d-dff23ce4e628 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Refreshing instance network info cache due to event network-changed-8a1dec1a-8918-4a7d-b090-5716c5b433e5. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:43:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3621f422-0a80-463d-b0c0-d4bcf151d4e0 req-9107e70b-8cad-4e2c-a20d-dff23ce4e628 service nova] Acquiring lock "refresh_cache-31463852-d5bb-4840-aa04-3bc48f95e03a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:43:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3621f422-0a80-463d-b0c0-d4bcf151d4e0 req-9107e70b-8cad-4e2c-a20d-dff23ce4e628 service nova] Acquired lock "refresh_cache-31463852-d5bb-4840-aa04-3bc48f95e03a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:43:31 user nova-compute[75571]: DEBUG nova.network.neutron [req-3621f422-0a80-463d-b0c0-d4bcf151d4e0 req-9107e70b-8cad-4e2c-a20d-dff23ce4e628 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Refreshing network info cache for port 8a1dec1a-8918-4a7d-b090-5716c5b433e5 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:43:32 user nova-compute[75571]: DEBUG nova.network.neutron [req-3621f422-0a80-463d-b0c0-d4bcf151d4e0 req-9107e70b-8cad-4e2c-a20d-dff23ce4e628 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Updated VIF entry in instance network info cache for port 8a1dec1a-8918-4a7d-b090-5716c5b433e5. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:43:32 user nova-compute[75571]: DEBUG nova.network.neutron [req-3621f422-0a80-463d-b0c0-d4bcf151d4e0 req-9107e70b-8cad-4e2c-a20d-dff23ce4e628 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Updating instance_info_cache with network_info: [{"id": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "address": "fa:16:3e:be:0e:26", "network": {"id": "4e671b0b-2ab3-4d0a-aa29-33b492f38b43", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1165036513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d61798b224867b31a4c78fcc33d83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1dec1a-89", "ovs_interfaceid": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:43:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3621f422-0a80-463d-b0c0-d4bcf151d4e0 req-9107e70b-8cad-4e2c-a20d-dff23ce4e628 service nova] Releasing lock "refresh_cache-31463852-d5bb-4840-aa04-3bc48f95e03a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:43:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:43:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "31463852-d5bb-4840-aa04-3bc48f95e03a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:43:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:43:35 user nova-compute[75571]: DEBUG nova.objects.instance [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lazy-loading 'flavor' on Instance uuid 31463852-d5bb-4840-aa04-3bc48f95e03a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:43:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "31463852-d5bb-4840-aa04-3bc48f95e03a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:43:36 user nova-compute[75571]: INFO nova.compute.manager [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Attaching volume cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 to /dev/vdb
Nov 28 20:43:36 user nova-compute[75571]: DEBUG os_brick.utils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[686dd089-419e-4194-83e9-9b76c6a4b8f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[464835bd-553f-4bcb-b478-b91ef58acf87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[43812c6a-baa4-450c-b561-3091547cb7b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9690b0de-120c-4802-aa31-628cf342b925]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:43:36 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:43:36 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a12932-e939-4158-abaa-1bf175575b75]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG os_brick.utils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:43:36 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Updating existing volume attachment record: 4ccfd1dc-4cb8-4f24-8403-c3ec6ad7a3bc {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:43:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcWlbjwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:43:43 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:43:43 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:43:43 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c408e9a-bdae-48c7-9729-c963f455fdac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:43:43 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5990244-d3fa-4693-bc26-99952ced2886]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8] added
Nov 28 20:43:43 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[675fe153-8f44-4c92-b62f-fe94b898fd2e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd9d1b5-108c-4e5c-b6f3-f7daa77b9ab0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XcWlbjwa {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XcWlbjwa" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[94791324-664e-4a3b-b1dd-51330dea4308]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XcWlbjwa'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f00fa2-f320-4da2-8cfc-2f0329717f5f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f27292e-dd35-4be3-8117-f13c5dda7876]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 (non-flash)
Nov 28 20:43:43 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 (non-flash)
Nov 28 20:43:43 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[744c19ab-d716-4b47-8098-921c95842e0a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8, portal: 172.16.0.220,3260]
Nov 28 20:43:43 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8, portal: 172.16.0.220,3260] successful.
Nov 28 20:43:43 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[992e657e-d987-4455-88c5-4f8110c5c849]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[295546b6-9ca2-49f0-8131-aee35ceeb392]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 (non-flash)
Nov 28 20:43:43 user nova-compute[75571]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 (non-flash)
Nov 28 20:43:43 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 (non-flash)
Nov 28 20:43:43 user nova-compute[75571]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 (non-flash)
Nov 28 20:43:43 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b046c5-bf94-4f8c-b0fb-ad54d3afcd21]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:43:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:44 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:43:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcWlbjwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:43:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:43:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23665323434333432', 'path': '/dev/sdc'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:43:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665323434333432', 'path': '/dev/sdc'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:43:44 user nova-compute[75571]: DEBUG nova.objects.instance [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lazy-loading 'flavor' on Instance uuid 31463852-d5bb-4840-aa04-3bc48f95e03a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:43:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:43:44 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:43:44 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:43:44 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:43:44 user nova-compute[75571]:   <serial>cf5d52ce-bbdd-42d3-b468-464c38dc7ab8</serial>
Nov 28 20:43:44 user nova-compute[75571]: </disk>
Nov 28 20:43:44 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:43:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:43:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:43:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] No VIF found with MAC fa:16:3e:be:0e:26, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:43:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.981s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:43:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "31463852-d5bb-4840-aa04-3bc48f95e03a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:43:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:43:46 user nova-compute[75571]: INFO nova.compute.manager [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Detaching volume cf5d52ce-bbdd-42d3-b468-464c38dc7ab8
Nov 28 20:43:46 user nova-compute[75571]: INFO nova.virt.block_device [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Attempting to driver detach volume cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 from mountpoint /dev/vdb
Nov 28 20:43:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Attempting to detach device vdb from instance 31463852-d5bb-4840-aa04-3bc48f95e03a from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:43:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:43:46 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:43:46 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:43:46 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:43:46 user nova-compute[75571]:   <serial>cf5d52ce-bbdd-42d3-b468-464c38dc7ab8</serial>
Nov 28 20:43:46 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:43:46 user nova-compute[75571]: </disk>
Nov 28 20:43:46 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:43:46 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Successfully detached device vdb from instance 31463852-d5bb-4840-aa04-3bc48f95e03a from the persistent domain config.
Nov 28 20:43:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31463852-d5bb-4840-aa04-3bc48f95e03a from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:43:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:43:46 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:43:46 user nova-compute[75571]:   <source dev="/dev/sdc"/>
Nov 28 20:43:46 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:43:46 user nova-compute[75571]:   <serial>cf5d52ce-bbdd-42d3-b468-464c38dc7ab8</serial>
Nov 28 20:43:46 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:43:46 user nova-compute[75571]: </disk>
Nov 28 20:43:46 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:43:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31463852-d5bb-4840-aa04-3bc48f95e03a {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:43:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:43:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG nova.compute.manager [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:43:52 user nova-compute[75571]: INFO nova.compute.claims [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Claim successful on node user
Nov 28 20:43:52 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG nova.compute.manager [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG nova.compute.manager [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG nova.network.neutron [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:43:52 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:43:52 user nova-compute[75571]: DEBUG nova.compute.manager [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG nova.policy [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG nova.compute.manager [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:43:52 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Creating image(s)
Nov 28 20:43:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "/opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "/opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "/opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:43:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk 1073741824" returned: 0 in 0.051s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG nova.network.neutron [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Successfully created port: 30bb67dc-9127-4518-917c-fa6fd887c49b {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Cannot resize image /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Ensure instance console log exists: /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:43:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.network.neutron [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Successfully updated port: 30bb67dc-9127-4518-917c-fa6fd887c49b {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "refresh_cache-99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquired lock "refresh_cache-99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.network.neutron [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.compute.manager [req-8e740b0b-0484-47a9-b75f-ea482fcf3b4a req-d1dff566-e0b9-4d91-8615-45c557e2da81 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Received event network-changed-30bb67dc-9127-4518-917c-fa6fd887c49b {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.compute.manager [req-8e740b0b-0484-47a9-b75f-ea482fcf3b4a req-d1dff566-e0b9-4d91-8615-45c557e2da81 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Refreshing instance network info cache due to event network-changed-30bb67dc-9127-4518-917c-fa6fd887c49b. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8e740b0b-0484-47a9-b75f-ea482fcf3b4a req-d1dff566-e0b9-4d91-8615-45c557e2da81 service nova] Acquiring lock "refresh_cache-99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.network.neutron [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.network.neutron [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Updating instance_info_cache with network_info: [{"id": "30bb67dc-9127-4518-917c-fa6fd887c49b", "address": "fa:16:3e:13:4c:d6", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb67dc-91", "ovs_interfaceid": "30bb67dc-9127-4518-917c-fa6fd887c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Releasing lock "refresh_cache-99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.compute.manager [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Instance network_info: |[{"id": "30bb67dc-9127-4518-917c-fa6fd887c49b", "address": "fa:16:3e:13:4c:d6", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb67dc-91", "ovs_interfaceid": "30bb67dc-9127-4518-917c-fa6fd887c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8e740b0b-0484-47a9-b75f-ea482fcf3b4a req-d1dff566-e0b9-4d91-8615-45c557e2da81 service nova] Acquired lock "refresh_cache-99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.network.neutron [req-8e740b0b-0484-47a9-b75f-ea482fcf3b4a req-d1dff566-e0b9-4d91-8615-45c557e2da81 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Refreshing network info cache for port 30bb67dc-9127-4518-917c-fa6fd887c49b {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Start _get_guest_xml network_info=[{"id": "30bb67dc-9127-4518-917c-fa6fd887c49b", "address": "fa:16:3e:13:4c:d6", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb67dc-91", "ovs_interfaceid": "30bb67dc-9127-4518-917c-fa6fd887c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:43:54 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:43:54 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1667927386',display_name='tempest-AttachVolumeNegativeTest-server-1667927386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1667927386',id=43,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/46ePml504hPEHQqQwlHayTrpifeFxrkouprNVaZfmM9bJRT8L0UdcDEGRU5k63AL7fQj7CVe1Xm846FrrhiuRF0lBW8FhtlmCqASIwliEtIjLrn1+aKhzX1DPEraxhg==',key_name='tempest-keypair-2067019178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c30c6dea8b148f08d7e5e84757c5e64',ramdisk_id='',reservation_id='r-i8h0b7zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-959194587',owner_user_name='tempest-AttachVolumeNegativeTest-959194587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='409bfc19d682425ea17eda9b336750b4',uuid=99d47cb6-b685-4b05-a93b-7c9efdd3e4bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30bb67dc-9127-4518-917c-fa6fd887c49b", "address": "fa:16:3e:13:4c:d6", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb67dc-91", "ovs_interfaceid": "30bb67dc-9127-4518-917c-fa6fd887c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converting VIF {"id": "30bb67dc-9127-4518-917c-fa6fd887c49b", "address": "fa:16:3e:13:4c:d6", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb67dc-91", "ovs_interfaceid": "30bb67dc-9127-4518-917c-fa6fd887c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:d6,bridge_name='br-int',has_traffic_filtering=True,id=30bb67dc-9127-4518-917c-fa6fd887c49b,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bb67dc-91') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.objects.instance [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'pci_devices' on Instance uuid 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:43:54 user nova-compute[75571]:   <uuid>99d47cb6-b685-4b05-a93b-7c9efdd3e4bd</uuid>
Nov 28 20:43:54 user nova-compute[75571]:   <name>instance-0000002b</name>
Nov 28 20:43:54 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:43:54 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:43:54 user nova-compute[75571]:   <metadata>
Nov 28 20:43:54 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:43:54 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:43:54 user nova-compute[75571]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1667927386</nova:name>
Nov 28 20:43:54 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:43:54</nova:creationTime>
Nov 28 20:43:54 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:43:54 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:43:54 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:43:54 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:43:54 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:43:54 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:43:54 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:43:54 user nova-compute[75571]:       <nova:owner>
Nov 28 20:43:54 user nova-compute[75571]:         <nova:user uuid="409bfc19d682425ea17eda9b336750b4">tempest-AttachVolumeNegativeTest-959194587-project-member</nova:user>
Nov 28 20:43:54 user nova-compute[75571]:         <nova:project uuid="9c30c6dea8b148f08d7e5e84757c5e64">tempest-AttachVolumeNegativeTest-959194587</nova:project>
Nov 28 20:43:54 user nova-compute[75571]:       </nova:owner>
Nov 28 20:43:54 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:43:54 user nova-compute[75571]:       <nova:ports>
Nov 28 20:43:54 user nova-compute[75571]:         <nova:port uuid="30bb67dc-9127-4518-917c-fa6fd887c49b">
Nov 28 20:43:54 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:43:54 user nova-compute[75571]:         </nova:port>
Nov 28 20:43:54 user nova-compute[75571]:       </nova:ports>
Nov 28 20:43:54 user nova-compute[75571]:     </nova:instance>
Nov 28 20:43:54 user nova-compute[75571]:   </metadata>
Nov 28 20:43:54 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:43:54 user nova-compute[75571]:     <system>
Nov 28 20:43:54 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:43:54 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:43:54 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:43:54 user nova-compute[75571]:       <entry name="serial">99d47cb6-b685-4b05-a93b-7c9efdd3e4bd</entry>
Nov 28 20:43:54 user nova-compute[75571]:       <entry name="uuid">99d47cb6-b685-4b05-a93b-7c9efdd3e4bd</entry>
Nov 28 20:43:54 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:43:54 user nova-compute[75571]:     </system>
Nov 28 20:43:54 user nova-compute[75571]:   </sysinfo>
Nov 28 20:43:54 user nova-compute[75571]:   <os>
Nov 28 20:43:54 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:43:54 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:43:54 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:43:54 user nova-compute[75571]:   </os>
Nov 28 20:43:54 user nova-compute[75571]:   <features>
Nov 28 20:43:54 user nova-compute[75571]:     <acpi/>
Nov 28 20:43:54 user nova-compute[75571]:     <apic/>
Nov 28 20:43:54 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:43:54 user nova-compute[75571]:   </features>
Nov 28 20:43:54 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:43:54 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:43:54 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:43:54 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:43:54 user nova-compute[75571]:   </clock>
Nov 28 20:43:54 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:43:54 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:43:54 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:43:54 user nova-compute[75571]:   </cpu>
Nov 28 20:43:54 user nova-compute[75571]:   <devices>
Nov 28 20:43:54 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:43:54 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:43:54 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk"/>
Nov 28 20:43:54 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:43:54 user nova-compute[75571]:     </disk>
Nov 28 20:43:54 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:43:54 user nova-compute[75571]:       <mac address="fa:16:3e:13:4c:d6"/>
Nov 28 20:43:54 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:43:54 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:43:54 user nova-compute[75571]:       <target dev="tap30bb67dc-91"/>
Nov 28 20:43:54 user nova-compute[75571]:     </interface>
Nov 28 20:43:54 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:43:54 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/console.log" append="off"/>
Nov 28 20:43:54 user nova-compute[75571]:     </serial>
Nov 28 20:43:54 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:43:54 user nova-compute[75571]:     <video>
Nov 28 20:43:54 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:43:54 user nova-compute[75571]:     </video>
Nov 28 20:43:54 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:43:54 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:43:54 user nova-compute[75571]:     </rng>
Nov 28 20:43:54 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:43:54 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:43:54 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:43:54 user nova-compute[75571]:     </memballoon>
Nov 28 20:43:54 user nova-compute[75571]:   </devices>
Nov 28 20:43:54 user nova-compute[75571]: </domain>
Nov 28 20:43:54 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1667927386',display_name='tempest-AttachVolumeNegativeTest-server-1667927386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1667927386',id=43,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/46ePml504hPEHQqQwlHayTrpifeFxrkouprNVaZfmM9bJRT8L0UdcDEGRU5k63AL7fQj7CVe1Xm846FrrhiuRF0lBW8FhtlmCqASIwliEtIjLrn1+aKhzX1DPEraxhg==',key_name='tempest-keypair-2067019178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c30c6dea8b148f08d7e5e84757c5e64',ramdisk_id='',reservation_id='r-i8h0b7zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-959194587',owner_user_name='tempest-AttachVolumeNegativeTest-959194587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='409bfc19d682425ea17eda9b336750b4',uuid=99d47cb6-b685-4b05-a93b-7c9efdd3e4bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30bb67dc-9127-4518-917c-fa6fd887c49b", "address": "fa:16:3e:13:4c:d6", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb67dc-91", "ovs_interfaceid": "30bb67dc-9127-4518-917c-fa6fd887c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converting VIF {"id": "30bb67dc-9127-4518-917c-fa6fd887c49b", "address": "fa:16:3e:13:4c:d6", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb67dc-91", "ovs_interfaceid": "30bb67dc-9127-4518-917c-fa6fd887c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:d6,bridge_name='br-int',has_traffic_filtering=True,id=30bb67dc-9127-4518-917c-fa6fd887c49b,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bb67dc-91') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG os_vif [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:d6,bridge_name='br-int',has_traffic_filtering=True,id=30bb67dc-9127-4518-917c-fa6fd887c49b,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bb67dc-91') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '090a73ff-009e-5e32-b2e8-3de32d63fb03', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30bb67dc-91, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30bb67dc-91, col_values=(('qos', UUID('c11deeeb-f80e-480b-8a7b-825f7e0d6ff5')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30bb67dc-91, col_values=(('external_ids', {'iface-id': '30bb67dc-9127-4518-917c-fa6fd887c49b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:4c:d6', 'vm-uuid': '99d47cb6-b685-4b05-a93b-7c9efdd3e4bd'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:54 user nova-compute[75571]: INFO os_vif [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:4c:d6,bridge_name='br-int',has_traffic_filtering=True,id=30bb67dc-9127-4518-917c-fa6fd887c49b,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bb67dc-91')
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No VIF found with MAC fa:16:3e:13:4c:d6, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.network.neutron [req-8e740b0b-0484-47a9-b75f-ea482fcf3b4a req-d1dff566-e0b9-4d91-8615-45c557e2da81 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Updated VIF entry in instance network info cache for port 30bb67dc-9127-4518-917c-fa6fd887c49b. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG nova.network.neutron [req-8e740b0b-0484-47a9-b75f-ea482fcf3b4a req-d1dff566-e0b9-4d91-8615-45c557e2da81 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Updating instance_info_cache with network_info: [{"id": "30bb67dc-9127-4518-917c-fa6fd887c49b", "address": "fa:16:3e:13:4c:d6", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb67dc-91", "ovs_interfaceid": "30bb67dc-9127-4518-917c-fa6fd887c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:43:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-8e740b0b-0484-47a9-b75f-ea482fcf3b4a req-d1dff566-e0b9-4d91-8615-45c557e2da81 service nova] Releasing lock "refresh_cache-99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:43:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:56 user nova-compute[75571]: DEBUG nova.compute.manager [req-7bac6697-42d2-478c-9c15-1c677c5b6e7c req-2875a2cb-902e-440f-b82e-6aeeb4efad8d service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Received event network-vif-plugged-30bb67dc-9127-4518-917c-fa6fd887c49b {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:43:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7bac6697-42d2-478c-9c15-1c677c5b6e7c req-2875a2cb-902e-440f-b82e-6aeeb4efad8d service nova] Acquiring lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:43:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7bac6697-42d2-478c-9c15-1c677c5b6e7c req-2875a2cb-902e-440f-b82e-6aeeb4efad8d service nova] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:43:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-7bac6697-42d2-478c-9c15-1c677c5b6e7c req-2875a2cb-902e-440f-b82e-6aeeb4efad8d service nova] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:43:56 user nova-compute[75571]: DEBUG nova.compute.manager [req-7bac6697-42d2-478c-9c15-1c677c5b6e7c req-2875a2cb-902e-440f-b82e-6aeeb4efad8d service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] No waiting events found dispatching network-vif-plugged-30bb67dc-9127-4518-917c-fa6fd887c49b {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:43:56 user nova-compute[75571]: WARNING nova.compute.manager [req-7bac6697-42d2-478c-9c15-1c677c5b6e7c req-2875a2cb-902e-440f-b82e-6aeeb4efad8d service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Received unexpected event network-vif-plugged-30bb67dc-9127-4518-917c-fa6fd887c49b for instance with vm_state building and task_state spawning.
Nov 28 20:43:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:43:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:43:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:43:57 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Instance spawned successfully.
Nov 28 20:43:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:43:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:43:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:43:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:43:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:43:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:43:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:43:58 user nova-compute[75571]: DEBUG nova.compute.manager [req-26983d46-646d-43fa-b72e-6225aad8ab74 req-bb91811a-e525-4c09-b409-da0be8fa94f8 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Received event network-vif-plugged-30bb67dc-9127-4518-917c-fa6fd887c49b {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:43:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-26983d46-646d-43fa-b72e-6225aad8ab74 req-bb91811a-e525-4c09-b409-da0be8fa94f8 service nova] Acquiring lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:43:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-26983d46-646d-43fa-b72e-6225aad8ab74 req-bb91811a-e525-4c09-b409-da0be8fa94f8 service nova] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:43:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-26983d46-646d-43fa-b72e-6225aad8ab74 req-bb91811a-e525-4c09-b409-da0be8fa94f8 service nova] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:43:58 user nova-compute[75571]: DEBUG nova.compute.manager [req-26983d46-646d-43fa-b72e-6225aad8ab74 req-bb91811a-e525-4c09-b409-da0be8fa94f8 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] No waiting events found dispatching network-vif-plugged-30bb67dc-9127-4518-917c-fa6fd887c49b {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:43:58 user nova-compute[75571]: WARNING nova.compute.manager [req-26983d46-646d-43fa-b72e-6225aad8ab74 req-bb91811a-e525-4c09-b409-da0be8fa94f8 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Received unexpected event network-vif-plugged-30bb67dc-9127-4518-917c-fa6fd887c49b for instance with vm_state building and task_state spawning.
Nov 28 20:43:58 user nova-compute[75571]: INFO nova.compute.manager [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 28 20:43:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:43:58 user nova-compute[75571]: INFO nova.compute.manager [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Took 6.00 seconds to build instance.
Nov 28 20:43:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.094s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:43:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:07 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 31463852-d5bb-4840-aa04-3bc48f95e03a is timed out.
Nov 28 20:44:07 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Successfully detached device vdb from instance 31463852-d5bb-4840-aa04-3bc48f95e03a from the live domain config.
Nov 28 20:44:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcWlbjwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:44:07 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3484466d-d012-42b3-adba-e0d71410317c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:44:07 user nova-compute[75571]: No targets found.
Nov 28 20:44:07 user nova-compute[75571]: iSNS:
Nov 28 20:44:07 user nova-compute[75571]: No targets found.
Nov 28 20:44:07 user nova-compute[75571]: STATIC:
Nov 28 20:44:07 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8
Nov 28 20:44:07 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:44:07 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:44:07 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351
Nov 28 20:44:07 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:44:07 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:44:07 user nova-compute[75571]: FIRMWARE:
Nov 28 20:44:07 user nova-compute[75571]: No targets found.
Nov 28 20:44:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:44:07 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:44:07 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[77508673-f89f-4309-8ebb-0bca9300db23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0849f0ae-7ed2-4156-8900-08ee90136426]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 (non-flash)
Nov 28 20:44:07 user nova-compute[75571]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 (non-flash)
Nov 28 20:44:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 (non-flash)
Nov 28 20:44:07 user nova-compute[75571]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 (non-flash)
Nov 28 20:44:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768713c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8'): ({'sdc'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Removing single pathed devices sdc {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0e0697-3b61-4689-9d9b-59954746bfd5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[173ef722-ddb7-4d8c-9d39-bb504d50efe8]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Flushing IO for device /dev/sdc {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1125ad0-f7ed-4113-8962-13534c6549db]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bca22c9-ea44-4897-a800-a2b917c91015]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a702f4-17b2-459a-8654-10ac1e61dbf0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5f88bf-d1e9-42e6-bd36-99b324ada3c5]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8, portal: 172.16.0.220,3260]
Nov 28 20:44:07 user nova-compute[75571]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8, portal: 172.16.0.220,3260] successful.
Nov 28 20:44:07 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37b7350-2076-4020-8032-4b39cc2d6918]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] <== disconnect_volume: return (273ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:44:07 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:44:08 user nova-compute[75571]: DEBUG nova.objects.instance [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lazy-loading 'flavor' on Instance uuid 31463852-d5bb-4840-aa04-3bc48f95e03a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:44:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.868s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:44:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:18 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:44:19 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:44:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:44:23 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:44:24 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:44:24 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:44:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:25 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:44:25 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:44:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:44:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:44:25 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:44:25 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updating instance_info_cache with network_info: [{"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:44:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:44:25 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:44:25 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:44:29 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:44:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:44:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:44:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:44:29 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:44:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:29 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:31 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:44:31 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:44:31 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:44:31 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8581MB free_disk=24.921955108642578GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:44:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:44:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:44:31 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:44:31 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:44:31 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:44:31 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 31463852-d5bb-4840-aa04-3bc48f95e03a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:44:31 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:44:31 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:44:31 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:44:32 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:44:32 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:44:32 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:44:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:44:33 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:44:34 user nova-compute[75571]: DEBUG nova.compute.manager [req-dc3ccafe-7613-4704-9d05-2fef27060bb5 req-47e344d4-b421-4eeb-bff0-3547b7cd7085 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-changed-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:44:34 user nova-compute[75571]: DEBUG nova.compute.manager [req-dc3ccafe-7613-4704-9d05-2fef27060bb5 req-47e344d4-b421-4eeb-bff0-3547b7cd7085 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Refreshing instance network info cache due to event network-changed-7354a1a8-41e9-4a3c-9d08-fa55997c917a. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:44:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-dc3ccafe-7613-4704-9d05-2fef27060bb5 req-47e344d4-b421-4eeb-bff0-3547b7cd7085 service nova] Acquiring lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:44:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-dc3ccafe-7613-4704-9d05-2fef27060bb5 req-47e344d4-b421-4eeb-bff0-3547b7cd7085 service nova] Acquired lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:44:34 user nova-compute[75571]: DEBUG nova.network.neutron [req-dc3ccafe-7613-4704-9d05-2fef27060bb5 req-47e344d4-b421-4eeb-bff0-3547b7cd7085 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Refreshing network info cache for port 7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:44:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:44:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:44:34 user nova-compute[75571]: INFO nova.compute.manager [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Detaching volume d9d0bf49-e1ad-4031-9ad6-10aade724351
Nov 28 20:44:34 user nova-compute[75571]: DEBUG nova.network.neutron [req-dc3ccafe-7613-4704-9d05-2fef27060bb5 req-47e344d4-b421-4eeb-bff0-3547b7cd7085 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updated VIF entry in instance network info cache for port 7354a1a8-41e9-4a3c-9d08-fa55997c917a. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:44:34 user nova-compute[75571]: DEBUG nova.network.neutron [req-dc3ccafe-7613-4704-9d05-2fef27060bb5 req-47e344d4-b421-4eeb-bff0-3547b7cd7085 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updating instance_info_cache with network_info: [{"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:44:34 user nova-compute[75571]: INFO nova.virt.block_device [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Attempting to driver detach volume d9d0bf49-e1ad-4031-9ad6-10aade724351 from mountpoint /dev/vdb
Nov 28 20:44:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-dc3ccafe-7613-4704-9d05-2fef27060bb5 req-47e344d4-b421-4eeb-bff0-3547b7cd7085 service nova] Releasing lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:44:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Attempting to detach device vdb from instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:44:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:44:34 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:44:34 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:44:34 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:44:34 user nova-compute[75571]:   <serial>d9d0bf49-e1ad-4031-9ad6-10aade724351</serial>
Nov 28 20:44:34 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:44:34 user nova-compute[75571]: </disk>
Nov 28 20:44:34 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:44:34 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Successfully detached device vdb from instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 from the persistent domain config.
Nov 28 20:44:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:44:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:44:34 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:44:34 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:44:34 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:44:34 user nova-compute[75571]:   <serial>d9d0bf49-e1ad-4031-9ad6-10aade724351</serial>
Nov 28 20:44:34 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:44:34 user nova-compute[75571]: </disk>
Nov 28 20:44:34 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:44:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:44:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:44:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:36 user nova-compute[75571]: DEBUG nova.compute.manager [req-14559bda-1e33-44e0-9bb9-85ffe0d7bd0b req-7583995e-c798-44d4-8476-29036f9c1f33 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-changed-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:44:36 user nova-compute[75571]: DEBUG nova.compute.manager [req-14559bda-1e33-44e0-9bb9-85ffe0d7bd0b req-7583995e-c798-44d4-8476-29036f9c1f33 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Refreshing instance network info cache due to event network-changed-7354a1a8-41e9-4a3c-9d08-fa55997c917a. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:44:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-14559bda-1e33-44e0-9bb9-85ffe0d7bd0b req-7583995e-c798-44d4-8476-29036f9c1f33 service nova] Acquiring lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:44:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-14559bda-1e33-44e0-9bb9-85ffe0d7bd0b req-7583995e-c798-44d4-8476-29036f9c1f33 service nova] Acquired lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:44:36 user nova-compute[75571]: DEBUG nova.network.neutron [req-14559bda-1e33-44e0-9bb9-85ffe0d7bd0b req-7583995e-c798-44d4-8476-29036f9c1f33 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Refreshing network info cache for port 7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:44:36 user nova-compute[75571]: DEBUG nova.network.neutron [req-14559bda-1e33-44e0-9bb9-85ffe0d7bd0b req-7583995e-c798-44d4-8476-29036f9c1f33 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updated VIF entry in instance network info cache for port 7354a1a8-41e9-4a3c-9d08-fa55997c917a. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:44:36 user nova-compute[75571]: DEBUG nova.network.neutron [req-14559bda-1e33-44e0-9bb9-85ffe0d7bd0b req-7583995e-c798-44d4-8476-29036f9c1f33 service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updating instance_info_cache with network_info: [{"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:44:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-14559bda-1e33-44e0-9bb9-85ffe0d7bd0b req-7583995e-c798-44d4-8476-29036f9c1f33 service nova] Releasing lock "refresh_cache-f23739ef-322e-4a8f-9df3-2a06e42b6a35" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:44:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "31463852-d5bb-4840-aa04-3bc48f95e03a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "31463852-d5bb-4840-aa04-3bc48f95e03a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:44:40 user nova-compute[75571]: INFO nova.compute.manager [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Terminating instance
Nov 28 20:44:40 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-62a79265-7321-4ac2-864a-cadc143b6d58 req-40d9a7b8-dcc7-4943-8f75-b4fd4d68516a service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Received event network-vif-unplugged-8a1dec1a-8918-4a7d-b090-5716c5b433e5 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-62a79265-7321-4ac2-864a-cadc143b6d58 req-40d9a7b8-dcc7-4943-8f75-b4fd4d68516a service nova] Acquiring lock "31463852-d5bb-4840-aa04-3bc48f95e03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-62a79265-7321-4ac2-864a-cadc143b6d58 req-40d9a7b8-dcc7-4943-8f75-b4fd4d68516a service nova] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-62a79265-7321-4ac2-864a-cadc143b6d58 req-40d9a7b8-dcc7-4943-8f75-b4fd4d68516a service nova] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-62a79265-7321-4ac2-864a-cadc143b6d58 req-40d9a7b8-dcc7-4943-8f75-b4fd4d68516a service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] No waiting events found dispatching network-vif-unplugged-8a1dec1a-8918-4a7d-b090-5716c5b433e5 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG nova.compute.manager [req-62a79265-7321-4ac2-864a-cadc143b6d58 req-40d9a7b8-dcc7-4943-8f75-b4fd4d68516a service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Received event network-vif-unplugged-8a1dec1a-8918-4a7d-b090-5716c5b433e5 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:44:40 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Instance destroyed successfully.
Nov 28 20:44:40 user nova-compute[75571]: DEBUG nova.objects.instance [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lazy-loading 'resources' on Instance uuid 31463852-d5bb-4840-aa04-3bc48f95e03a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-325300438',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-325300438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3253004',id=42,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNW2Ol1IiPRGYOvr8k5pIvcbfcrOd7C7P2kNo49zDE60g5fhSRy+NlgnDBmQy85DvdPH/mTRWv2S80dFNjCrhw/dFimPWoqVAZVWu2Jd6crzaEjPsqKrUPbxEHhDG802A==',key_name='tempest-keypair-232633400',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:41:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='335d61798b224867b31a4c78fcc33d83',ramdisk_id='',reservation_id='r-l3fa36ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2043532910',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:41:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a9546b6c4e84a5890b690340c414506',uuid=31463852-d5bb-4840-aa04-3bc48f95e03a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "address": "fa:16:3e:be:0e:26", "network": {"id": "4e671b0b-2ab3-4d0a-aa29-33b492f38b43", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1165036513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d61798b224867b31a4c78fcc33d83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1dec1a-89", "ovs_interfaceid": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Converting VIF {"id": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "address": "fa:16:3e:be:0e:26", "network": {"id": "4e671b0b-2ab3-4d0a-aa29-33b492f38b43", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1165036513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d61798b224867b31a4c78fcc33d83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a1dec1a-89", "ovs_interfaceid": "8a1dec1a-8918-4a7d-b090-5716c5b433e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:0e:26,bridge_name='br-int',has_traffic_filtering=True,id=8a1dec1a-8918-4a7d-b090-5716c5b433e5,network=Network(4e671b0b-2ab3-4d0a-aa29-33b492f38b43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1dec1a-89') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG os_vif [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:0e:26,bridge_name='br-int',has_traffic_filtering=True,id=8a1dec1a-8918-4a7d-b090-5716c5b433e5,network=Network(4e671b0b-2ab3-4d0a-aa29-33b492f38b43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1dec1a-89') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a1dec1a-89, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79181ae7-9b01-416d-911b-972901e9fed4) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:40 user nova-compute[75571]: INFO os_vif [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:0e:26,bridge_name='br-int',has_traffic_filtering=True,id=8a1dec1a-8918-4a7d-b090-5716c5b433e5,network=Network(4e671b0b-2ab3-4d0a-aa29-33b492f38b43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a1dec1a-89')
Nov 28 20:44:40 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Deleting instance files /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a_del
Nov 28 20:44:40 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Deletion of /opt/stack/data/nova/instances/31463852-d5bb-4840-aa04-3bc48f95e03a_del complete
Nov 28 20:44:41 user nova-compute[75571]: INFO nova.compute.manager [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 20:44:41 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:44:41 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:44:41 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:44:41 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:44:41 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Took 0.65 seconds to deallocate network for instance.
Nov 28 20:44:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:44:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:44:42 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:44:42 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:44:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:44:42 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Deleted allocations for instance 31463852-d5bb-4840-aa04-3bc48f95e03a
Nov 28 20:44:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.096s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:44:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-70575b8a-70f2-45a3-aa45-33535ffd68a3 req-cb9f78c6-1ed2-478d-8c3e-75b1047c65c3 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Received event network-vif-plugged-8a1dec1a-8918-4a7d-b090-5716c5b433e5 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:44:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-70575b8a-70f2-45a3-aa45-33535ffd68a3 req-cb9f78c6-1ed2-478d-8c3e-75b1047c65c3 service nova] Acquiring lock "31463852-d5bb-4840-aa04-3bc48f95e03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:44:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-70575b8a-70f2-45a3-aa45-33535ffd68a3 req-cb9f78c6-1ed2-478d-8c3e-75b1047c65c3 service nova] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:44:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-70575b8a-70f2-45a3-aa45-33535ffd68a3 req-cb9f78c6-1ed2-478d-8c3e-75b1047c65c3 service nova] Lock "31463852-d5bb-4840-aa04-3bc48f95e03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:44:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-70575b8a-70f2-45a3-aa45-33535ffd68a3 req-cb9f78c6-1ed2-478d-8c3e-75b1047c65c3 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] No waiting events found dispatching network-vif-plugged-8a1dec1a-8918-4a7d-b090-5716c5b433e5 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:44:42 user nova-compute[75571]: WARNING nova.compute.manager [req-70575b8a-70f2-45a3-aa45-33535ffd68a3 req-cb9f78c6-1ed2-478d-8c3e-75b1047c65c3 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Received unexpected event network-vif-plugged-8a1dec1a-8918-4a7d-b090-5716c5b433e5 for instance with vm_state deleted and task_state None.
Nov 28 20:44:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-70575b8a-70f2-45a3-aa45-33535ffd68a3 req-cb9f78c6-1ed2-478d-8c3e-75b1047c65c3 service nova] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Received event network-vif-deleted-8a1dec1a-8918-4a7d-b090-5716c5b433e5 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:44:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:44:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:44:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:44:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:44:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 is timed out.
Nov 28 20:44:55 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Successfully detached device vdb from instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 from the live domain config.
Nov 28 20:44:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDkiMuCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:44:55 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff046a5-cccc-4406-95fa-5837f8be56b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:44:55 user nova-compute[75571]: No targets found.
Nov 28 20:44:55 user nova-compute[75571]: iSNS:
Nov 28 20:44:55 user nova-compute[75571]: No targets found.
Nov 28 20:44:55 user nova-compute[75571]: STATIC:
Nov 28 20:44:55 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351
Nov 28 20:44:55 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:44:55 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:44:55 user nova-compute[75571]: FIRMWARE:
Nov 28 20:44:55 user nova-compute[75571]: No targets found.
Nov 28 20:44:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:44:55 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:44:55 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad4774e-dd0e-48d1-b115-ebaf6dd5567c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[17816040-b41b-4774-bcf2-a9db609c7c26]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 (non-flash)
Nov 28 20:44:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 (non-flash)
Nov 28 20:44:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768505fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[facbb0e8-ac95-400d-9426-eb2467a3a941]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[744e86d5-5c54-4a13-93c2-5f9f12d87e6b]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f9884-687c-41e1-8d4f-63c919a18215]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35cebb7-6946-448e-bc76-e24f8f4fed67]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f590c025-6b0d-4c3d-89f4-3f1b97f0953b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aced00-f60f-418f-8e30-1094ce90721b]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351, portal: 172.16.0.220,3260]
Nov 28 20:44:55 user nova-compute[75571]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351, portal: 172.16.0.220,3260] successful.
Nov 28 20:44:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9d0bf49-e1ad-4031-9ad6-10aade724351 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dc9db8-60e7-40da-9dee-d30d013e57c1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] <== disconnect_volume: return (304ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:44:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:44:56 user nova-compute[75571]: DEBUG nova.objects.instance [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'flavor' on Instance uuid f23739ef-322e-4a8f-9df3-2a06e42b6a35 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:44:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.626s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:45:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:45:19 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:45:20 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:45:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:45:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:45:23 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:45:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:45:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:45:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:45:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:45:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:45:24 user nova-compute[75571]: INFO nova.compute.manager [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Terminating instance
Nov 28 20:45:24 user nova-compute[75571]: DEBUG nova.compute.manager [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:45:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG nova.compute.manager [req-cff12130-e28a-4b79-b2dd-533c157b280c req-ba4fc750-e55d-4694-a57c-c4d92d62695c service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-vif-unplugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cff12130-e28a-4b79-b2dd-533c157b280c req-ba4fc750-e55d-4694-a57c-c4d92d62695c service nova] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cff12130-e28a-4b79-b2dd-533c157b280c req-ba4fc750-e55d-4694-a57c-c4d92d62695c service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cff12130-e28a-4b79-b2dd-533c157b280c req-ba4fc750-e55d-4694-a57c-c4d92d62695c service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG nova.compute.manager [req-cff12130-e28a-4b79-b2dd-533c157b280c req-ba4fc750-e55d-4694-a57c-c4d92d62695c service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] No waiting events found dispatching network-vif-unplugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG nova.compute.manager [req-cff12130-e28a-4b79-b2dd-533c157b280c req-ba4fc750-e55d-4694-a57c-c4d92d62695c service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-vif-unplugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:25 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Instance destroyed successfully.
Nov 28 20:45:25 user nova-compute[75571]: DEBUG nova.objects.instance [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'resources' on Instance uuid f23739ef-322e-4a8f-9df3-2a06e42b6a35 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1401374666',display_name='tempest-ServerRescueNegativeTestJSON-server-1401374666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1401374666',id=41,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWg6YbMlebQ5V+UbkiDrrgElaYoiXY9oYImEppuaL6/Oo5HZCbiLccGXYvygaEUJySbNh/P4i1kz+O1q3We6pyWNWE9nV6EgEtTcw+bkFNGx5lVpre5FiMuKcW99C0YaA==',key_name='tempest-keypair-249978267',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:40:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d72dc075421c4e7eb9c0ff2bf1641a92',ramdisk_id='',reservation_id='r-zhhy1al0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-506941201',owner_user_name='tempest-ServerRescueNegativeTestJSON-506941201-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='634123644067453a92f4d43da0b28fa7',uuid=f23739ef-322e-4a8f-9df3-2a06e42b6a35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converting VIF {"id": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "address": "fa:16:3e:a8:8b:70", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7354a1a8-41", "ovs_interfaceid": "7354a1a8-41e9-4a3c-9d08-fa55997c917a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:8b:70,bridge_name='br-int',has_traffic_filtering=True,id=7354a1a8-41e9-4a3c-9d08-fa55997c917a,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7354a1a8-41') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG os_vif [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:8b:70,bridge_name='br-int',has_traffic_filtering=True,id=7354a1a8-41e9-4a3c-9d08-fa55997c917a,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7354a1a8-41') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7354a1a8-41, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1364f2f2-5c4f-48a4-924f-f0e576b5e836) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:45:25 user nova-compute[75571]: INFO os_vif [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:8b:70,bridge_name='br-int',has_traffic_filtering=True,id=7354a1a8-41e9-4a3c-9d08-fa55997c917a,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7354a1a8-41')
Nov 28 20:45:25 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Deleting instance files /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35_del
Nov 28 20:45:25 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Deletion of /opt/stack/data/nova/instances/f23739ef-322e-4a8f-9df3-2a06e42b6a35_del complete
Nov 28 20:45:25 user nova-compute[75571]: INFO nova.compute.manager [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 28 20:45:25 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:45:25 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:45:26 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:45:26 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:45:26 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:45:26 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Took 0.76 seconds to deallocate network for instance.
Nov 28 20:45:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-38955dce-b51c-4bb5-a499-9b22ad948f2c req-8fb99a48-50cf-4d02-9763-42bd0dac017e service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-vif-deleted-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:45:26 user nova-compute[75571]: INFO nova.compute.manager [req-38955dce-b51c-4bb5-a499-9b22ad948f2c req-8fb99a48-50cf-4d02-9763-42bd0dac017e service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Neutron deleted interface 7354a1a8-41e9-4a3c-9d08-fa55997c917a; detaching it from the instance and deleting it from the info cache
Nov 28 20:45:26 user nova-compute[75571]: DEBUG nova.network.neutron [req-38955dce-b51c-4bb5-a499-9b22ad948f2c req-8fb99a48-50cf-4d02-9763-42bd0dac017e service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:45:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-38955dce-b51c-4bb5-a499-9b22ad948f2c req-8fb99a48-50cf-4d02-9763-42bd0dac017e service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Detach interface failed, port_id=7354a1a8-41e9-4a3c-9d08-fa55997c917a, reason: Instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:45:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:45:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:45:26 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:45:26 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:45:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:45:26 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Deleted allocations for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35
Nov 28 20:45:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.942s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:45:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-aec940c2-b459-4f05-9efa-f137262ab526 req-2ff8487c-cc3a-415b-98b8-260f70932ffa service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:45:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-aec940c2-b459-4f05-9efa-f137262ab526 req-2ff8487c-cc3a-415b-98b8-260f70932ffa service nova] Acquiring lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:45:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-aec940c2-b459-4f05-9efa-f137262ab526 req-2ff8487c-cc3a-415b-98b8-260f70932ffa service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:45:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-aec940c2-b459-4f05-9efa-f137262ab526 req-2ff8487c-cc3a-415b-98b8-260f70932ffa service nova] Lock "f23739ef-322e-4a8f-9df3-2a06e42b6a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:45:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-aec940c2-b459-4f05-9efa-f137262ab526 req-2ff8487c-cc3a-415b-98b8-260f70932ffa service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] No waiting events found dispatching network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:45:27 user nova-compute[75571]: WARNING nova.compute.manager [req-aec940c2-b459-4f05-9efa-f137262ab526 req-2ff8487c-cc3a-415b-98b8-260f70932ffa service nova] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Received unexpected event network-vif-plugged-7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance with vm_state deleted and task_state None.
Nov 28 20:45:30 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:45:30 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:45:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:45:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:45:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:45:30 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:45:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:30 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:32 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:45:32 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:45:32 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8754MB free_disk=24.976863861083984GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:45:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:45:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:45:32 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:45:32 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:45:32 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:45:32 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:45:32 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:45:32 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:45:32 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:45:32 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:45:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:45:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-9f772ab8-90d9-4d55-9599-ba194d0535f0 req-44953a35-0102-45c7-b8f3-b52d83f0b954 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Received event network-changed-30bb67dc-9127-4518-917c-fa6fd887c49b {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:45:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-9f772ab8-90d9-4d55-9599-ba194d0535f0 req-44953a35-0102-45c7-b8f3-b52d83f0b954 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Refreshing instance network info cache due to event network-changed-30bb67dc-9127-4518-917c-fa6fd887c49b. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:45:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9f772ab8-90d9-4d55-9599-ba194d0535f0 req-44953a35-0102-45c7-b8f3-b52d83f0b954 service nova] Acquiring lock "refresh_cache-99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:45:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9f772ab8-90d9-4d55-9599-ba194d0535f0 req-44953a35-0102-45c7-b8f3-b52d83f0b954 service nova] Acquired lock "refresh_cache-99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:45:42 user nova-compute[75571]: DEBUG nova.network.neutron [req-9f772ab8-90d9-4d55-9599-ba194d0535f0 req-44953a35-0102-45c7-b8f3-b52d83f0b954 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Refreshing network info cache for port 30bb67dc-9127-4518-917c-fa6fd887c49b {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:45:43 user nova-compute[75571]: DEBUG nova.network.neutron [req-9f772ab8-90d9-4d55-9599-ba194d0535f0 req-44953a35-0102-45c7-b8f3-b52d83f0b954 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Updated VIF entry in instance network info cache for port 30bb67dc-9127-4518-917c-fa6fd887c49b. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:45:43 user nova-compute[75571]: DEBUG nova.network.neutron [req-9f772ab8-90d9-4d55-9599-ba194d0535f0 req-44953a35-0102-45c7-b8f3-b52d83f0b954 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Updating instance_info_cache with network_info: [{"id": "30bb67dc-9127-4518-917c-fa6fd887c49b", "address": "fa:16:3e:13:4c:d6", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb67dc-91", "ovs_interfaceid": "30bb67dc-9127-4518-917c-fa6fd887c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:45:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9f772ab8-90d9-4d55-9599-ba194d0535f0 req-44953a35-0102-45c7-b8f3-b52d83f0b954 service nova] Releasing lock "refresh_cache-99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:45:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:45:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:45:45 user nova-compute[75571]: DEBUG nova.objects.instance [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'flavor' on Instance uuid 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:45:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:45:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:45:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:45:45 user nova-compute[75571]: INFO nova.compute.manager [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Attaching volume a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 to /dev/vdb
Nov 28 20:45:45 user nova-compute[75571]: DEBUG os_brick.utils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:45:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd306a51-0966-4a7d-8f61-9af0afd95680]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[96219427-0614-4898-85b4-b74e8b357bd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec3196c-3ba8-4b6c-b26b-f6797e50abdc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7e80bb-4cd7-4387-86ee-5b97b7fe3f3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:45:46 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:45:46 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3b3315-9a75-49c8-83dc-6b2f5ee3126b]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG os_brick.utils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:45:46 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Updating existing volume attachment record: cd2de47a-f8ea-4d99-9a68-985dfe159711 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:45:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:45:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNHfwRno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:45:52 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:45:52 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:45:52 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f4abf5-3524-4eb5-bc54-aadf67b78129]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:45:52 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d212c4ed-a134-483a-8f40-09afb72845d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7] added
Nov 28 20:45:52 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d1437e-2551-4a77-b34c-22708cad2407]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d23958-ba58-4bd7-ae97-e0fc6a73c782]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNHfwRno {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNHfwRno" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3822f0-3611-4d44-8bcf-c01847e8b33c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iNHfwRno'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ee07dd-ce4d-4e63-b5c6-1e70a108beb2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2dfb55-b929-4801-ac46-53004c745161]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:45:52 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:45:52 user nova-compute[75571]:  {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:45:52 user nova-compute[75571]: WARNING os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 20:45:52 user nova-compute[75571]: 
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3314509a-1282-41b5-98ce-5883b24dedd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7, portal: 172.16.0.220,3260]
Nov 28 20:45:52 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7, portal: 172.16.0.220,3260] successful.
Nov 28 20:45:52 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[91da4c24-ae7d-47c5-8de4-fc0826ce524b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6b3f42-480a-4321-a0cd-469f937f2ec4]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 (non-flash)
Nov 28 20:45:52 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 (non-flash)
Nov 28 20:45:52 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bc8389-0cf6-4f45-b4a1-876d1e798725]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:45:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNHfwRno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:45:53 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:45:53 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26262393331346138', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:45:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262393331346138', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:45:53 user nova-compute[75571]: DEBUG nova.objects.instance [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'flavor' on Instance uuid 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:45:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:45:53 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:45:53 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:45:53 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:45:53 user nova-compute[75571]:   <serial>a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7</serial>
Nov 28 20:45:53 user nova-compute[75571]: </disk>
Nov 28 20:45:53 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:45:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:45:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:45:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No VIF found with MAC fa:16:3e:13:4c:d6, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:45:54 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.542s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:45:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:45:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:45:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:45:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:45:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:45:57 user nova-compute[75571]: INFO nova.compute.claims [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Claim successful on node user
Nov 28 20:45:57 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:45:57 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:45:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG nova.policy [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:45:57 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Creating image(s)
Nov 28 20:45:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "/opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "/opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "/opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.188s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:45:57 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.211s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk 1073741824" returned: 0 in 0.050s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Successfully created port: 2db490a9-4311-4a10-ba45-0610a87cb422 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Cannot resize image /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Ensure instance console log exists: /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Successfully updated port: 2db490a9-4311-4a10-ba45-0610a87cb422 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "refresh_cache-876085ae-87cc-4a4d-b4b7-3f595497d6e7" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquired lock "refresh_cache-876085ae-87cc-4a4d-b4b7-3f595497d6e7" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG nova.compute.manager [req-f8a1ba30-ced4-4a2b-af76-dca43f2efb2b req-723c809b-7381-4dbc-b63b-f8e9931f8d7f service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Received event network-changed-2db490a9-4311-4a10-ba45-0610a87cb422 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG nova.compute.manager [req-f8a1ba30-ced4-4a2b-af76-dca43f2efb2b req-723c809b-7381-4dbc-b63b-f8e9931f8d7f service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Refreshing instance network info cache due to event network-changed-2db490a9-4311-4a10-ba45-0610a87cb422. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f8a1ba30-ced4-4a2b-af76-dca43f2efb2b req-723c809b-7381-4dbc-b63b-f8e9931f8d7f service nova] Acquiring lock "refresh_cache-876085ae-87cc-4a4d-b4b7-3f595497d6e7" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:45:58 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Updating instance_info_cache with network_info: [{"id": "2db490a9-4311-4a10-ba45-0610a87cb422", "address": "fa:16:3e:f2:8c:59", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db490a9-43", "ovs_interfaceid": "2db490a9-4311-4a10-ba45-0610a87cb422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Releasing lock "refresh_cache-876085ae-87cc-4a4d-b4b7-3f595497d6e7" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Instance network_info: |[{"id": "2db490a9-4311-4a10-ba45-0610a87cb422", "address": "fa:16:3e:f2:8c:59", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db490a9-43", "ovs_interfaceid": "2db490a9-4311-4a10-ba45-0610a87cb422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f8a1ba30-ced4-4a2b-af76-dca43f2efb2b req-723c809b-7381-4dbc-b63b-f8e9931f8d7f service nova] Acquired lock "refresh_cache-876085ae-87cc-4a4d-b4b7-3f595497d6e7" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.network.neutron [req-f8a1ba30-ced4-4a2b-af76-dca43f2efb2b req-723c809b-7381-4dbc-b63b-f8e9931f8d7f service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Refreshing network info cache for port 2db490a9-4311-4a10-ba45-0610a87cb422 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Start _get_guest_xml network_info=[{"id": "2db490a9-4311-4a10-ba45-0610a87cb422", "address": "fa:16:3e:f2:8c:59", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db490a9-43", "ovs_interfaceid": "2db490a9-4311-4a10-ba45-0610a87cb422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:45:59 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:45:59 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:45:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-725689161',display_name='tempest-AttachVolumeNegativeTest-server-725689161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-725689161',id=44,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDDuxARll7/LMfz2HOhMx+h1egmbo8MLXcn8TDB+mNo/cPT/oI6Ezwve8HwnVYGVmMFb/zzID1OQQm1/7xa9jTN0HHpsL0zuCZQfCIjJiLFiEe+gATwmZBnGXhmgLGsJg==',key_name='tempest-keypair-1035919865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c30c6dea8b148f08d7e5e84757c5e64',ramdisk_id='',reservation_id='r-v0jgglrl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-959194587',owner_user_name='tempest-AttachVolumeNegativeTest-959194587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='409bfc19d682425ea17eda9b336750b4',uuid=876085ae-87cc-4a4d-b4b7-3f595497d6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2db490a9-4311-4a10-ba45-0610a87cb422", "address": "fa:16:3e:f2:8c:59", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db490a9-43", "ovs_interfaceid": "2db490a9-4311-4a10-ba45-0610a87cb422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converting VIF {"id": "2db490a9-4311-4a10-ba45-0610a87cb422", "address": "fa:16:3e:f2:8c:59", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db490a9-43", "ovs_interfaceid": "2db490a9-4311-4a10-ba45-0610a87cb422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8c:59,bridge_name='br-int',has_traffic_filtering=True,id=2db490a9-4311-4a10-ba45-0610a87cb422,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2db490a9-43') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.objects.instance [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'pci_devices' on Instance uuid 876085ae-87cc-4a4d-b4b7-3f595497d6e7 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:45:59 user nova-compute[75571]:   <uuid>876085ae-87cc-4a4d-b4b7-3f595497d6e7</uuid>
Nov 28 20:45:59 user nova-compute[75571]:   <name>instance-0000002c</name>
Nov 28 20:45:59 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:45:59 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:45:59 user nova-compute[75571]:   <metadata>
Nov 28 20:45:59 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:45:59 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:45:59 user nova-compute[75571]:       <nova:name>tempest-AttachVolumeNegativeTest-server-725689161</nova:name>
Nov 28 20:45:59 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:45:59</nova:creationTime>
Nov 28 20:45:59 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:45:59 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:45:59 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:45:59 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:45:59 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:45:59 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:45:59 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:45:59 user nova-compute[75571]:       <nova:owner>
Nov 28 20:45:59 user nova-compute[75571]:         <nova:user uuid="409bfc19d682425ea17eda9b336750b4">tempest-AttachVolumeNegativeTest-959194587-project-member</nova:user>
Nov 28 20:45:59 user nova-compute[75571]:         <nova:project uuid="9c30c6dea8b148f08d7e5e84757c5e64">tempest-AttachVolumeNegativeTest-959194587</nova:project>
Nov 28 20:45:59 user nova-compute[75571]:       </nova:owner>
Nov 28 20:45:59 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:45:59 user nova-compute[75571]:       <nova:ports>
Nov 28 20:45:59 user nova-compute[75571]:         <nova:port uuid="2db490a9-4311-4a10-ba45-0610a87cb422">
Nov 28 20:45:59 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 20:45:59 user nova-compute[75571]:         </nova:port>
Nov 28 20:45:59 user nova-compute[75571]:       </nova:ports>
Nov 28 20:45:59 user nova-compute[75571]:     </nova:instance>
Nov 28 20:45:59 user nova-compute[75571]:   </metadata>
Nov 28 20:45:59 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:45:59 user nova-compute[75571]:     <system>
Nov 28 20:45:59 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:45:59 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:45:59 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:45:59 user nova-compute[75571]:       <entry name="serial">876085ae-87cc-4a4d-b4b7-3f595497d6e7</entry>
Nov 28 20:45:59 user nova-compute[75571]:       <entry name="uuid">876085ae-87cc-4a4d-b4b7-3f595497d6e7</entry>
Nov 28 20:45:59 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:45:59 user nova-compute[75571]:     </system>
Nov 28 20:45:59 user nova-compute[75571]:   </sysinfo>
Nov 28 20:45:59 user nova-compute[75571]:   <os>
Nov 28 20:45:59 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:45:59 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:45:59 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:45:59 user nova-compute[75571]:   </os>
Nov 28 20:45:59 user nova-compute[75571]:   <features>
Nov 28 20:45:59 user nova-compute[75571]:     <acpi/>
Nov 28 20:45:59 user nova-compute[75571]:     <apic/>
Nov 28 20:45:59 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:45:59 user nova-compute[75571]:   </features>
Nov 28 20:45:59 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:45:59 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:45:59 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:45:59 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:45:59 user nova-compute[75571]:   </clock>
Nov 28 20:45:59 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:45:59 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:45:59 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:45:59 user nova-compute[75571]:   </cpu>
Nov 28 20:45:59 user nova-compute[75571]:   <devices>
Nov 28 20:45:59 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:45:59 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:45:59 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk"/>
Nov 28 20:45:59 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:45:59 user nova-compute[75571]:     </disk>
Nov 28 20:45:59 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:45:59 user nova-compute[75571]:       <mac address="fa:16:3e:f2:8c:59"/>
Nov 28 20:45:59 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:45:59 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:45:59 user nova-compute[75571]:       <target dev="tap2db490a9-43"/>
Nov 28 20:45:59 user nova-compute[75571]:     </interface>
Nov 28 20:45:59 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:45:59 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/console.log" append="off"/>
Nov 28 20:45:59 user nova-compute[75571]:     </serial>
Nov 28 20:45:59 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:45:59 user nova-compute[75571]:     <video>
Nov 28 20:45:59 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:45:59 user nova-compute[75571]:     </video>
Nov 28 20:45:59 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:45:59 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:45:59 user nova-compute[75571]:     </rng>
Nov 28 20:45:59 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:45:59 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:45:59 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:45:59 user nova-compute[75571]:     </memballoon>
Nov 28 20:45:59 user nova-compute[75571]:   </devices>
Nov 28 20:45:59 user nova-compute[75571]: </domain>
Nov 28 20:45:59 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:45:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-725689161',display_name='tempest-AttachVolumeNegativeTest-server-725689161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-725689161',id=44,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDDuxARll7/LMfz2HOhMx+h1egmbo8MLXcn8TDB+mNo/cPT/oI6Ezwve8HwnVYGVmMFb/zzID1OQQm1/7xa9jTN0HHpsL0zuCZQfCIjJiLFiEe+gATwmZBnGXhmgLGsJg==',key_name='tempest-keypair-1035919865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c30c6dea8b148f08d7e5e84757c5e64',ramdisk_id='',reservation_id='r-v0jgglrl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-959194587',owner_user_name='tempest-AttachVolumeNegativeTest-959194587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='409bfc19d682425ea17eda9b336750b4',uuid=876085ae-87cc-4a4d-b4b7-3f595497d6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2db490a9-4311-4a10-ba45-0610a87cb422", "address": "fa:16:3e:f2:8c:59", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db490a9-43", "ovs_interfaceid": "2db490a9-4311-4a10-ba45-0610a87cb422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converting VIF {"id": "2db490a9-4311-4a10-ba45-0610a87cb422", "address": "fa:16:3e:f2:8c:59", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db490a9-43", "ovs_interfaceid": "2db490a9-4311-4a10-ba45-0610a87cb422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8c:59,bridge_name='br-int',has_traffic_filtering=True,id=2db490a9-4311-4a10-ba45-0610a87cb422,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2db490a9-43') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG os_vif [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8c:59,bridge_name='br-int',has_traffic_filtering=True,id=2db490a9-4311-4a10-ba45-0610a87cb422,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2db490a9-43') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '188f72bc-5b5b-5ff9-b412-55e3baf70102', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2db490a9-43, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2db490a9-43, col_values=(('qos', UUID('b009672f-5ca1-47c6-a383-e4f31f203e86')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2db490a9-43, col_values=(('external_ids', {'iface-id': '2db490a9-4311-4a10-ba45-0610a87cb422', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:8c:59', 'vm-uuid': '876085ae-87cc-4a4d-b4b7-3f595497d6e7'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:45:59 user nova-compute[75571]: INFO os_vif [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8c:59,bridge_name='br-int',has_traffic_filtering=True,id=2db490a9-4311-4a10-ba45-0610a87cb422,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2db490a9-43')
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No VIF found with MAC fa:16:3e:f2:8c:59, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.network.neutron [req-f8a1ba30-ced4-4a2b-af76-dca43f2efb2b req-723c809b-7381-4dbc-b63b-f8e9931f8d7f service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Updated VIF entry in instance network info cache for port 2db490a9-4311-4a10-ba45-0610a87cb422. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG nova.network.neutron [req-f8a1ba30-ced4-4a2b-af76-dca43f2efb2b req-723c809b-7381-4dbc-b63b-f8e9931f8d7f service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Updating instance_info_cache with network_info: [{"id": "2db490a9-4311-4a10-ba45-0610a87cb422", "address": "fa:16:3e:f2:8c:59", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db490a9-43", "ovs_interfaceid": "2db490a9-4311-4a10-ba45-0610a87cb422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:45:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f8a1ba30-ced4-4a2b-af76-dca43f2efb2b req-723c809b-7381-4dbc-b63b-f8e9931f8d7f service nova] Releasing lock "refresh_cache-876085ae-87cc-4a4d-b4b7-3f595497d6e7" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:46:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-31dfb7a2-a5e4-4009-b6e7-3541b9d14582 req-348d1341-a788-46db-98b5-3597d7fa52af service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Received event network-vif-plugged-2db490a9-4311-4a10-ba45-0610a87cb422 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:46:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-31dfb7a2-a5e4-4009-b6e7-3541b9d14582 req-348d1341-a788-46db-98b5-3597d7fa52af service nova] Acquiring lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:46:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-31dfb7a2-a5e4-4009-b6e7-3541b9d14582 req-348d1341-a788-46db-98b5-3597d7fa52af service nova] Lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:46:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-31dfb7a2-a5e4-4009-b6e7-3541b9d14582 req-348d1341-a788-46db-98b5-3597d7fa52af service nova] Lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:46:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-31dfb7a2-a5e4-4009-b6e7-3541b9d14582 req-348d1341-a788-46db-98b5-3597d7fa52af service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] No waiting events found dispatching network-vif-plugged-2db490a9-4311-4a10-ba45-0610a87cb422 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:46:00 user nova-compute[75571]: WARNING nova.compute.manager [req-31dfb7a2-a5e4-4009-b6e7-3541b9d14582 req-348d1341-a788-46db-98b5-3597d7fa52af service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Received unexpected event network-vif-plugged-2db490a9-4311-4a10-ba45-0610a87cb422 for instance with vm_state building and task_state spawning.
Nov 28 20:46:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:46:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:46:02 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Instance spawned successfully.
Nov 28 20:46:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:46:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:46:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:46:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:46:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:46:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:46:02 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:46:02 user nova-compute[75571]: INFO nova.compute.manager [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 28 20:46:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:46:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-a8fdd322-5641-4c0f-add5-18f040da3dd4 req-abe6b017-77e8-47e0-86a2-f94244771dff service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Received event network-vif-plugged-2db490a9-4311-4a10-ba45-0610a87cb422 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:46:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a8fdd322-5641-4c0f-add5-18f040da3dd4 req-abe6b017-77e8-47e0-86a2-f94244771dff service nova] Acquiring lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:46:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a8fdd322-5641-4c0f-add5-18f040da3dd4 req-abe6b017-77e8-47e0-86a2-f94244771dff service nova] Lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:46:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a8fdd322-5641-4c0f-add5-18f040da3dd4 req-abe6b017-77e8-47e0-86a2-f94244771dff service nova] Lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:46:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-a8fdd322-5641-4c0f-add5-18f040da3dd4 req-abe6b017-77e8-47e0-86a2-f94244771dff service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] No waiting events found dispatching network-vif-plugged-2db490a9-4311-4a10-ba45-0610a87cb422 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:46:02 user nova-compute[75571]: WARNING nova.compute.manager [req-a8fdd322-5641-4c0f-add5-18f040da3dd4 req-abe6b017-77e8-47e0-86a2-f94244771dff service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Received unexpected event network-vif-plugged-2db490a9-4311-4a10-ba45-0610a87cb422 for instance with vm_state building and task_state spawning.
Nov 28 20:46:03 user nova-compute[75571]: INFO nova.compute.manager [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Took 5.90 seconds to build instance.
Nov 28 20:46:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.016s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:46:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:20 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:46:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:21 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:46:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "def2369e-4d57-482b-aef9-dab7c3a7cb84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:46:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:46:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:46:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:46:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:46:22 user nova-compute[75571]: INFO nova.compute.manager [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Terminating instance
Nov 28 20:46:22 user nova-compute[75571]: DEBUG nova.compute.manager [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:46:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:22 user nova-compute[75571]: DEBUG nova.compute.manager [req-fee98269-c3e2-4784-9ea6-e56a23d69a1e req-3e25e319-4ddf-4bf9-80e7-5a1f60581f04 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received event network-vif-unplugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:46:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fee98269-c3e2-4784-9ea6-e56a23d69a1e req-3e25e319-4ddf-4bf9-80e7-5a1f60581f04 service nova] Acquiring lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:46:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fee98269-c3e2-4784-9ea6-e56a23d69a1e req-3e25e319-4ddf-4bf9-80e7-5a1f60581f04 service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:46:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fee98269-c3e2-4784-9ea6-e56a23d69a1e req-3e25e319-4ddf-4bf9-80e7-5a1f60581f04 service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:46:22 user nova-compute[75571]: DEBUG nova.compute.manager [req-fee98269-c3e2-4784-9ea6-e56a23d69a1e req-3e25e319-4ddf-4bf9-80e7-5a1f60581f04 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] No waiting events found dispatching network-vif-unplugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:46:22 user nova-compute[75571]: DEBUG nova.compute.manager [req-fee98269-c3e2-4784-9ea6-e56a23d69a1e req-3e25e319-4ddf-4bf9-80e7-5a1f60581f04 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received event network-vif-unplugged-ca71d400-500b-4d9b-9141-67afb25ac98d for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:46:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:23 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Instance destroyed successfully.
Nov 28 20:46:23 user nova-compute[75571]: DEBUG nova.objects.instance [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'resources' on Instance uuid def2369e-4d57-482b-aef9-dab7c3a7cb84 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:30:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1606228576',display_name='tempest-ServerRescueNegativeTestJSON-server-1606228576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1606228576',id=36,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:32:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d72dc075421c4e7eb9c0ff2bf1641a92',ramdisk_id='',reservation_id='r-s7rpgbpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-506941201',owner_user_name='tempest-ServerRescueNegativeTestJSON-506941201-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:32:15Z,user_data=None,user_id='634123644067453a92f4d43da0b28fa7',uuid=def2369e-4d57-482b-aef9-dab7c3a7cb84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converting VIF {"id": "ca71d400-500b-4d9b-9141-67afb25ac98d", "address": "fa:16:3e:4c:61:d8", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca71d400-50", "ovs_interfaceid": "ca71d400-500b-4d9b-9141-67afb25ac98d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:61:d8,bridge_name='br-int',has_traffic_filtering=True,id=ca71d400-500b-4d9b-9141-67afb25ac98d,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca71d400-50') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG os_vif [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:61:d8,bridge_name='br-int',has_traffic_filtering=True,id=ca71d400-500b-4d9b-9141-67afb25ac98d,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca71d400-50') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca71d400-50, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3de7301-b05a-447e-9fb2-b7e53a34a774) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:23 user nova-compute[75571]: INFO os_vif [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:61:d8,bridge_name='br-int',has_traffic_filtering=True,id=ca71d400-500b-4d9b-9141-67afb25ac98d,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca71d400-50')
Nov 28 20:46:23 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Deleting instance files /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84_del
Nov 28 20:46:23 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Deletion of /opt/stack/data/nova/instances/def2369e-4d57-482b-aef9-dab7c3a7cb84_del complete
Nov 28 20:46:23 user nova-compute[75571]: INFO nova.compute.manager [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 28 20:46:23 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-a468c968-ad52-439d-bf2e-c0136cf722ce req-7fa80808-1061-465e-b63c-1b6716416f90 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received event network-vif-deleted-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:46:23 user nova-compute[75571]: INFO nova.compute.manager [req-a468c968-ad52-439d-bf2e-c0136cf722ce req-7fa80808-1061-465e-b63c-1b6716416f90 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Neutron deleted interface ca71d400-500b-4d9b-9141-67afb25ac98d; detaching it from the instance and deleting it from the info cache
Nov 28 20:46:23 user nova-compute[75571]: DEBUG nova.network.neutron [req-a468c968-ad52-439d-bf2e-c0136cf722ce req-7fa80808-1061-465e-b63c-1b6716416f90 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:46:23 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:46:23 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Took 0.73 seconds to deallocate network for instance.
Nov 28 20:46:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-a468c968-ad52-439d-bf2e-c0136cf722ce req-7fa80808-1061-465e-b63c-1b6716416f90 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Detach interface failed, port_id=ca71d400-500b-4d9b-9141-67afb25ac98d, reason: Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:46:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:46:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:46:24 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:46:24 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:46:24 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:46:24 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:46:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:46:24 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Deleted allocations for instance def2369e-4d57-482b-aef9-dab7c3a7cb84
Nov 28 20:46:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.809s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:46:24 user nova-compute[75571]: DEBUG nova.compute.manager [req-35a368a6-c4bc-4442-a713-159625d652b5 req-f6783e3a-dba8-404c-b82e-c1e54b4c1b61 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received event network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:46:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-35a368a6-c4bc-4442-a713-159625d652b5 req-f6783e3a-dba8-404c-b82e-c1e54b4c1b61 service nova] Acquiring lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:46:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-35a368a6-c4bc-4442-a713-159625d652b5 req-f6783e3a-dba8-404c-b82e-c1e54b4c1b61 service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:46:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-35a368a6-c4bc-4442-a713-159625d652b5 req-f6783e3a-dba8-404c-b82e-c1e54b4c1b61 service nova] Lock "def2369e-4d57-482b-aef9-dab7c3a7cb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:46:24 user nova-compute[75571]: DEBUG nova.compute.manager [req-35a368a6-c4bc-4442-a713-159625d652b5 req-f6783e3a-dba8-404c-b82e-c1e54b4c1b61 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] No waiting events found dispatching network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:46:24 user nova-compute[75571]: WARNING nova.compute.manager [req-35a368a6-c4bc-4442-a713-159625d652b5 req-f6783e3a-dba8-404c-b82e-c1e54b4c1b61 service nova] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Received unexpected event network-vif-plugged-ca71d400-500b-4d9b-9141-67afb25ac98d for instance with vm_state deleted and task_state None.
Nov 28 20:46:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:26 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:46:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:46:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:46:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:46:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:46:26 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:46:26 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 29443f30-6d05-4148-9185-a31f78b4a68f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:46:26 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Updating instance_info_cache with network_info: [{"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:46:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-29443f30-6d05-4148-9185-a31f78b4a68f" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:46:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:46:26 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:46:26 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:46:27 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:46:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:30 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:46:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:32 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:46:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:46:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:46:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:46:32 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:46:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:46:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:46:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:46:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:46:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:46:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:46:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:46:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:46:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:46:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:46:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:46:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:46:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:46:33 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:46:33 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:46:33 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=24.97458267211914GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:46:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:46:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:46:34 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:46:34 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:46:34 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:46:34 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:46:34 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:46:34 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:46:34 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:46:34 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:46:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:46:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:46:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:46:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:46:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:46:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Verify base images {{(pid=75571) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Image id 77b9e284-7155-4207-b748-934c25ce18d0 yields fingerprint bec346222d5c9f56f90d540a5e4b53c2c475728b {{(pid=75571) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 20:46:47 user nova-compute[75571]: INFO nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] image 77b9e284-7155-4207-b748-934c25ce18d0 at (/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b): checking
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] image 77b9e284-7155-4207-b748-934c25ce18d0 at (/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b): image is in use {{(pid=75571) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75571) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd is a valid instance name {{(pid=75571) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd has a disk file {{(pid=75571) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd is backed by bec346222d5c9f56f90d540a5e4b53c2c475728b {{(pid=75571) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] 29443f30-6d05-4148-9185-a31f78b4a68f is a valid instance name {{(pid=75571) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] 29443f30-6d05-4148-9185-a31f78b4a68f has a disk file {{(pid=75571) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 29443f30-6d05-4148-9185-a31f78b4a68f is backed by bec346222d5c9f56f90d540a5e4b53c2c475728b {{(pid=75571) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] 876085ae-87cc-4a4d-b4b7-3f595497d6e7 is a valid instance name {{(pid=75571) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] 876085ae-87cc-4a4d-b4b7-3f595497d6e7 has a disk file {{(pid=75571) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 is backed by bec346222d5c9f56f90d540a5e4b53c2c475728b {{(pid=75571) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 28 20:46:47 user nova-compute[75571]: WARNING nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Unknown base file: /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d
Nov 28 20:46:47 user nova-compute[75571]: WARNING nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4270e978df50c6d046d840d5a70f83fda4f426c1
Nov 28 20:46:47 user nova-compute[75571]: WARNING nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ee31cfe828ea1f3289d26f6a2449da8ba16b3df8
Nov 28 20:46:47 user nova-compute[75571]: WARNING nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Unknown base file: /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8
Nov 28 20:46:47 user nova-compute[75571]: WARNING nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9
Nov 28 20:46:47 user nova-compute[75571]: WARNING nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792
Nov 28 20:46:47 user nova-compute[75571]: WARNING nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda
Nov 28 20:46:47 user nova-compute[75571]: WARNING nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Unknown base file: /opt/stack/data/nova/instances/_base/14d248f17ea541e1677c53b6657caaa14a8c262b
Nov 28 20:46:47 user nova-compute[75571]: WARNING nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa
Nov 28 20:46:47 user nova-compute[75571]: INFO nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Active base files: /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b
Nov 28 20:46:47 user nova-compute[75571]: INFO nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Removable base files: /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d /opt/stack/data/nova/instances/_base/4270e978df50c6d046d840d5a70f83fda4f426c1 /opt/stack/data/nova/instances/_base/ee31cfe828ea1f3289d26f6a2449da8ba16b3df8 /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8 /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9 /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792 /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda /opt/stack/data/nova/instances/_base/14d248f17ea541e1677c53b6657caaa14a8c262b /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa
Nov 28 20:46:47 user nova-compute[75571]: INFO nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/211aeae282eb575dacf914f800a848e0fa0b293d
Nov 28 20:46:47 user nova-compute[75571]: INFO nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4270e978df50c6d046d840d5a70f83fda4f426c1
Nov 28 20:46:47 user nova-compute[75571]: INFO nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ee31cfe828ea1f3289d26f6a2449da8ba16b3df8
Nov 28 20:46:47 user nova-compute[75571]: INFO nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/432b1c7e7f8b0a78df25a87577c0ea191dbf62f8
Nov 28 20:46:47 user nova-compute[75571]: INFO nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a5a6ef84ae0b153b1cf5c9392035a1f2a515d7e9
Nov 28 20:46:47 user nova-compute[75571]: INFO nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6f4ebe798e4958ec92f88731555389ead5db7792
Nov 28 20:46:47 user nova-compute[75571]: INFO nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0e74b078f3fcca0cfbae7446013bda930cad9fda
Nov 28 20:46:47 user nova-compute[75571]: INFO nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/14d248f17ea541e1677c53b6657caaa14a8c262b
Nov 28 20:46:47 user nova-compute[75571]: INFO nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e6099f48fdc9fa43ccc8504641002373d7f7e2fa
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Verification complete {{(pid=75571) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Verify swap images {{(pid=75571) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 28 20:46:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.imagecache [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Verify ephemeral images {{(pid=75571) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 28 20:46:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:46:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:46:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:47:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:47:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:47:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:47:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "29443f30-6d05-4148-9185-a31f78b4a68f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:13 user nova-compute[75571]: INFO nova.compute.manager [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Terminating instance
Nov 28 20:47:13 user nova-compute[75571]: DEBUG nova.compute.manager [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG nova.compute.manager [req-be6c62f0-0746-4b10-a4c8-a400a9b1456a req-e4d2a50b-0c83-4829-85b3-db9ea928844b service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-unplugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-be6c62f0-0746-4b10-a4c8-a400a9b1456a req-e4d2a50b-0c83-4829-85b3-db9ea928844b service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-be6c62f0-0746-4b10-a4c8-a400a9b1456a req-e4d2a50b-0c83-4829-85b3-db9ea928844b service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-be6c62f0-0746-4b10-a4c8-a400a9b1456a req-e4d2a50b-0c83-4829-85b3-db9ea928844b service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG nova.compute.manager [req-be6c62f0-0746-4b10-a4c8-a400a9b1456a req-e4d2a50b-0c83-4829-85b3-db9ea928844b service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-unplugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG nova.compute.manager [req-be6c62f0-0746-4b10-a4c8-a400a9b1456a req-e4d2a50b-0c83-4829-85b3-db9ea928844b service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-unplugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:47:13 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Instance destroyed successfully.
Nov 28 20:47:13 user nova-compute[75571]: DEBUG nova.objects.instance [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'resources' on Instance uuid 29443f30-6d05-4148-9185-a31f78b4a68f {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2038069783',display_name='tempest-ServerRescueNegativeTestJSON-server-2038069783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2038069783',id=35,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d72dc075421c4e7eb9c0ff2bf1641a92',ramdisk_id='',reservation_id='r-vjt3ghjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-506941201',owner_user_name='tempest-ServerRescueNegativeTestJSON-506941201-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:36:59Z,user_data=None,user_id='634123644067453a92f4d43da0b28fa7',uuid=29443f30-6d05-4148-9185-a31f78b4a68f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converting VIF {"id": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "address": "fa:16:3e:cf:2e:94", "network": {"id": "05832c98-5094-434e-8832-8d7b10329513", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1869944619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d72dc075421c4e7eb9c0ff2bf1641a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9deee0-36", "ovs_interfaceid": "ff9deee0-3665-4ae4-864e-1da67b83ccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:2e:94,bridge_name='br-int',has_traffic_filtering=True,id=ff9deee0-3665-4ae4-864e-1da67b83ccd2,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9deee0-36') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG os_vif [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:2e:94,bridge_name='br-int',has_traffic_filtering=True,id=ff9deee0-3665-4ae4-864e-1da67b83ccd2,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9deee0-36') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff9deee0-36, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4dd01b02-3a14-4a92-bf49-c8a44448ed5d) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:47:13 user nova-compute[75571]: INFO os_vif [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:2e:94,bridge_name='br-int',has_traffic_filtering=True,id=ff9deee0-3665-4ae4-864e-1da67b83ccd2,network=Network(05832c98-5094-434e-8832-8d7b10329513),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9deee0-36')
Nov 28 20:47:13 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Deleting instance files /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f_del
Nov 28 20:47:13 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Deletion of /opt/stack/data/nova/instances/29443f30-6d05-4148-9185-a31f78b4a68f_del complete
Nov 28 20:47:13 user nova-compute[75571]: INFO nova.compute.manager [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 28 20:47:13 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:47:13 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:47:14 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:47:14 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Took 0.43 seconds to deallocate network for instance.
Nov 28 20:47:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-c2d3dad3-78fc-41ad-be09-c8afde0705d2 req-f90429cb-1fd8-4ded-9a00-7a18c98e4c50 service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-deleted-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:47:14 user nova-compute[75571]: INFO nova.compute.manager [req-c2d3dad3-78fc-41ad-be09-c8afde0705d2 req-f90429cb-1fd8-4ded-9a00-7a18c98e4c50 service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Neutron deleted interface ff9deee0-3665-4ae4-864e-1da67b83ccd2; detaching it from the instance and deleting it from the info cache
Nov 28 20:47:14 user nova-compute[75571]: DEBUG nova.network.neutron [req-c2d3dad3-78fc-41ad-be09-c8afde0705d2 req-f90429cb-1fd8-4ded-9a00-7a18c98e4c50 service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:47:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-c2d3dad3-78fc-41ad-be09-c8afde0705d2 req-f90429cb-1fd8-4ded-9a00-7a18c98e4c50 service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Detach interface failed, port_id=ff9deee0-3665-4ae4-864e-1da67b83ccd2, reason: Instance 29443f30-6d05-4148-9185-a31f78b4a68f could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:47:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:47:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:47:14 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:47:14 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:47:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:47:14 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Deleted allocations for instance 29443f30-6d05-4148-9185-a31f78b4a68f
Nov 28 20:47:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "29443f30-6d05-4148-9185-a31f78b4a68f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.482s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:47:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-9881bcb2-5492-44a1-a354-e7b889c8dbab req-9c626976-d360-4310-a76e-9add79e205dd service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:47:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9881bcb2-5492-44a1-a354-e7b889c8dbab req-9c626976-d360-4310-a76e-9add79e205dd service nova] Acquiring lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:47:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9881bcb2-5492-44a1-a354-e7b889c8dbab req-9c626976-d360-4310-a76e-9add79e205dd service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:47:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9881bcb2-5492-44a1-a354-e7b889c8dbab req-9c626976-d360-4310-a76e-9add79e205dd service nova] Lock "29443f30-6d05-4148-9185-a31f78b4a68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:47:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-9881bcb2-5492-44a1-a354-e7b889c8dbab req-9c626976-d360-4310-a76e-9add79e205dd service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] No waiting events found dispatching network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:47:15 user nova-compute[75571]: WARNING nova.compute.manager [req-9881bcb2-5492-44a1-a354-e7b889c8dbab req-9c626976-d360-4310-a76e-9add79e205dd service nova] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Received unexpected event network-vif-plugged-ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance with vm_state deleted and task_state None.
Nov 28 20:47:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:21 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:47:21 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:47:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:25 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:47:25 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:47:26 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:47:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:47:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:47:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:47:26 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:47:26 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Updating instance_info_cache with network_info: [{"id": "30bb67dc-9127-4518-917c-fa6fd887c49b", "address": "fa:16:3e:13:4c:d6", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb67dc-91", "ovs_interfaceid": "30bb67dc-9127-4518-917c-fa6fd887c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:47:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:47:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:47:27 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:47:27 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:47:28 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:47:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:47:31 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:47:32 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:47:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:47:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:47:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:47:32 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:47:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:47:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:47:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:47:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:47:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:47:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:47:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:47:33 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:47:33 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:47:33 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=25.00177764892578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing inventories for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating ProviderTree inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing aggregate associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, aggregates: None {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing trait associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:47:33 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:47:34 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:47:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:47:36 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:47:36 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 20:47:36 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] There are 0 instances to clean {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 20:47:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:41 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:47:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75571) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 20:47:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:47:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:47:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-948f89c7-291f-4937-a321-b9f6f9107735 req-aeb36cf8-5688-4a40-98c8-4051ebe3996d service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Received event network-changed-2db490a9-4311-4a10-ba45-0610a87cb422 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-948f89c7-291f-4937-a321-b9f6f9107735 req-aeb36cf8-5688-4a40-98c8-4051ebe3996d service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Refreshing instance network info cache due to event network-changed-2db490a9-4311-4a10-ba45-0610a87cb422. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-948f89c7-291f-4937-a321-b9f6f9107735 req-aeb36cf8-5688-4a40-98c8-4051ebe3996d service nova] Acquiring lock "refresh_cache-876085ae-87cc-4a4d-b4b7-3f595497d6e7" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-948f89c7-291f-4937-a321-b9f6f9107735 req-aeb36cf8-5688-4a40-98c8-4051ebe3996d service nova] Acquired lock "refresh_cache-876085ae-87cc-4a4d-b4b7-3f595497d6e7" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-948f89c7-291f-4937-a321-b9f6f9107735 req-aeb36cf8-5688-4a40-98c8-4051ebe3996d service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Refreshing network info cache for port 2db490a9-4311-4a10-ba45-0610a87cb422 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-948f89c7-291f-4937-a321-b9f6f9107735 req-aeb36cf8-5688-4a40-98c8-4051ebe3996d service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Updated VIF entry in instance network info cache for port 2db490a9-4311-4a10-ba45-0610a87cb422. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-948f89c7-291f-4937-a321-b9f6f9107735 req-aeb36cf8-5688-4a40-98c8-4051ebe3996d service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Updating instance_info_cache with network_info: [{"id": "2db490a9-4311-4a10-ba45-0610a87cb422", "address": "fa:16:3e:f2:8c:59", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db490a9-43", "ovs_interfaceid": "2db490a9-4311-4a10-ba45-0610a87cb422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:47:48 user nova-compute[75571]: INFO nova.compute.manager [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Terminating instance
Nov 28 20:47:48 user nova-compute[75571]: DEBUG nova.compute.manager [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-948f89c7-291f-4937-a321-b9f6f9107735 req-aeb36cf8-5688-4a40-98c8-4051ebe3996d service nova] Releasing lock "refresh_cache-876085ae-87cc-4a4d-b4b7-3f595497d6e7" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-19198d05-5bbe-43d8-85fb-7428160f4017 req-425f70a1-4583-4792-98e7-c82c5cb23f1e service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Received event network-vif-unplugged-2db490a9-4311-4a10-ba45-0610a87cb422 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-19198d05-5bbe-43d8-85fb-7428160f4017 req-425f70a1-4583-4792-98e7-c82c5cb23f1e service nova] Acquiring lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-19198d05-5bbe-43d8-85fb-7428160f4017 req-425f70a1-4583-4792-98e7-c82c5cb23f1e service nova] Lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-19198d05-5bbe-43d8-85fb-7428160f4017 req-425f70a1-4583-4792-98e7-c82c5cb23f1e service nova] Lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-19198d05-5bbe-43d8-85fb-7428160f4017 req-425f70a1-4583-4792-98e7-c82c5cb23f1e service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] No waiting events found dispatching network-vif-unplugged-2db490a9-4311-4a10-ba45-0610a87cb422 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:47:48 user nova-compute[75571]: DEBUG nova.compute.manager [req-19198d05-5bbe-43d8-85fb-7428160f4017 req-425f70a1-4583-4792-98e7-c82c5cb23f1e service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Received event network-vif-unplugged-2db490a9-4311-4a10-ba45-0610a87cb422 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Instance destroyed successfully.
Nov 28 20:47:49 user nova-compute[75571]: DEBUG nova.objects.instance [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'resources' on Instance uuid 876085ae-87cc-4a4d-b4b7-3f595497d6e7 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:45:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-725689161',display_name='tempest-AttachVolumeNegativeTest-server-725689161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-725689161',id=44,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDDuxARll7/LMfz2HOhMx+h1egmbo8MLXcn8TDB+mNo/cPT/oI6Ezwve8HwnVYGVmMFb/zzID1OQQm1/7xa9jTN0HHpsL0zuCZQfCIjJiLFiEe+gATwmZBnGXhmgLGsJg==',key_name='tempest-keypair-1035919865',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:46:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c30c6dea8b148f08d7e5e84757c5e64',ramdisk_id='',reservation_id='r-v0jgglrl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-959194587',owner_user_name='tempest-AttachVolumeNegativeTest-959194587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='409bfc19d682425ea17eda9b336750b4',uuid=876085ae-87cc-4a4d-b4b7-3f595497d6e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2db490a9-4311-4a10-ba45-0610a87cb422", "address": "fa:16:3e:f2:8c:59", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db490a9-43", "ovs_interfaceid": "2db490a9-4311-4a10-ba45-0610a87cb422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converting VIF {"id": "2db490a9-4311-4a10-ba45-0610a87cb422", "address": "fa:16:3e:f2:8c:59", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2db490a9-43", "ovs_interfaceid": "2db490a9-4311-4a10-ba45-0610a87cb422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8c:59,bridge_name='br-int',has_traffic_filtering=True,id=2db490a9-4311-4a10-ba45-0610a87cb422,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2db490a9-43') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG os_vif [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8c:59,bridge_name='br-int',has_traffic_filtering=True,id=2db490a9-4311-4a10-ba45-0610a87cb422,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2db490a9-43') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2db490a9-43, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b009672f-5ca1-47c6-a383-e4f31f203e86) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:49 user nova-compute[75571]: INFO os_vif [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8c:59,bridge_name='br-int',has_traffic_filtering=True,id=2db490a9-4311-4a10-ba45-0610a87cb422,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2db490a9-43')
Nov 28 20:47:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Deleting instance files /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7_del
Nov 28 20:47:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Deletion of /opt/stack/data/nova/instances/876085ae-87cc-4a4d-b4b7-3f595497d6e7_del complete
Nov 28 20:47:49 user nova-compute[75571]: INFO nova.compute.manager [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Took 0.64 seconds to destroy the instance on the hypervisor.
Nov 28 20:47:49 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:47:49 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:47:49 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Took 0.67 seconds to deallocate network for instance.
Nov 28 20:47:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:47:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:47:50 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:47:50 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:47:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:47:50 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Deleted allocations for instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7
Nov 28 20:47:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.634s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:47:50 user nova-compute[75571]: DEBUG nova.compute.manager [req-587c978a-b8ac-47cb-927a-d32c3969ebdb req-92aa76af-867b-4ed7-afdd-4464befb3a40 service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Received event network-vif-plugged-2db490a9-4311-4a10-ba45-0610a87cb422 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:47:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-587c978a-b8ac-47cb-927a-d32c3969ebdb req-92aa76af-867b-4ed7-afdd-4464befb3a40 service nova] Acquiring lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:47:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-587c978a-b8ac-47cb-927a-d32c3969ebdb req-92aa76af-867b-4ed7-afdd-4464befb3a40 service nova] Lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:47:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-587c978a-b8ac-47cb-927a-d32c3969ebdb req-92aa76af-867b-4ed7-afdd-4464befb3a40 service nova] Lock "876085ae-87cc-4a4d-b4b7-3f595497d6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:47:50 user nova-compute[75571]: DEBUG nova.compute.manager [req-587c978a-b8ac-47cb-927a-d32c3969ebdb req-92aa76af-867b-4ed7-afdd-4464befb3a40 service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] No waiting events found dispatching network-vif-plugged-2db490a9-4311-4a10-ba45-0610a87cb422 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:47:50 user nova-compute[75571]: WARNING nova.compute.manager [req-587c978a-b8ac-47cb-927a-d32c3969ebdb req-92aa76af-867b-4ed7-afdd-4464befb3a40 service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Received unexpected event network-vif-plugged-2db490a9-4311-4a10-ba45-0610a87cb422 for instance with vm_state deleted and task_state None.
Nov 28 20:47:51 user nova-compute[75571]: DEBUG nova.compute.manager [req-587c978a-b8ac-47cb-927a-d32c3969ebdb req-92aa76af-867b-4ed7-afdd-4464befb3a40 service nova] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Received event network-vif-deleted-2db490a9-4311-4a10-ba45-0610a87cb422 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:47:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:47:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:48:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:48:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:48:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:48:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:48:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:48:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:48:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:48:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:48:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:48:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:48:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:48:20 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:48:20 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 20:48:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:48:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:48:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:48:22 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:48:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:48:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:48:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:48:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:48:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:48:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:48:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:48:26 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:48:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:48:27 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:48:27 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:48:27 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 20:48:27 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:48:28 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:48:28 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:48:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:48:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:48:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:48:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:48:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:48:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:48:33 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:48:34 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:48:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:48:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:48:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:48:34 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:48:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:48:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:48:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:48:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:48:34 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:48:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:48:34 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:48:34 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:48:34 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=25.027503967285156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:48:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:48:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:48:35 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:48:35 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:48:35 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:48:35 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:48:35 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:48:35 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:48:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:48:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:48:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:48:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:48:39 user nova-compute[75571]: INFO nova.compute.manager [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Detaching volume a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7
Nov 28 20:48:40 user nova-compute[75571]: INFO nova.virt.block_device [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Attempting to driver detach volume a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 from mountpoint /dev/vdb
Nov 28 20:48:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Attempting to detach device vdb from instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:48:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:48:40 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:48:40 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:48:40 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:48:40 user nova-compute[75571]:   <serial>a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7</serial>
Nov 28 20:48:40 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:48:40 user nova-compute[75571]: </disk>
Nov 28 20:48:40 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:48:40 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Successfully detached device vdb from instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd from the persistent domain config.
Nov 28 20:48:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:48:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:48:40 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:48:40 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:48:40 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:48:40 user nova-compute[75571]:   <serial>a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7</serial>
Nov 28 20:48:40 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:48:40 user nova-compute[75571]: </disk>
Nov 28 20:48:40 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:48:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:48:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:48:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:48:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:48:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:48:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:48:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:48:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:48:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:48:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:00 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd is timed out.
Nov 28 20:49:00 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Successfully detached device vdb from instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd from the live domain config.
Nov 28 20:49:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNHfwRno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:49:00 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8f54ac-990f-4d87-8eb5-d9a5303edbd9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:49:00 user nova-compute[75571]: No targets found.
Nov 28 20:49:00 user nova-compute[75571]: iSNS:
Nov 28 20:49:00 user nova-compute[75571]: No targets found.
Nov 28 20:49:00 user nova-compute[75571]: STATIC:
Nov 28 20:49:00 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7
Nov 28 20:49:00 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:49:00 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:49:00 user nova-compute[75571]: FIRMWARE:
Nov 28 20:49:00 user nova-compute[75571]: No targets found.
Nov 28 20:49:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:49:00 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:49:00 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f836d2c6-9999-4797-bc3b-4838b5cd0410]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1037855-f114-4a95-b486-97c99d6804e8]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 (non-flash)
Nov 28 20:49:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 (non-flash)
Nov 28 20:49:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77486632e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbb215c-b73c-4c7d-950b-3f6310768407]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[024d3e82-3c76-4e05-92dd-ae3645368a17]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e67613b-cfb0-4e25-8b58-79055bc9f433]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[597065ed-e7df-4100-86d8-5f73a3c153a7]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc0d907-8a07-4ae1-89f7-1945b32785f1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b893d2bf-1d0e-4565-a9f6-c269f47a16e9]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7, portal: 172.16.0.220,3260]
Nov 28 20:49:00 user nova-compute[75571]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7, portal: 172.16.0.220,3260] successful.
Nov 28 20:49:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3e67d3-cad3-48ce-87ed-b1705dfb01cb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] <== disconnect_volume: return (286ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:49:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:49:01 user nova-compute[75571]: DEBUG nova.objects.instance [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'flavor' on Instance uuid 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:49:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.778s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:49:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:49:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:49:24 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:49:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:49:27 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:49:27 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:49:28 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:49:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:49:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:49:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:49:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:49:28 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:49:28 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:49:28 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Updating instance_info_cache with network_info: [{"id": "30bb67dc-9127-4518-917c-fa6fd887c49b", "address": "fa:16:3e:13:4c:d6", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb67dc-91", "ovs_interfaceid": "30bb67dc-9127-4518-917c-fa6fd887c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:49:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:49:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:49:28 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:49:29 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:49:29 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:49:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:49:30 user nova-compute[75571]: INFO nova.compute.manager [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Terminating instance
Nov 28 20:49:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG nova.compute.manager [req-d887a0f2-4256-464d-a4af-afcf00d689cc req-e1cf7695-de6c-4829-8754-93c0dba4d911 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Received event network-vif-unplugged-30bb67dc-9127-4518-917c-fa6fd887c49b {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d887a0f2-4256-464d-a4af-afcf00d689cc req-e1cf7695-de6c-4829-8754-93c0dba4d911 service nova] Acquiring lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d887a0f2-4256-464d-a4af-afcf00d689cc req-e1cf7695-de6c-4829-8754-93c0dba4d911 service nova] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d887a0f2-4256-464d-a4af-afcf00d689cc req-e1cf7695-de6c-4829-8754-93c0dba4d911 service nova] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG nova.compute.manager [req-d887a0f2-4256-464d-a4af-afcf00d689cc req-e1cf7695-de6c-4829-8754-93c0dba4d911 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] No waiting events found dispatching network-vif-unplugged-30bb67dc-9127-4518-917c-fa6fd887c49b {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:49:30 user nova-compute[75571]: DEBUG nova.compute.manager [req-d887a0f2-4256-464d-a4af-afcf00d689cc req-e1cf7695-de6c-4829-8754-93c0dba4d911 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Received event network-vif-unplugged-30bb67dc-9127-4518-917c-fa6fd887c49b for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:49:31 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Instance destroyed successfully.
Nov 28 20:49:31 user nova-compute[75571]: DEBUG nova.objects.instance [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'resources' on Instance uuid 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:49:31 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1667927386',display_name='tempest-AttachVolumeNegativeTest-server-1667927386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1667927386',id=43,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/46ePml504hPEHQqQwlHayTrpifeFxrkouprNVaZfmM9bJRT8L0UdcDEGRU5k63AL7fQj7CVe1Xm846FrrhiuRF0lBW8FhtlmCqASIwliEtIjLrn1+aKhzX1DPEraxhg==',key_name='tempest-keypair-2067019178',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:43:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c30c6dea8b148f08d7e5e84757c5e64',ramdisk_id='',reservation_id='r-i8h0b7zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-959194587',owner_user_name='tempest-AttachVolumeNegativeTest-959194587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:43:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='409bfc19d682425ea17eda9b336750b4',uuid=99d47cb6-b685-4b05-a93b-7c9efdd3e4bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30bb67dc-9127-4518-917c-fa6fd887c49b", "address": "fa:16:3e:13:4c:d6", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb67dc-91", "ovs_interfaceid": "30bb67dc-9127-4518-917c-fa6fd887c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:49:31 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converting VIF {"id": "30bb67dc-9127-4518-917c-fa6fd887c49b", "address": "fa:16:3e:13:4c:d6", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb67dc-91", "ovs_interfaceid": "30bb67dc-9127-4518-917c-fa6fd887c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:49:31 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:4c:d6,bridge_name='br-int',has_traffic_filtering=True,id=30bb67dc-9127-4518-917c-fa6fd887c49b,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bb67dc-91') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:49:31 user nova-compute[75571]: DEBUG os_vif [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:4c:d6,bridge_name='br-int',has_traffic_filtering=True,id=30bb67dc-9127-4518-917c-fa6fd887c49b,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bb67dc-91') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:49:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30bb67dc-91, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:49:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:49:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c11deeeb-f80e-480b-8a7b-825f7e0d6ff5) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:49:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:49:31 user nova-compute[75571]: INFO os_vif [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:4c:d6,bridge_name='br-int',has_traffic_filtering=True,id=30bb67dc-9127-4518-917c-fa6fd887c49b,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bb67dc-91')
Nov 28 20:49:31 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Deleting instance files /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd_del
Nov 28 20:49:31 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Deletion of /opt/stack/data/nova/instances/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd_del complete
Nov 28 20:49:31 user nova-compute[75571]: INFO nova.compute.manager [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 20:49:31 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:49:31 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:49:31 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:49:32 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:49:32 user nova-compute[75571]: DEBUG nova.compute.manager [req-6bc37faf-9b7e-4410-824a-522be8900529 req-cfbc83ec-5851-4def-92ea-136f590a3b6c service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Received event network-vif-deleted-30bb67dc-9127-4518-917c-fa6fd887c49b {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:49:32 user nova-compute[75571]: INFO nova.compute.manager [req-6bc37faf-9b7e-4410-824a-522be8900529 req-cfbc83ec-5851-4def-92ea-136f590a3b6c service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Neutron deleted interface 30bb67dc-9127-4518-917c-fa6fd887c49b; detaching it from the instance and deleting it from the info cache
Nov 28 20:49:32 user nova-compute[75571]: DEBUG nova.network.neutron [req-6bc37faf-9b7e-4410-824a-522be8900529 req-cfbc83ec-5851-4def-92ea-136f590a3b6c service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:49:32 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Took 1.19 seconds to deallocate network for instance.
Nov 28 20:49:32 user nova-compute[75571]: DEBUG nova.compute.manager [req-6bc37faf-9b7e-4410-824a-522be8900529 req-cfbc83ec-5851-4def-92ea-136f590a3b6c service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Detach interface failed, port_id=30bb67dc-9127-4518-917c-fa6fd887c49b, reason: Instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:49:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:49:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:49:32 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:49:32 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:49:32 user nova-compute[75571]: DEBUG nova.compute.manager [req-cdca7723-77c8-4252-8d8d-74a853a6ed49 req-bfb19a17-73c0-4007-a065-4439ac427ff4 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Received event network-vif-plugged-30bb67dc-9127-4518-917c-fa6fd887c49b {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:49:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cdca7723-77c8-4252-8d8d-74a853a6ed49 req-bfb19a17-73c0-4007-a065-4439ac427ff4 service nova] Acquiring lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:49:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cdca7723-77c8-4252-8d8d-74a853a6ed49 req-bfb19a17-73c0-4007-a065-4439ac427ff4 service nova] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:49:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cdca7723-77c8-4252-8d8d-74a853a6ed49 req-bfb19a17-73c0-4007-a065-4439ac427ff4 service nova] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:49:32 user nova-compute[75571]: DEBUG nova.compute.manager [req-cdca7723-77c8-4252-8d8d-74a853a6ed49 req-bfb19a17-73c0-4007-a065-4439ac427ff4 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] No waiting events found dispatching network-vif-plugged-30bb67dc-9127-4518-917c-fa6fd887c49b {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:49:32 user nova-compute[75571]: WARNING nova.compute.manager [req-cdca7723-77c8-4252-8d8d-74a853a6ed49 req-bfb19a17-73c0-4007-a065-4439ac427ff4 service nova] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Received unexpected event network-vif-plugged-30bb67dc-9127-4518-917c-fa6fd887c49b for instance with vm_state deleted and task_state None.
Nov 28 20:49:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:49:32 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Deleted allocations for instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd
Nov 28 20:49:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.452s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:49:34 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:49:34 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:49:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:49:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:49:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:49:34 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:49:34 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:49:34 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:49:34 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9097MB free_disk=25.04552459716797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:49:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:49:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:49:34 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:49:34 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:49:34 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:49:34 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:49:34 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:49:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:49:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:49:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:49:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:49:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:49:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:49:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:49:52 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:49:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:49:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:50:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:50:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:50:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:50:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:50:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:50:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:50:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:50:22 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG nova.compute.manager [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:50:24 user nova-compute[75571]: INFO nova.compute.claims [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Claim successful on node user
Nov 28 20:50:24 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG nova.compute.manager [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG nova.compute.manager [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG nova.network.neutron [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:50:24 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:50:24 user nova-compute[75571]: DEBUG nova.compute.manager [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG nova.policy [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG nova.compute.manager [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:50:24 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Creating image(s)
Nov 28 20:50:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "/opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "/opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "/opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.190s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:50:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk 1073741824" returned: 0 in 0.053s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG nova.network.neutron [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Successfully created port: e520ab2e-827e-49ed-974d-ab6828753ea6 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Cannot resize image /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Ensure instance console log exists: /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG nova.network.neutron [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Successfully updated port: e520ab2e-827e-49ed-974d-ab6828753ea6 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquired lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG nova.network.neutron [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG nova.network.neutron [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG nova.compute.manager [req-78bbebc8-e9fc-4e06-91c1-bb50e46c14ce req-07d81709-e1a8-48c6-a82e-ec616a2c4f2d service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Received event network-changed-e520ab2e-827e-49ed-974d-ab6828753ea6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG nova.compute.manager [req-78bbebc8-e9fc-4e06-91c1-bb50e46c14ce req-07d81709-e1a8-48c6-a82e-ec616a2c4f2d service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Refreshing instance network info cache due to event network-changed-e520ab2e-827e-49ed-974d-ab6828753ea6. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:50:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-78bbebc8-e9fc-4e06-91c1-bb50e46c14ce req-07d81709-e1a8-48c6-a82e-ec616a2c4f2d service nova] Acquiring lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.network.neutron [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Updating instance_info_cache with network_info: [{"id": "e520ab2e-827e-49ed-974d-ab6828753ea6", "address": "fa:16:3e:ba:22:f2", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape520ab2e-82", "ovs_interfaceid": "e520ab2e-827e-49ed-974d-ab6828753ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Releasing lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Instance network_info: |[{"id": "e520ab2e-827e-49ed-974d-ab6828753ea6", "address": "fa:16:3e:ba:22:f2", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape520ab2e-82", "ovs_interfaceid": "e520ab2e-827e-49ed-974d-ab6828753ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-78bbebc8-e9fc-4e06-91c1-bb50e46c14ce req-07d81709-e1a8-48c6-a82e-ec616a2c4f2d service nova] Acquired lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.network.neutron [req-78bbebc8-e9fc-4e06-91c1-bb50e46c14ce req-07d81709-e1a8-48c6-a82e-ec616a2c4f2d service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Refreshing network info cache for port e520ab2e-827e-49ed-974d-ab6828753ea6 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Start _get_guest_xml network_info=[{"id": "e520ab2e-827e-49ed-974d-ab6828753ea6", "address": "fa:16:3e:ba:22:f2", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape520ab2e-82", "ovs_interfaceid": "e520ab2e-827e-49ed-974d-ab6828753ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:50:26 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:50:26 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:50:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-556641452',display_name='tempest-AttachVolumeNegativeTest-server-556641452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-556641452',id=45,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzt+rvlu8IOwBMKEhMCcxSM5mRgkamAdD+fA49z5exaxi9GSu94u7hWGILlxAg7fxju8bk4UBIUtwAMFZ7Vzf1XpwpnQC9PZEkH0cOGYdYuiAGfClWnaAV61r4sPVb6xA==',key_name='tempest-keypair-1955953124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c30c6dea8b148f08d7e5e84757c5e64',ramdisk_id='',reservation_id='r-0lzluxtv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-959194587',owner_user_name='tempest-AttachVolumeNegativeTest-959194587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:50:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='409bfc19d682425ea17eda9b336750b4',uuid=03e1aaf1-d8c2-4bc0-934b-00d8961cd368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e520ab2e-827e-49ed-974d-ab6828753ea6", "address": "fa:16:3e:ba:22:f2", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape520ab2e-82", "ovs_interfaceid": "e520ab2e-827e-49ed-974d-ab6828753ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converting VIF {"id": "e520ab2e-827e-49ed-974d-ab6828753ea6", "address": "fa:16:3e:ba:22:f2", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape520ab2e-82", "ovs_interfaceid": "e520ab2e-827e-49ed-974d-ab6828753ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:22:f2,bridge_name='br-int',has_traffic_filtering=True,id=e520ab2e-827e-49ed-974d-ab6828753ea6,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape520ab2e-82') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.objects.instance [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'pci_devices' on Instance uuid 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:50:26 user nova-compute[75571]:   <uuid>03e1aaf1-d8c2-4bc0-934b-00d8961cd368</uuid>
Nov 28 20:50:26 user nova-compute[75571]:   <name>instance-0000002d</name>
Nov 28 20:50:26 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:50:26 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:50:26 user nova-compute[75571]:   <metadata>
Nov 28 20:50:26 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:50:26 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:50:26 user nova-compute[75571]:       <nova:name>tempest-AttachVolumeNegativeTest-server-556641452</nova:name>
Nov 28 20:50:26 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:50:26</nova:creationTime>
Nov 28 20:50:26 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:50:26 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:50:26 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:50:26 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:50:26 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:50:26 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:50:26 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:50:26 user nova-compute[75571]:       <nova:owner>
Nov 28 20:50:26 user nova-compute[75571]:         <nova:user uuid="409bfc19d682425ea17eda9b336750b4">tempest-AttachVolumeNegativeTest-959194587-project-member</nova:user>
Nov 28 20:50:26 user nova-compute[75571]:         <nova:project uuid="9c30c6dea8b148f08d7e5e84757c5e64">tempest-AttachVolumeNegativeTest-959194587</nova:project>
Nov 28 20:50:26 user nova-compute[75571]:       </nova:owner>
Nov 28 20:50:26 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:50:26 user nova-compute[75571]:       <nova:ports>
Nov 28 20:50:26 user nova-compute[75571]:         <nova:port uuid="e520ab2e-827e-49ed-974d-ab6828753ea6">
Nov 28 20:50:26 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 20:50:26 user nova-compute[75571]:         </nova:port>
Nov 28 20:50:26 user nova-compute[75571]:       </nova:ports>
Nov 28 20:50:26 user nova-compute[75571]:     </nova:instance>
Nov 28 20:50:26 user nova-compute[75571]:   </metadata>
Nov 28 20:50:26 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:50:26 user nova-compute[75571]:     <system>
Nov 28 20:50:26 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:50:26 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:50:26 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:50:26 user nova-compute[75571]:       <entry name="serial">03e1aaf1-d8c2-4bc0-934b-00d8961cd368</entry>
Nov 28 20:50:26 user nova-compute[75571]:       <entry name="uuid">03e1aaf1-d8c2-4bc0-934b-00d8961cd368</entry>
Nov 28 20:50:26 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:50:26 user nova-compute[75571]:     </system>
Nov 28 20:50:26 user nova-compute[75571]:   </sysinfo>
Nov 28 20:50:26 user nova-compute[75571]:   <os>
Nov 28 20:50:26 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:50:26 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:50:26 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:50:26 user nova-compute[75571]:   </os>
Nov 28 20:50:26 user nova-compute[75571]:   <features>
Nov 28 20:50:26 user nova-compute[75571]:     <acpi/>
Nov 28 20:50:26 user nova-compute[75571]:     <apic/>
Nov 28 20:50:26 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:50:26 user nova-compute[75571]:   </features>
Nov 28 20:50:26 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:50:26 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:50:26 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:50:26 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:50:26 user nova-compute[75571]:   </clock>
Nov 28 20:50:26 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:50:26 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:50:26 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:50:26 user nova-compute[75571]:   </cpu>
Nov 28 20:50:26 user nova-compute[75571]:   <devices>
Nov 28 20:50:26 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:50:26 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:50:26 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk"/>
Nov 28 20:50:26 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:50:26 user nova-compute[75571]:     </disk>
Nov 28 20:50:26 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:50:26 user nova-compute[75571]:       <mac address="fa:16:3e:ba:22:f2"/>
Nov 28 20:50:26 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:50:26 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:50:26 user nova-compute[75571]:       <target dev="tape520ab2e-82"/>
Nov 28 20:50:26 user nova-compute[75571]:     </interface>
Nov 28 20:50:26 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:50:26 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/console.log" append="off"/>
Nov 28 20:50:26 user nova-compute[75571]:     </serial>
Nov 28 20:50:26 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:50:26 user nova-compute[75571]:     <video>
Nov 28 20:50:26 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:50:26 user nova-compute[75571]:     </video>
Nov 28 20:50:26 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:50:26 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:50:26 user nova-compute[75571]:     </rng>
Nov 28 20:50:26 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:50:26 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:50:26 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:50:26 user nova-compute[75571]:     </memballoon>
Nov 28 20:50:26 user nova-compute[75571]:   </devices>
Nov 28 20:50:26 user nova-compute[75571]: </domain>
Nov 28 20:50:26 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:50:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-556641452',display_name='tempest-AttachVolumeNegativeTest-server-556641452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-556641452',id=45,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzt+rvlu8IOwBMKEhMCcxSM5mRgkamAdD+fA49z5exaxi9GSu94u7hWGILlxAg7fxju8bk4UBIUtwAMFZ7Vzf1XpwpnQC9PZEkH0cOGYdYuiAGfClWnaAV61r4sPVb6xA==',key_name='tempest-keypair-1955953124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c30c6dea8b148f08d7e5e84757c5e64',ramdisk_id='',reservation_id='r-0lzluxtv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-959194587',owner_user_name='tempest-AttachVolumeNegativeTest-959194587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:50:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='409bfc19d682425ea17eda9b336750b4',uuid=03e1aaf1-d8c2-4bc0-934b-00d8961cd368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e520ab2e-827e-49ed-974d-ab6828753ea6", "address": "fa:16:3e:ba:22:f2", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape520ab2e-82", "ovs_interfaceid": "e520ab2e-827e-49ed-974d-ab6828753ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converting VIF {"id": "e520ab2e-827e-49ed-974d-ab6828753ea6", "address": "fa:16:3e:ba:22:f2", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape520ab2e-82", "ovs_interfaceid": "e520ab2e-827e-49ed-974d-ab6828753ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:22:f2,bridge_name='br-int',has_traffic_filtering=True,id=e520ab2e-827e-49ed-974d-ab6828753ea6,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape520ab2e-82') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG os_vif [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:22:f2,bridge_name='br-int',has_traffic_filtering=True,id=e520ab2e-827e-49ed-974d-ab6828753ea6,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape520ab2e-82') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba5a5f1f-7c55-5850-af95-25b14361fa62', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape520ab2e-82, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape520ab2e-82, col_values=(('qos', UUID('d031efd8-3634-4ee4-88e2-ff19e4b7db11')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape520ab2e-82, col_values=(('external_ids', {'iface-id': 'e520ab2e-827e-49ed-974d-ab6828753ea6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:22:f2', 'vm-uuid': '03e1aaf1-d8c2-4bc0-934b-00d8961cd368'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:26 user nova-compute[75571]: INFO os_vif [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:22:f2,bridge_name='br-int',has_traffic_filtering=True,id=e520ab2e-827e-49ed-974d-ab6828753ea6,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape520ab2e-82')
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No VIF found with MAC fa:16:3e:ba:22:f2, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.network.neutron [req-78bbebc8-e9fc-4e06-91c1-bb50e46c14ce req-07d81709-e1a8-48c6-a82e-ec616a2c4f2d service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Updated VIF entry in instance network info cache for port e520ab2e-827e-49ed-974d-ab6828753ea6. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG nova.network.neutron [req-78bbebc8-e9fc-4e06-91c1-bb50e46c14ce req-07d81709-e1a8-48c6-a82e-ec616a2c4f2d service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Updating instance_info_cache with network_info: [{"id": "e520ab2e-827e-49ed-974d-ab6828753ea6", "address": "fa:16:3e:ba:22:f2", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape520ab2e-82", "ovs_interfaceid": "e520ab2e-827e-49ed-974d-ab6828753ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:50:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-78bbebc8-e9fc-4e06-91c1-bb50e46c14ce req-07d81709-e1a8-48c6-a82e-ec616a2c4f2d service nova] Releasing lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:50:27 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:50:27 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:50:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-4eb5c4b7-808c-48c8-a9c4-32d0a4626d13 req-b2f01166-7956-4a69-90ca-4b344cb0eb44 service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Received event network-vif-plugged-e520ab2e-827e-49ed-974d-ab6828753ea6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:50:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4eb5c4b7-808c-48c8-a9c4-32d0a4626d13 req-b2f01166-7956-4a69-90ca-4b344cb0eb44 service nova] Acquiring lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:50:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4eb5c4b7-808c-48c8-a9c4-32d0a4626d13 req-b2f01166-7956-4a69-90ca-4b344cb0eb44 service nova] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:50:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-4eb5c4b7-808c-48c8-a9c4-32d0a4626d13 req-b2f01166-7956-4a69-90ca-4b344cb0eb44 service nova] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:50:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-4eb5c4b7-808c-48c8-a9c4-32d0a4626d13 req-b2f01166-7956-4a69-90ca-4b344cb0eb44 service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] No waiting events found dispatching network-vif-plugged-e520ab2e-827e-49ed-974d-ab6828753ea6 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:50:27 user nova-compute[75571]: WARNING nova.compute.manager [req-4eb5c4b7-808c-48c8-a9c4-32d0a4626d13 req-b2f01166-7956-4a69-90ca-4b344cb0eb44 service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Received unexpected event network-vif-plugged-e520ab2e-827e-49ed-974d-ab6828753ea6 for instance with vm_state building and task_state spawning.
Nov 28 20:50:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:29 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:50:29 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:50:29 user nova-compute[75571]: DEBUG nova.compute.manager [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:50:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:50:29 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Instance spawned successfully.
Nov 28 20:50:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:50:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:50:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:50:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:50:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:50:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:50:29 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:50:29 user nova-compute[75571]: INFO nova.compute.manager [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 28 20:50:29 user nova-compute[75571]: DEBUG nova.compute.manager [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:50:29 user nova-compute[75571]: INFO nova.compute.manager [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Took 5.54 seconds to build instance.
Nov 28 20:50:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.640s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:50:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-47c08a1a-11ff-4399-b2ef-18fe366ab088 req-60e3647a-8058-429a-a5e0-de19c4771cd1 service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Received event network-vif-plugged-e520ab2e-827e-49ed-974d-ab6828753ea6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:50:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-47c08a1a-11ff-4399-b2ef-18fe366ab088 req-60e3647a-8058-429a-a5e0-de19c4771cd1 service nova] Acquiring lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:50:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-47c08a1a-11ff-4399-b2ef-18fe366ab088 req-60e3647a-8058-429a-a5e0-de19c4771cd1 service nova] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:50:29 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-47c08a1a-11ff-4399-b2ef-18fe366ab088 req-60e3647a-8058-429a-a5e0-de19c4771cd1 service nova] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:50:29 user nova-compute[75571]: DEBUG nova.compute.manager [req-47c08a1a-11ff-4399-b2ef-18fe366ab088 req-60e3647a-8058-429a-a5e0-de19c4771cd1 service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] No waiting events found dispatching network-vif-plugged-e520ab2e-827e-49ed-974d-ab6828753ea6 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:50:29 user nova-compute[75571]: WARNING nova.compute.manager [req-47c08a1a-11ff-4399-b2ef-18fe366ab088 req-60e3647a-8058-429a-a5e0-de19c4771cd1 service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Received unexpected event network-vif-plugged-e520ab2e-827e-49ed-974d-ab6828753ea6 for instance with vm_state active and task_state None.
Nov 28 20:50:30 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:50:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:50:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:50:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:50:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:50:30 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:50:30 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:50:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:30 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Updating instance_info_cache with network_info: [{"id": "e520ab2e-827e-49ed-974d-ab6828753ea6", "address": "fa:16:3e:ba:22:f2", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape520ab2e-82", "ovs_interfaceid": "e520ab2e-827e-49ed-974d-ab6828753ea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:50:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:50:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:50:31 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:50:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:50:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:50:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:50:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:50:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:50:35 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:50:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:50:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:50:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:50:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:50:35 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:50:35 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:50:35 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9111MB free_disk=25.043121337890625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:50:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:50:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:50:36 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:50:36 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:50:36 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:50:36 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:50:36 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:50:36 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:50:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:50:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:50:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:51:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:51:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:51:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:51:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:51:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:51:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:51:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:51:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:51:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:51:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:51:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:51:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:51:26 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:51:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:51:27 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:51:27 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:51:29 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:51:31 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:51:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:51:32 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:51:32 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:51:32 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:51:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:51:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:51:32 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:51:32 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:51:32 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Updating instance_info_cache with network_info: [{"id": "e520ab2e-827e-49ed-974d-ab6828753ea6", "address": "fa:16:3e:ba:22:f2", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape520ab2e-82", "ovs_interfaceid": "e520ab2e-827e-49ed-974d-ab6828753ea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:51:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:51:32 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:51:33 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:51:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:51:36 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:51:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:51:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:51:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:51:36 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:51:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:51:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:51:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:51:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:51:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:51:36 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:51:36 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:51:36 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9077MB free_disk=25.014728546142578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:51:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:51:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:51:37 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:51:37 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:51:37 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:51:37 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:51:37 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:51:37 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:51:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:51:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:51:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:51:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:51:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:51:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:52:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:52:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:52:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:52:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-264c0834-6da6-4d2e-b6e9-e741e816eaaa req-5879e60b-3460-48b0-a59e-ab080ec66afb service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Received event network-changed-e520ab2e-827e-49ed-974d-ab6828753ea6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:52:15 user nova-compute[75571]: DEBUG nova.compute.manager [req-264c0834-6da6-4d2e-b6e9-e741e816eaaa req-5879e60b-3460-48b0-a59e-ab080ec66afb service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Refreshing instance network info cache due to event network-changed-e520ab2e-827e-49ed-974d-ab6828753ea6. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:52:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-264c0834-6da6-4d2e-b6e9-e741e816eaaa req-5879e60b-3460-48b0-a59e-ab080ec66afb service nova] Acquiring lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:52:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-264c0834-6da6-4d2e-b6e9-e741e816eaaa req-5879e60b-3460-48b0-a59e-ab080ec66afb service nova] Acquired lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:52:15 user nova-compute[75571]: DEBUG nova.network.neutron [req-264c0834-6da6-4d2e-b6e9-e741e816eaaa req-5879e60b-3460-48b0-a59e-ab080ec66afb service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Refreshing network info cache for port e520ab2e-827e-49ed-974d-ab6828753ea6 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:52:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:52:15 user nova-compute[75571]: DEBUG nova.network.neutron [req-264c0834-6da6-4d2e-b6e9-e741e816eaaa req-5879e60b-3460-48b0-a59e-ab080ec66afb service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Updated VIF entry in instance network info cache for port e520ab2e-827e-49ed-974d-ab6828753ea6. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:52:15 user nova-compute[75571]: DEBUG nova.network.neutron [req-264c0834-6da6-4d2e-b6e9-e741e816eaaa req-5879e60b-3460-48b0-a59e-ab080ec66afb service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Updating instance_info_cache with network_info: [{"id": "e520ab2e-827e-49ed-974d-ab6828753ea6", "address": "fa:16:3e:ba:22:f2", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape520ab2e-82", "ovs_interfaceid": "e520ab2e-827e-49ed-974d-ab6828753ea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:52:15 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-264c0834-6da6-4d2e-b6e9-e741e816eaaa req-5879e60b-3460-48b0-a59e-ab080ec66afb service nova] Releasing lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:52:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG nova.objects.instance [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'flavor' on Instance uuid 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:52:17 user nova-compute[75571]: INFO nova.compute.manager [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Attaching volume c63126b0-6d74-48cc-8d86-3448671163aa to /dev/vdb
Nov 28 20:52:17 user nova-compute[75571]: DEBUG os_brick.utils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[428e489f-4f61-4797-91db-c2194921db6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b94589-9ef0-4454-9a2a-638fe569af48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf22a1b-f456-430c-ad2c-675c5c75923e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a867ed-dd33-4e58-904a-0b38306a9580]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:52:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:52:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:52:18 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:52:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a15860-3c9b-4c6b-b1e2-26148d1ad008]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:52:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:52:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:52:18 user nova-compute[75571]: DEBUG os_brick.utils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:52:18 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Updating existing volume attachment record: 1a74f41b-0f93-4cf7-b9ad-746c64c327e5 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:52:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:52:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:52:22 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crzdlvty', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:52:24 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:52:24 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:52:24 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2952e5-4153-4305-a682-40efafcbec76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:52:24 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e69b995-3c4c-4124-96c3-c1b6f7134bd6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa] added
Nov 28 20:52:24 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb94d6f-9eaa-43db-b7ea-a8ada5ad5c85]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e39d0e2-71e9-4c52-a6a7-29c1484ba786]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crzdlvty {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crzdlvty" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[515ebd6a-8956-46cd-ab46-246a399cf03a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'crzdlvty'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad320a4-5f54-4e8f-9651-904166792b00]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e2a6b7-90c5-4834-a837-39810abdd8b2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:52:24 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:52:24 user nova-compute[75571]:  {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:52:24 user nova-compute[75571]: WARNING os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 20:52:24 user nova-compute[75571]: 
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a14b8e-edff-4f56-80b3-f93a0a8ec60b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa, portal: 172.16.0.220,3260]
Nov 28 20:52:24 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa, portal: 172.16.0.220,3260] successful.
Nov 28 20:52:24 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0971b3-a139-41d1-a3d7-d433258952cb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7046c2a-6cf0-4b38-b014-70fa7a3682f4]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa (non-flash)
Nov 28 20:52:24 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa (non-flash)
Nov 28 20:52:24 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c433389-9d38-4a8b-aa0b-9365ad854570]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:24 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:52:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:52:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:52:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crzdlvty', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:52:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:52:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23630653831313965', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:52:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630653831313965', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:52:25 user nova-compute[75571]: DEBUG nova.objects.instance [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'flavor' on Instance uuid 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:52:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:52:25 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:52:25 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:52:25 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:52:25 user nova-compute[75571]:   <serial>c63126b0-6d74-48cc-8d86-3448671163aa</serial>
Nov 28 20:52:25 user nova-compute[75571]: </disk>
Nov 28 20:52:25 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:52:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:52:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:52:26 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No VIF found with MAC fa:16:3e:ba:22:f2, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:52:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:52:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.396s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:52:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:52:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:52:26 user nova-compute[75571]: INFO nova.compute.manager [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Detaching volume c63126b0-6d74-48cc-8d86-3448671163aa
Nov 28 20:52:27 user nova-compute[75571]: INFO nova.virt.block_device [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Attempting to driver detach volume c63126b0-6d74-48cc-8d86-3448671163aa from mountpoint /dev/vdb
Nov 28 20:52:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Attempting to detach device vdb from instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:52:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:52:27 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:52:27 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:52:27 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:52:27 user nova-compute[75571]:   <serial>c63126b0-6d74-48cc-8d86-3448671163aa</serial>
Nov 28 20:52:27 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:52:27 user nova-compute[75571]: </disk>
Nov 28 20:52:27 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:52:27 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Successfully detached device vdb from instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 from the persistent domain config.
Nov 28 20:52:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:52:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:52:27 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:52:27 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:52:27 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:52:27 user nova-compute[75571]:   <serial>c63126b0-6d74-48cc-8d86-3448671163aa</serial>
Nov 28 20:52:27 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:52:27 user nova-compute[75571]: </disk>
Nov 28 20:52:27 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:52:27 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:52:27 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:52:28 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:52:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:52:29 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:52:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:52:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:52:33 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:52:33 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:52:33 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:52:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:52:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:52:33 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:52:33 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:52:33 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Updating instance_info_cache with network_info: [{"id": "e520ab2e-827e-49ed-974d-ab6828753ea6", "address": "fa:16:3e:ba:22:f2", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape520ab2e-82", "ovs_interfaceid": "e520ab2e-827e-49ed-974d-ab6828753ea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:52:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-03e1aaf1-d8c2-4bc0-934b-00d8961cd368" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:52:33 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:52:33 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:52:33 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:52:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:52:36 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:52:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:52:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:52:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:52:36 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:52:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:52:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:36 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:36 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:52:36 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:52:36 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9046MB free_disk=25.013713836669922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:52:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:52:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:52:37 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:52:37 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:52:37 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:52:37 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing inventories for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 20:52:37 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating ProviderTree inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 20:52:37 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 20:52:37 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing aggregate associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, aggregates: None {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 20:52:37 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing trait associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 20:52:37 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:52:37 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:52:37 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:52:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:52:40 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:52:40 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 20:52:40 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] There are 0 instances to clean {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 20:52:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:52:42 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:52:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75571) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 20:52:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:52:47 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 is timed out.
Nov 28 20:52:47 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Successfully detached device vdb from instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 from the live domain config.
Nov 28 20:52:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crzdlvty', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:52:47 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f03ecc-ea0e-4115-829b-bb3bad62317b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:52:47 user nova-compute[75571]: No targets found.
Nov 28 20:52:47 user nova-compute[75571]: iSNS:
Nov 28 20:52:47 user nova-compute[75571]: No targets found.
Nov 28 20:52:47 user nova-compute[75571]: STATIC:
Nov 28 20:52:47 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa
Nov 28 20:52:47 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:52:47 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:52:47 user nova-compute[75571]: FIRMWARE:
Nov 28 20:52:47 user nova-compute[75571]: No targets found.
Nov 28 20:52:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:52:47 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:52:47 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d03001-6d4e-4de4-ab8b-e84e705dfda9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[444cdb51-177a-4a41-b22d-826249209195]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa (non-flash)
Nov 28 20:52:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa (non-flash)
Nov 28 20:52:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768565c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2792f3bf-e126-4164-8129-dfdbfefa9855]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbb8c09-e66b-46d2-99ec-62a957df5c9d]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5308809c-4dc2-4a81-88b5-e173944455af]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d711669-4a4b-4e95-8ec4-978d073942ea]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[973cdc89-c0c6-4def-9d4f-cb2f0533e942]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[933f2cc2-a3f3-496d-b8c2-9aaa1a8bdeef]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa, portal: 172.16.0.220,3260]
Nov 28 20:52:47 user nova-compute[75571]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa, portal: 172.16.0.220,3260] successful.
Nov 28 20:52:47 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63126b0-6d74-48cc-8d86-3448671163aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b964e67-25eb-4af5-b4e3-a719ccc6d6fa]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] <== disconnect_volume: return (298ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:52:47 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:52:48 user nova-compute[75571]: DEBUG nova.objects.instance [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'flavor' on Instance uuid 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:52:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.818s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:52:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:52:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:52:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:52:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:53:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:53:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:53:17 user nova-compute[75571]: INFO nova.compute.manager [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Terminating instance
Nov 28 20:53:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-cc5a78ad-c9a1-49a8-8736-6560f5791d90 req-8d985bb5-06bf-42b9-8fdc-3b201680d2c1 service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Received event network-vif-unplugged-e520ab2e-827e-49ed-974d-ab6828753ea6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cc5a78ad-c9a1-49a8-8736-6560f5791d90 req-8d985bb5-06bf-42b9-8fdc-3b201680d2c1 service nova] Acquiring lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cc5a78ad-c9a1-49a8-8736-6560f5791d90 req-8d985bb5-06bf-42b9-8fdc-3b201680d2c1 service nova] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-cc5a78ad-c9a1-49a8-8736-6560f5791d90 req-8d985bb5-06bf-42b9-8fdc-3b201680d2c1 service nova] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-cc5a78ad-c9a1-49a8-8736-6560f5791d90 req-8d985bb5-06bf-42b9-8fdc-3b201680d2c1 service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] No waiting events found dispatching network-vif-unplugged-e520ab2e-827e-49ed-974d-ab6828753ea6 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-cc5a78ad-c9a1-49a8-8736-6560f5791d90 req-8d985bb5-06bf-42b9-8fdc-3b201680d2c1 service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Received event network-vif-unplugged-e520ab2e-827e-49ed-974d-ab6828753ea6 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:53:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:17 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Instance destroyed successfully.
Nov 28 20:53:17 user nova-compute[75571]: DEBUG nova.objects.instance [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'resources' on Instance uuid 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:50:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-556641452',display_name='tempest-AttachVolumeNegativeTest-server-556641452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-556641452',id=45,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzt+rvlu8IOwBMKEhMCcxSM5mRgkamAdD+fA49z5exaxi9GSu94u7hWGILlxAg7fxju8bk4UBIUtwAMFZ7Vzf1XpwpnQC9PZEkH0cOGYdYuiAGfClWnaAV61r4sPVb6xA==',key_name='tempest-keypair-1955953124',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:50:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c30c6dea8b148f08d7e5e84757c5e64',ramdisk_id='',reservation_id='r-0lzluxtv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-959194587',owner_user_name='tempest-AttachVolumeNegativeTest-959194587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:50:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='409bfc19d682425ea17eda9b336750b4',uuid=03e1aaf1-d8c2-4bc0-934b-00d8961cd368,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e520ab2e-827e-49ed-974d-ab6828753ea6", "address": "fa:16:3e:ba:22:f2", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape520ab2e-82", "ovs_interfaceid": "e520ab2e-827e-49ed-974d-ab6828753ea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converting VIF {"id": "e520ab2e-827e-49ed-974d-ab6828753ea6", "address": "fa:16:3e:ba:22:f2", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape520ab2e-82", "ovs_interfaceid": "e520ab2e-827e-49ed-974d-ab6828753ea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:22:f2,bridge_name='br-int',has_traffic_filtering=True,id=e520ab2e-827e-49ed-974d-ab6828753ea6,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape520ab2e-82') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG os_vif [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:22:f2,bridge_name='br-int',has_traffic_filtering=True,id=e520ab2e-827e-49ed-974d-ab6828753ea6,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape520ab2e-82') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape520ab2e-82, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d031efd8-3634-4ee4-88e2-ff19e4b7db11) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:53:18 user nova-compute[75571]: INFO os_vif [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:22:f2,bridge_name='br-int',has_traffic_filtering=True,id=e520ab2e-827e-49ed-974d-ab6828753ea6,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape520ab2e-82')
Nov 28 20:53:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Deleting instance files /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368_del
Nov 28 20:53:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Deletion of /opt/stack/data/nova/instances/03e1aaf1-d8c2-4bc0-934b-00d8961cd368_del complete
Nov 28 20:53:18 user nova-compute[75571]: INFO nova.compute.manager [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 28 20:53:18 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:53:18 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Took 0.62 seconds to deallocate network for instance.
Nov 28 20:53:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:53:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:53:18 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Deleted allocations for instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368
Nov 28 20:53:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.822s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:53:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-57b49e97-2867-4c40-9797-4878dbf29008 req-4df741dd-ea04-4f59-8d3e-34b4d01578d6 service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Received event network-vif-plugged-e520ab2e-827e-49ed-974d-ab6828753ea6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:53:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-57b49e97-2867-4c40-9797-4878dbf29008 req-4df741dd-ea04-4f59-8d3e-34b4d01578d6 service nova] Acquiring lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:53:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-57b49e97-2867-4c40-9797-4878dbf29008 req-4df741dd-ea04-4f59-8d3e-34b4d01578d6 service nova] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:53:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-57b49e97-2867-4c40-9797-4878dbf29008 req-4df741dd-ea04-4f59-8d3e-34b4d01578d6 service nova] Lock "03e1aaf1-d8c2-4bc0-934b-00d8961cd368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:53:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-57b49e97-2867-4c40-9797-4878dbf29008 req-4df741dd-ea04-4f59-8d3e-34b4d01578d6 service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] No waiting events found dispatching network-vif-plugged-e520ab2e-827e-49ed-974d-ab6828753ea6 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:53:19 user nova-compute[75571]: WARNING nova.compute.manager [req-57b49e97-2867-4c40-9797-4878dbf29008 req-4df741dd-ea04-4f59-8d3e-34b4d01578d6 service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Received unexpected event network-vif-plugged-e520ab2e-827e-49ed-974d-ab6828753ea6 for instance with vm_state deleted and task_state None.
Nov 28 20:53:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-57b49e97-2867-4c40-9797-4878dbf29008 req-4df741dd-ea04-4f59-8d3e-34b4d01578d6 service nova] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Received event network-vif-deleted-e520ab2e-827e-49ed-974d-ab6828753ea6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:53:22 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:53:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:53:28 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:53:28 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:53:29 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:53:31 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:53:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:53:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:53:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:53:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:53:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:34 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:53:34 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:53:34 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:53:34 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 20:53:34 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:53:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:53:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:53:36 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:53:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:53:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:53:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:53:36 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:53:36 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:53:36 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:53:36 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9188MB free_disk=25.04095458984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:53:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:53:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:53:36 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:53:36 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:53:36 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:53:36 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:53:36 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:53:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:53:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:53:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:53:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:53:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:53:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:53:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:54:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:54:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:54:10 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:54:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:54:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:54:10 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:54:10 user nova-compute[75571]: INFO nova.compute.claims [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Claim successful on node user
Nov 28 20:54:11 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:54:11 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:54:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG nova.policy [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:54:11 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Creating image(s)
Nov 28 20:54:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "/opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "/opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.168s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk 1073741824" returned: 0 in 0.063s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:54:11 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Successfully created port: ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.179s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Cannot resize image /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Ensure instance console log exists: /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Successfully updated port: ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquired lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-602b583e-bf1c-46ab-838e-48e58a619f97 req-f2bd0754-b128-4bc0-ab19-93a412b20980 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received event network-changed-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-602b583e-bf1c-46ab-838e-48e58a619f97 req-f2bd0754-b128-4bc0-ab19-93a412b20980 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Refreshing instance network info cache due to event network-changed-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-602b583e-bf1c-46ab-838e-48e58a619f97 req-f2bd0754-b128-4bc0-ab19-93a412b20980 service nova] Acquiring lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Updating instance_info_cache with network_info: [{"id": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "address": "fa:16:3e:61:48:0d", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffece4bb-9d", "ovs_interfaceid": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Releasing lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Instance network_info: |[{"id": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "address": "fa:16:3e:61:48:0d", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffece4bb-9d", "ovs_interfaceid": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-602b583e-bf1c-46ab-838e-48e58a619f97 req-f2bd0754-b128-4bc0-ab19-93a412b20980 service nova] Acquired lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.network.neutron [req-602b583e-bf1c-46ab-838e-48e58a619f97 req-f2bd0754-b128-4bc0-ab19-93a412b20980 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Refreshing network info cache for port ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Start _get_guest_xml network_info=[{"id": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "address": "fa:16:3e:61:48:0d", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffece4bb-9d", "ovs_interfaceid": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:54:12 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:54:12 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1607459046',display_name='tempest-AttachVolumeNegativeTest-server-1607459046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1607459046',id=46,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiMPNWzL0GpLGIMPG/AmYmZDYonku5WZ9kUe5UoEMdM0LgTZPJ10hqZzhavjjCygbBzTBjxK1s3//CauBfe8IoR30/3vBxEKOW8ONxMGqZRbOdr5zCmmrmzgsS5dBSEDg==',key_name='tempest-keypair-1778218187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c30c6dea8b148f08d7e5e84757c5e64',ramdisk_id='',reservation_id='r-8jncx4zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-959194587',owner_user_name='tempest-AttachVolumeNegativeTest-959194587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:54:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='409bfc19d682425ea17eda9b336750b4',uuid=5f3dfdce-64ea-48c3-a57d-6b21f4ef525c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "address": "fa:16:3e:61:48:0d", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffece4bb-9d", "ovs_interfaceid": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converting VIF {"id": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "address": "fa:16:3e:61:48:0d", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffece4bb-9d", "ovs_interfaceid": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:48:0d,bridge_name='br-int',has_traffic_filtering=True,id=ffece4bb-9dc5-41f7-8ff2-9e097aac4a64,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffece4bb-9d') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.objects.instance [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:54:12 user nova-compute[75571]:   <uuid>5f3dfdce-64ea-48c3-a57d-6b21f4ef525c</uuid>
Nov 28 20:54:12 user nova-compute[75571]:   <name>instance-0000002e</name>
Nov 28 20:54:12 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:54:12 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:54:12 user nova-compute[75571]:   <metadata>
Nov 28 20:54:12 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:54:12 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:54:12 user nova-compute[75571]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1607459046</nova:name>
Nov 28 20:54:12 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:54:12</nova:creationTime>
Nov 28 20:54:12 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:54:12 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:54:12 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:54:12 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:54:12 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:54:12 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:54:12 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:54:12 user nova-compute[75571]:       <nova:owner>
Nov 28 20:54:12 user nova-compute[75571]:         <nova:user uuid="409bfc19d682425ea17eda9b336750b4">tempest-AttachVolumeNegativeTest-959194587-project-member</nova:user>
Nov 28 20:54:12 user nova-compute[75571]:         <nova:project uuid="9c30c6dea8b148f08d7e5e84757c5e64">tempest-AttachVolumeNegativeTest-959194587</nova:project>
Nov 28 20:54:12 user nova-compute[75571]:       </nova:owner>
Nov 28 20:54:12 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 20:54:12 user nova-compute[75571]:       <nova:ports>
Nov 28 20:54:12 user nova-compute[75571]:         <nova:port uuid="ffece4bb-9dc5-41f7-8ff2-9e097aac4a64">
Nov 28 20:54:12 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 20:54:12 user nova-compute[75571]:         </nova:port>
Nov 28 20:54:12 user nova-compute[75571]:       </nova:ports>
Nov 28 20:54:12 user nova-compute[75571]:     </nova:instance>
Nov 28 20:54:12 user nova-compute[75571]:   </metadata>
Nov 28 20:54:12 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:54:12 user nova-compute[75571]:     <system>
Nov 28 20:54:12 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:54:12 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:54:12 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:54:12 user nova-compute[75571]:       <entry name="serial">5f3dfdce-64ea-48c3-a57d-6b21f4ef525c</entry>
Nov 28 20:54:12 user nova-compute[75571]:       <entry name="uuid">5f3dfdce-64ea-48c3-a57d-6b21f4ef525c</entry>
Nov 28 20:54:12 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:54:12 user nova-compute[75571]:     </system>
Nov 28 20:54:12 user nova-compute[75571]:   </sysinfo>
Nov 28 20:54:12 user nova-compute[75571]:   <os>
Nov 28 20:54:12 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:54:12 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:54:12 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:54:12 user nova-compute[75571]:   </os>
Nov 28 20:54:12 user nova-compute[75571]:   <features>
Nov 28 20:54:12 user nova-compute[75571]:     <acpi/>
Nov 28 20:54:12 user nova-compute[75571]:     <apic/>
Nov 28 20:54:12 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:54:12 user nova-compute[75571]:   </features>
Nov 28 20:54:12 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:54:12 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:54:12 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:54:12 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:54:12 user nova-compute[75571]:   </clock>
Nov 28 20:54:12 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:54:12 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:54:12 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:54:12 user nova-compute[75571]:   </cpu>
Nov 28 20:54:12 user nova-compute[75571]:   <devices>
Nov 28 20:54:12 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 20:54:12 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 20:54:12 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk"/>
Nov 28 20:54:12 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:54:12 user nova-compute[75571]:     </disk>
Nov 28 20:54:12 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:54:12 user nova-compute[75571]:       <mac address="fa:16:3e:61:48:0d"/>
Nov 28 20:54:12 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:54:12 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:54:12 user nova-compute[75571]:       <target dev="tapffece4bb-9d"/>
Nov 28 20:54:12 user nova-compute[75571]:     </interface>
Nov 28 20:54:12 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:54:12 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/console.log" append="off"/>
Nov 28 20:54:12 user nova-compute[75571]:     </serial>
Nov 28 20:54:12 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:54:12 user nova-compute[75571]:     <video>
Nov 28 20:54:12 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:54:12 user nova-compute[75571]:     </video>
Nov 28 20:54:12 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:54:12 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:54:12 user nova-compute[75571]:     </rng>
Nov 28 20:54:12 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:54:12 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:54:12 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:54:12 user nova-compute[75571]:     </memballoon>
Nov 28 20:54:12 user nova-compute[75571]:   </devices>
Nov 28 20:54:12 user nova-compute[75571]: </domain>
Nov 28 20:54:12 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1607459046',display_name='tempest-AttachVolumeNegativeTest-server-1607459046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1607459046',id=46,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiMPNWzL0GpLGIMPG/AmYmZDYonku5WZ9kUe5UoEMdM0LgTZPJ10hqZzhavjjCygbBzTBjxK1s3//CauBfe8IoR30/3vBxEKOW8ONxMGqZRbOdr5zCmmrmzgsS5dBSEDg==',key_name='tempest-keypair-1778218187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c30c6dea8b148f08d7e5e84757c5e64',ramdisk_id='',reservation_id='r-8jncx4zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-959194587',owner_user_name='tempest-AttachVolumeNegativeTest-959194587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:54:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='409bfc19d682425ea17eda9b336750b4',uuid=5f3dfdce-64ea-48c3-a57d-6b21f4ef525c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "address": "fa:16:3e:61:48:0d", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffece4bb-9d", "ovs_interfaceid": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converting VIF {"id": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "address": "fa:16:3e:61:48:0d", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffece4bb-9d", "ovs_interfaceid": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:48:0d,bridge_name='br-int',has_traffic_filtering=True,id=ffece4bb-9dc5-41f7-8ff2-9e097aac4a64,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffece4bb-9d') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG os_vif [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:48:0d,bridge_name='br-int',has_traffic_filtering=True,id=ffece4bb-9dc5-41f7-8ff2-9e097aac4a64,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffece4bb-9d') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45980937-1090-55ef-b5c9-0882742eb441', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffece4bb-9d, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffece4bb-9d, col_values=(('qos', UUID('51bcbdbd-6a8c-4206-834b-1109af026bbc')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffece4bb-9d, col_values=(('external_ids', {'iface-id': 'ffece4bb-9dc5-41f7-8ff2-9e097aac4a64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:48:0d', 'vm-uuid': '5f3dfdce-64ea-48c3-a57d-6b21f4ef525c'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:54:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:12 user nova-compute[75571]: INFO os_vif [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:48:0d,bridge_name='br-int',has_traffic_filtering=True,id=ffece4bb-9dc5-41f7-8ff2-9e097aac4a64,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffece4bb-9d')
Nov 28 20:54:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:54:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No VIF found with MAC fa:16:3e:61:48:0d, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:54:13 user nova-compute[75571]: DEBUG nova.network.neutron [req-602b583e-bf1c-46ab-838e-48e58a619f97 req-f2bd0754-b128-4bc0-ab19-93a412b20980 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Updated VIF entry in instance network info cache for port ffece4bb-9dc5-41f7-8ff2-9e097aac4a64. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:54:13 user nova-compute[75571]: DEBUG nova.network.neutron [req-602b583e-bf1c-46ab-838e-48e58a619f97 req-f2bd0754-b128-4bc0-ab19-93a412b20980 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Updating instance_info_cache with network_info: [{"id": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "address": "fa:16:3e:61:48:0d", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffece4bb-9d", "ovs_interfaceid": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:54:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-602b583e-bf1c-46ab-838e-48e58a619f97 req-f2bd0754-b128-4bc0-ab19-93a412b20980 service nova] Releasing lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:54:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-99e03513-ea13-4074-b8e8-4c14d0c54223 req-fcbc2652-2bd3-45e8-884d-89f1dad39e62 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received event network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:54:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-99e03513-ea13-4074-b8e8-4c14d0c54223 req-fcbc2652-2bd3-45e8-884d-89f1dad39e62 service nova] Acquiring lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:54:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-99e03513-ea13-4074-b8e8-4c14d0c54223 req-fcbc2652-2bd3-45e8-884d-89f1dad39e62 service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:54:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-99e03513-ea13-4074-b8e8-4c14d0c54223 req-fcbc2652-2bd3-45e8-884d-89f1dad39e62 service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:54:14 user nova-compute[75571]: DEBUG nova.compute.manager [req-99e03513-ea13-4074-b8e8-4c14d0c54223 req-fcbc2652-2bd3-45e8-884d-89f1dad39e62 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] No waiting events found dispatching network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:54:14 user nova-compute[75571]: WARNING nova.compute.manager [req-99e03513-ea13-4074-b8e8-4c14d0c54223 req-fcbc2652-2bd3-45e8-884d-89f1dad39e62 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received unexpected event network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance with vm_state building and task_state spawning.
Nov 28 20:54:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:16 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:54:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:54:16 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Instance spawned successfully.
Nov 28 20:54:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:54:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:54:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:54:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:54:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:54:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:54:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:54:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-e6f16a67-6f33-43b9-a3c7-7975380b0e02 req-ef166373-2ac4-423b-9e1c-8ffa3df32ebe service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received event network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:54:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e6f16a67-6f33-43b9-a3c7-7975380b0e02 req-ef166373-2ac4-423b-9e1c-8ffa3df32ebe service nova] Acquiring lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:54:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e6f16a67-6f33-43b9-a3c7-7975380b0e02 req-ef166373-2ac4-423b-9e1c-8ffa3df32ebe service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:54:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e6f16a67-6f33-43b9-a3c7-7975380b0e02 req-ef166373-2ac4-423b-9e1c-8ffa3df32ebe service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:54:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-e6f16a67-6f33-43b9-a3c7-7975380b0e02 req-ef166373-2ac4-423b-9e1c-8ffa3df32ebe service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] No waiting events found dispatching network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:54:16 user nova-compute[75571]: WARNING nova.compute.manager [req-e6f16a67-6f33-43b9-a3c7-7975380b0e02 req-ef166373-2ac4-423b-9e1c-8ffa3df32ebe service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received unexpected event network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance with vm_state building and task_state spawning.
Nov 28 20:54:16 user nova-compute[75571]: INFO nova.compute.manager [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 28 20:54:16 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:54:16 user nova-compute[75571]: INFO nova.compute.manager [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Took 5.63 seconds to build instance.
Nov 28 20:54:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.719s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:54:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:23 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:54:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:54:29 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:54:30 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:54:30 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:54:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:31 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:54:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:54:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:54:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:54:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:54:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:54:35 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:54:35 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:54:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:35 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Updating instance_info_cache with network_info: [{"id": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "address": "fa:16:3e:61:48:0d", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffece4bb-9d", "ovs_interfaceid": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:54:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:54:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:54:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:54:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:54:36 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:54:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:38 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:54:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:54:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:54:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:54:38 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:54:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:54:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:54:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:54:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:54:38 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:54:38 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:54:38 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8992MB free_disk=25.00497055053711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:54:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:54:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:54:39 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:54:39 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:54:39 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:54:39 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:54:39 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:54:39 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:54:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:54:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:54:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:54:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:54:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:54:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:54:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:55:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:55:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:55:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:55:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:55:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:55:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:55:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:55:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:55:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:55:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:55:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:55:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:55:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:55:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:55:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:55:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:55:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:55:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:55:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:55:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:55:24 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:55:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:55:30 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:55:31 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:55:32 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:55:32 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:55:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:55:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:55:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:55:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:55:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:55:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:55:35 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:55:35 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:55:35 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Updating instance_info_cache with network_info: [{"id": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "address": "fa:16:3e:61:48:0d", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffece4bb-9d", "ovs_interfaceid": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:55:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:55:35 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:55:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:55:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:55:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:55:38 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:55:38 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:55:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:55:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:55:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:55:38 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:55:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:55:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:55:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:55:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:55:38 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:55:38 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:55:38 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9043MB free_disk=25.002933502197266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:55:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:55:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:55:39 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:55:39 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:55:39 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:55:39 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:55:39 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:55:39 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:55:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:55:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:55:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:55:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:55:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:55:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:55:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:55:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:55:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:55:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:55:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:55:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:55:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:55:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:55:57 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:55:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:55:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:55:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:55:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:55:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:55:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:56:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-3e257274-3da1-4aaf-a431-db97afef8544 req-cfbe58ed-4bfc-432f-b81c-f2c76490e287 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received event network-changed-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:56:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-3e257274-3da1-4aaf-a431-db97afef8544 req-cfbe58ed-4bfc-432f-b81c-f2c76490e287 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Refreshing instance network info cache due to event network-changed-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:56:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3e257274-3da1-4aaf-a431-db97afef8544 req-cfbe58ed-4bfc-432f-b81c-f2c76490e287 service nova] Acquiring lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:56:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3e257274-3da1-4aaf-a431-db97afef8544 req-cfbe58ed-4bfc-432f-b81c-f2c76490e287 service nova] Acquired lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:56:02 user nova-compute[75571]: DEBUG nova.network.neutron [req-3e257274-3da1-4aaf-a431-db97afef8544 req-cfbe58ed-4bfc-432f-b81c-f2c76490e287 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Refreshing network info cache for port ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:56:02 user nova-compute[75571]: DEBUG nova.network.neutron [req-3e257274-3da1-4aaf-a431-db97afef8544 req-cfbe58ed-4bfc-432f-b81c-f2c76490e287 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Updated VIF entry in instance network info cache for port ffece4bb-9dc5-41f7-8ff2-9e097aac4a64. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:56:02 user nova-compute[75571]: DEBUG nova.network.neutron [req-3e257274-3da1-4aaf-a431-db97afef8544 req-cfbe58ed-4bfc-432f-b81c-f2c76490e287 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Updating instance_info_cache with network_info: [{"id": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "address": "fa:16:3e:61:48:0d", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffece4bb-9d", "ovs_interfaceid": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:56:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3e257274-3da1-4aaf-a431-db97afef8544 req-cfbe58ed-4bfc-432f-b81c-f2c76490e287 service nova] Releasing lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:56:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:56:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:56:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:56:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:56:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:56:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:56:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:56:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:56:04 user nova-compute[75571]: DEBUG nova.objects.instance [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'flavor' on Instance uuid 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:56:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:56:05 user nova-compute[75571]: INFO nova.compute.manager [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Attaching volume 47bb81e3-9c73-4fbc-9a7f-8b520613a18e to /dev/vdb
Nov 28 20:56:05 user nova-compute[75571]: DEBUG os_brick.utils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7adde8-ca46-4b13-a318-f9f428b94a89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6e6232-847e-4f40-aaf6-0a18fa043eae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ba2720-fdcb-4bb8-a058-a2502df5d922]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1e5838-7222-4afe-b2e0-94c962364a4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:56:05 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:56:05 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e880c4-00d3-42c0-a169-408c16eeb69c]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG os_brick.utils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Updating existing volume attachment record: 9d081bbe-abe6-4ced-842c-a965ab519c23 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:56:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkngMbcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:56:11 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:56:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:56:11 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:56:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:56:11 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e3f610-ed8f-4a19-a522-98438df0f0a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:56:11 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[519c1e18-33f5-4a1a-9425-f6ddbbe8b20d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e] added
Nov 28 20:56:11 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5262fd-e225-4684-a385-c26e77ffa2e3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aeaddcb-0307-4d7c-bb08-b8e8b356ef38]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mkngMbcG {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mkngMbcG" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f971ca15-67ce-4c40-af30-941225973ddd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mkngMbcG'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1785b724-7ee0-470c-92c9-9137182e1ff8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d3eafd-101e-4f17-8c52-ef83f411e0e2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:56:11 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:56:11 user nova-compute[75571]:  {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:56:11 user nova-compute[75571]: WARNING os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 20:56:11 user nova-compute[75571]: 
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[981fc282-c4d0-4779-b6e5-65b18e3cfd0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e, portal: 172.16.0.220,3260]
Nov 28 20:56:11 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e, portal: 172.16.0.220,3260] successful.
Nov 28 20:56:11 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcc1f18-14c5-4829-a468-5cbab12984e3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:56:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[edabf6d3-9b71-4b37-a781-a1200f94e040]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e (non-flash)
Nov 28 20:56:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:56:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e (non-flash)
Nov 28 20:56:12 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:56:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:56:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:56:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:56:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:56:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:12 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:12 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a363dfd-dfec-4cb7-89fb-cadfd2d34be1]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:12 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:56:12 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkngMbcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:56:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:56:13 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23537646635303163', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:56:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537646635303163', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:56:13 user nova-compute[75571]: DEBUG nova.objects.instance [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'flavor' on Instance uuid 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:56:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 20:56:13 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:56:13 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:56:13 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:56:13 user nova-compute[75571]:   <serial>47bb81e3-9c73-4fbc-9a7f-8b520613a18e</serial>
Nov 28 20:56:13 user nova-compute[75571]: </disk>
Nov 28 20:56:13 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 20:56:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:56:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:56:13 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] No VIF found with MAC fa:16:3e:61:48:0d, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:56:13 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.598s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:56:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:56:14 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:56:15 user nova-compute[75571]: INFO nova.compute.manager [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Detaching volume 47bb81e3-9c73-4fbc-9a7f-8b520613a18e
Nov 28 20:56:15 user nova-compute[75571]: INFO nova.virt.block_device [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Attempting to driver detach volume 47bb81e3-9c73-4fbc-9a7f-8b520613a18e from mountpoint /dev/vdb
Nov 28 20:56:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Attempting to detach device vdb from instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 20:56:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:56:15 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:56:15 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:56:15 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:56:15 user nova-compute[75571]:   <serial>47bb81e3-9c73-4fbc-9a7f-8b520613a18e</serial>
Nov 28 20:56:15 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:56:15 user nova-compute[75571]: </disk>
Nov 28 20:56:15 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:56:15 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Successfully detached device vdb from instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c from the persistent domain config.
Nov 28 20:56:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 20:56:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 20:56:15 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:56:15 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 20:56:15 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 20:56:15 user nova-compute[75571]:   <serial>47bb81e3-9c73-4fbc-9a7f-8b520613a18e</serial>
Nov 28 20:56:15 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 20:56:15 user nova-compute[75571]: </disk>
Nov 28 20:56:15 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 20:56:15 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 20:56:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:56:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:56:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:56:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:56:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:24 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:56:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:56:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:56:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:56:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:56:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:31 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:56:32 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:56:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:56:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:56:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:56:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:56:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:34 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:56:34 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:35 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c is timed out.
Nov 28 20:56:35 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Successfully detached device vdb from instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c from the live domain config.
Nov 28 20:56:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkngMbcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:56:35 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2fabef-0969-4506-bd75-b41769b28465]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 20:56:35 user nova-compute[75571]: No targets found.
Nov 28 20:56:35 user nova-compute[75571]: iSNS:
Nov 28 20:56:35 user nova-compute[75571]: No targets found.
Nov 28 20:56:35 user nova-compute[75571]: STATIC:
Nov 28 20:56:35 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e
Nov 28 20:56:35 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 20:56:35 user nova-compute[75571]:                 Iface Name: default
Nov 28 20:56:35 user nova-compute[75571]: FIRMWARE:
Nov 28 20:56:35 user nova-compute[75571]: No targets found.
Nov 28 20:56:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 20:56:35 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 20:56:35 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0778b3d8-0645-4469-aa16-df09dd79a3fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[72efc641-493a-4ae2-8a8f-3def2eeaf55e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e (non-flash)
Nov 28 20:56:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e (non-flash)
Nov 28 20:56:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77781ef0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49b9769-e714-429e-9c60-2cfdc2766a5c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c125779f-b6c6-4cfb-aa77-01ec54c8b91a]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed316c15-82bd-42e4-a76a-5f78d7103e63]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c606170-7042-41b6-ac8e-892567eba518]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea57acb-8efb-4689-8753-77bf2156da25]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[243643d3-3b56-40d2-96ad-454306e2d811]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e, portal: 172.16.0.220,3260]
Nov 28 20:56:35 user nova-compute[75571]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e, portal: 172.16.0.220,3260] successful.
Nov 28 20:56:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47bb81e3-9c73-4fbc-9a7f-8b520613a18e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b03dfb-b59d-4b2f-97b5-01306a948903]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] <== disconnect_volume: return (259ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:56:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 20:56:36 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:56:36 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:56:36 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:56:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:56:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:56:36 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:56:36 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:56:36 user nova-compute[75571]: DEBUG nova.objects.instance [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'flavor' on Instance uuid 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:56:36 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Updating instance_info_cache with network_info: [{"id": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "address": "fa:16:3e:61:48:0d", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffece4bb-9d", "ovs_interfaceid": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:56:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:56:36 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:56:36 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:56:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.645s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:56:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:38 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:56:38 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:56:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:56:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:56:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:56:38 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:56:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:56:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:56:38 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:56:38 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:56:38 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9042MB free_disk=25.001846313476562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:56:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:56:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:56:39 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:56:39 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:56:39 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:56:39 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:56:39 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:56:39 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:56:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:56:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:56:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:56:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:56:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:56:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:56:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:56:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:56:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:56:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:56:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:56:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:56:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:56:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:56:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:56:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:57:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:57:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:57:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:57:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:57:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:57:05 user nova-compute[75571]: INFO nova.compute.manager [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Terminating instance
Nov 28 20:57:05 user nova-compute[75571]: DEBUG nova.compute.manager [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 20:57:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-e8db0851-aade-4cb9-a1bc-30a590887e89 req-fb91d528-678b-49eb-88c6-87a6257664b0 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received event network-vif-unplugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:57:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e8db0851-aade-4cb9-a1bc-30a590887e89 req-fb91d528-678b-49eb-88c6-87a6257664b0 service nova] Acquiring lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:57:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e8db0851-aade-4cb9-a1bc-30a590887e89 req-fb91d528-678b-49eb-88c6-87a6257664b0 service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:57:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e8db0851-aade-4cb9-a1bc-30a590887e89 req-fb91d528-678b-49eb-88c6-87a6257664b0 service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:57:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-e8db0851-aade-4cb9-a1bc-30a590887e89 req-fb91d528-678b-49eb-88c6-87a6257664b0 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] No waiting events found dispatching network-vif-unplugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:57:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-e8db0851-aade-4cb9-a1bc-30a590887e89 req-fb91d528-678b-49eb-88c6-87a6257664b0 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received event network-vif-unplugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:06 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Instance destroyed successfully.
Nov 28 20:57:06 user nova-compute[75571]: DEBUG nova.objects.instance [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'resources' on Instance uuid 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1607459046',display_name='tempest-AttachVolumeNegativeTest-server-1607459046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1607459046',id=46,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiMPNWzL0GpLGIMPG/AmYmZDYonku5WZ9kUe5UoEMdM0LgTZPJ10hqZzhavjjCygbBzTBjxK1s3//CauBfe8IoR30/3vBxEKOW8ONxMGqZRbOdr5zCmmrmzgsS5dBSEDg==',key_name='tempest-keypair-1778218187',keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:54:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c30c6dea8b148f08d7e5e84757c5e64',ramdisk_id='',reservation_id='r-8jncx4zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-959194587',owner_user_name='tempest-AttachVolumeNegativeTest-959194587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:54:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='409bfc19d682425ea17eda9b336750b4',uuid=5f3dfdce-64ea-48c3-a57d-6b21f4ef525c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "address": "fa:16:3e:61:48:0d", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffece4bb-9d", "ovs_interfaceid": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converting VIF {"id": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "address": "fa:16:3e:61:48:0d", "network": {"id": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1717385616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c30c6dea8b148f08d7e5e84757c5e64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffece4bb-9d", "ovs_interfaceid": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:48:0d,bridge_name='br-int',has_traffic_filtering=True,id=ffece4bb-9dc5-41f7-8ff2-9e097aac4a64,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffece4bb-9d') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG os_vif [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:48:0d,bridge_name='br-int',has_traffic_filtering=True,id=ffece4bb-9dc5-41f7-8ff2-9e097aac4a64,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffece4bb-9d') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffece4bb-9d, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51bcbdbd-6a8c-4206-834b-1109af026bbc) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:57:06 user nova-compute[75571]: INFO os_vif [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:48:0d,bridge_name='br-int',has_traffic_filtering=True,id=ffece4bb-9dc5-41f7-8ff2-9e097aac4a64,network=Network(1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffece4bb-9d')
Nov 28 20:57:06 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Deleting instance files /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c_del
Nov 28 20:57:06 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Deletion of /opt/stack/data/nova/instances/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c_del complete
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:06 user nova-compute[75571]: INFO nova.compute.manager [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 20:57:06 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:07 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:57:07 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Took 0.81 seconds to deallocate network for instance.
Nov 28 20:57:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-7d275fba-3a0c-4a4d-bf1f-6bf9fa0ad2b2 req-d717a411-ad5e-4a1e-a58d-1572800794f2 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received event network-vif-deleted-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:57:07 user nova-compute[75571]: INFO nova.compute.manager [req-7d275fba-3a0c-4a4d-bf1f-6bf9fa0ad2b2 req-d717a411-ad5e-4a1e-a58d-1572800794f2 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Neutron deleted interface ffece4bb-9dc5-41f7-8ff2-9e097aac4a64; detaching it from the instance and deleting it from the info cache
Nov 28 20:57:07 user nova-compute[75571]: DEBUG nova.network.neutron [req-7d275fba-3a0c-4a4d-bf1f-6bf9fa0ad2b2 req-d717a411-ad5e-4a1e-a58d-1572800794f2 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:57:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-7d275fba-3a0c-4a4d-bf1f-6bf9fa0ad2b2 req-d717a411-ad5e-4a1e-a58d-1572800794f2 service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Detach interface failed, port_id=ffece4bb-9dc5-41f7-8ff2-9e097aac4a64, reason: Instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 20:57:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:57:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:57:07 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:57:07 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:57:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:57:07 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Deleted allocations for instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c
Nov 28 20:57:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.006s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:57:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received event network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Acquiring lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] No waiting events found dispatching network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:57:08 user nova-compute[75571]: WARNING nova.compute.manager [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received unexpected event network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance with vm_state deleted and task_state None.
Nov 28 20:57:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received event network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Acquiring lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] No waiting events found dispatching network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:57:08 user nova-compute[75571]: WARNING nova.compute.manager [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received unexpected event network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance with vm_state deleted and task_state None.
Nov 28 20:57:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received event network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Acquiring lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] No waiting events found dispatching network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:57:08 user nova-compute[75571]: WARNING nova.compute.manager [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received unexpected event network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance with vm_state deleted and task_state None.
Nov 28 20:57:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received event network-vif-unplugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Acquiring lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] No waiting events found dispatching network-vif-unplugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:57:08 user nova-compute[75571]: WARNING nova.compute.manager [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received unexpected event network-vif-unplugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance with vm_state deleted and task_state None.
Nov 28 20:57:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received event network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Acquiring lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Lock "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:57:08 user nova-compute[75571]: DEBUG nova.compute.manager [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] No waiting events found dispatching network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:57:08 user nova-compute[75571]: WARNING nova.compute.manager [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Received unexpected event network-vif-plugged-ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance with vm_state deleted and task_state None.
Nov 28 20:57:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:25 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:57:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:57:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:32 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:57:33 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:57:36 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:57:36 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:57:36 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:57:36 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:57:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:57:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:57:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:57:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:57:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:38 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:57:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:57:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:57:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 20:57:39 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:57:40 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:57:40 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:57:40 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9169MB free_disk=25.02899169921875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing inventories for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating ProviderTree inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing aggregate associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, aggregates: None {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing trait associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:57:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:57:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:57:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:57:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:57:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:57:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:57:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:48 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:57:48 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75571) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 20:57:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:57:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 20:57:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] There are 0 instances to clean {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 20:57:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:57:57 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:57:59 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:58:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:58:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:25 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:58:26 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:58:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:34 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:58:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:58:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:36 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:58:36 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:58:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:37 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:58:37 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:58:38 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:58:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:58:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:58:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 20:58:40 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:58:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:41 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:58:42 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:58:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:58:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.005s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:58:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:58:42 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:58:42 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:58:42 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:58:42 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9181MB free_disk=25.02614974975586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:58:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:58:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:58:42 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:58:42 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:58:42 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:58:42 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:58:42 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:58:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:58:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "523bbab2-2a04-4bf9-9318-d80922e55cee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:58:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "523bbab2-2a04-4bf9-9318-d80922e55cee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:58:45 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 20:58:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:58:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:58:45 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 20:58:45 user nova-compute[75571]: INFO nova.compute.claims [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Claim successful on node user
Nov 28 20:58:45 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:58:45 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:58:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:58:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 20:58:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 20:58:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 20:58:46 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 20:58:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 20:58:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:46 user nova-compute[75571]: DEBUG nova.policy [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 20:58:46 user nova-compute[75571]: INFO nova.virt.block_device [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Booting with volume snapshot f58f419e-07c4-4922-a817-af480095646a at /dev/vda
Nov 28 20:58:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Successfully created port: 3e8f3c87-f107-471d-ab79-72568b1b5e25 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 20:58:47 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Successfully updated port: 3e8f3c87-f107-471d-ab79-72568b1b5e25 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 20:58:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "refresh_cache-523bbab2-2a04-4bf9-9318-d80922e55cee" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:58:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquired lock "refresh_cache-523bbab2-2a04-4bf9-9318-d80922e55cee" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:58:47 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 20:58:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-e42db2d2-6787-438a-ace8-61adcc12d940 req-bccb3b20-824e-4082-b3b1-15b704c19b4b service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Received event network-changed-3e8f3c87-f107-471d-ab79-72568b1b5e25 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:58:47 user nova-compute[75571]: DEBUG nova.compute.manager [req-e42db2d2-6787-438a-ace8-61adcc12d940 req-bccb3b20-824e-4082-b3b1-15b704c19b4b service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Refreshing instance network info cache due to event network-changed-3e8f3c87-f107-471d-ab79-72568b1b5e25. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 20:58:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e42db2d2-6787-438a-ace8-61adcc12d940 req-bccb3b20-824e-4082-b3b1-15b704c19b4b service nova] Acquiring lock "refresh_cache-523bbab2-2a04-4bf9-9318-d80922e55cee" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:58:47 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 20:58:47 user nova-compute[75571]: DEBUG nova.network.neutron [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Updating instance_info_cache with network_info: [{"id": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "address": "fa:16:3e:42:89:02", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f3c87-f1", "ovs_interfaceid": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:58:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Releasing lock "refresh_cache-523bbab2-2a04-4bf9-9318-d80922e55cee" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:58:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Instance network_info: |[{"id": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "address": "fa:16:3e:42:89:02", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f3c87-f1", "ovs_interfaceid": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 20:58:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e42db2d2-6787-438a-ace8-61adcc12d940 req-bccb3b20-824e-4082-b3b1-15b704c19b4b service nova] Acquired lock "refresh_cache-523bbab2-2a04-4bf9-9318-d80922e55cee" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:58:47 user nova-compute[75571]: DEBUG nova.network.neutron [req-e42db2d2-6787-438a-ace8-61adcc12d940 req-bccb3b20-824e-4082-b3b1-15b704c19b4b service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Refreshing network info cache for port 3e8f3c87-f107-471d-ab79-72568b1b5e25 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 20:58:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-e42db2d2-6787-438a-ace8-61adcc12d940 req-bccb3b20-824e-4082-b3b1-15b704c19b4b service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Updated VIF entry in instance network info cache for port 3e8f3c87-f107-471d-ab79-72568b1b5e25. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 20:58:48 user nova-compute[75571]: DEBUG nova.network.neutron [req-e42db2d2-6787-438a-ace8-61adcc12d940 req-bccb3b20-824e-4082-b3b1-15b704c19b4b service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Updating instance_info_cache with network_info: [{"id": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "address": "fa:16:3e:42:89:02", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f3c87-f1", "ovs_interfaceid": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:58:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e42db2d2-6787-438a-ace8-61adcc12d940 req-bccb3b20-824e-4082-b3b1-15b704c19b4b service nova] Releasing lock "refresh_cache-523bbab2-2a04-4bf9-9318-d80922e55cee" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:58:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:51 user nova-compute[75571]: DEBUG os_brick.utils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:58:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:58:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9ea5c6-accd-4a43-aee0-9f7fc66077df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:58:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec09ede1-298a-48a2-a164-ecd9b37b7ba2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:58:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b89b22-87b2-4b42-9b62-aa4b9d45ad56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:51 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb2aba0-c2fd-45a1-ab14-8c5170919dab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:51 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:58:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 20:58:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 20:58:52 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 20:58:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4851dd8-5234-409a-9dc0-4484c199cebe]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 20:58:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 20:58:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 20:58:52 user nova-compute[75571]: DEBUG os_brick.utils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:58:52 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Updating existing volume attachment record: 07c33830-8422-426e-b8ae-a856e4608d7d {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 20:58:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 20:58:58 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Creating image(s)
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Ensure instance console log exists: /opt/stack/data/nova/instances/523bbab2-2a04-4bf9-9318-d80922e55cee/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Start _get_guest_xml network_info=[{"id": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "address": "fa:16:3e:42:89:02", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f3c87-f1", "ovs_interfaceid": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUBnLCpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '523bbab2-2a04-4bf9-9318-d80922e55cee', 'attached_at': '', 'detached_at': '', 'volume_id': '1a84308f-2fe7-4fb7-bcc3-525c0956e6fa', 'serial': '1a84308f-2fe7-4fb7-bcc3-525c0956e6fa'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '07c33830-8422-426e-b8ae-a856e4608d7d', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 20:58:58 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:58:58 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUBnLCpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 20:58:58 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:58:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:58:58 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 20:58:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 20:58:58 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4e3e09-f572-4625-abf7-61d2f06cacbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 20:58:58 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c4fa6e-dbf9-40a2-a848-3d6ec2516354]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa] added
Nov 28 20:58:58 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadeb605-172b-44de-b1cd-c17cf343d955]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[43df4e00-b620-48ff-a36f-1c4e73d5deab]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUBnLCpF {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUBnLCpF" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3699a56c-be7a-4f93-b971-b993fcc6dc38]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mUBnLCpF'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[268f48a1-c2ea-4051-97bb-1d733cb47b6d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:58:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3320cce4-9f53-421f-ac7f-72526ec5df62]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:58:59 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 20:58:59 user nova-compute[75571]:  {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:58:59 user nova-compute[75571]: WARNING os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 20:58:59 user nova-compute[75571]: 
Nov 28 20:58:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8b1a25-f65b-40a6-8605-bacfbdacb50d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa, portal: 172.16.0.220,3260]
Nov 28 20:58:59 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa, portal: 172.16.0.220,3260] successful.
Nov 28 20:58:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6901bfcf-da23-47c0-b334-d17cda25d2b9]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bead123b-7ddf-4aeb-9fb3-ba72735f1466]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa (non-flash)
Nov 28 20:58:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa (non-flash)
Nov 28 20:58:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[240d5b76-54b6-482e-ae31-f1a2c1937245]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 20:58:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUBnLCpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23662376439646363', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662376439646363', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1315081543',display_name='tempest-TestVolumeBootPattern-server-1315081543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1315081543',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-uttjpvur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:58:46Z,user_data=None,user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=523bbab2-2a04-4bf9-9318-d80922e55cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "address": "fa:16:3e:42:89:02", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f3c87-f1", "ovs_interfaceid": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "address": "fa:16:3e:42:89:02", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f3c87-f1", "ovs_interfaceid": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:89:02,bridge_name='br-int',has_traffic_filtering=True,id=3e8f3c87-f107-471d-ab79-72568b1b5e25,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8f3c87-f1') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG nova.objects.instance [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lazy-loading 'pci_devices' on Instance uuid 523bbab2-2a04-4bf9-9318-d80922e55cee {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] End _get_guest_xml xml=<domain type="kvm">
Nov 28 20:59:00 user nova-compute[75571]:   <uuid>523bbab2-2a04-4bf9-9318-d80922e55cee</uuid>
Nov 28 20:59:00 user nova-compute[75571]:   <name>instance-0000002f</name>
Nov 28 20:59:00 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 20:59:00 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 20:59:00 user nova-compute[75571]:   <metadata>
Nov 28 20:59:00 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 20:59:00 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 20:59:00 user nova-compute[75571]:       <nova:name>tempest-TestVolumeBootPattern-server-1315081543</nova:name>
Nov 28 20:59:00 user nova-compute[75571]:       <nova:creationTime>2023-11-28 20:58:58</nova:creationTime>
Nov 28 20:59:00 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 20:59:00 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 20:59:00 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 20:59:00 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 20:59:00 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 20:59:00 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 20:59:00 user nova-compute[75571]:       </nova:flavor>
Nov 28 20:59:00 user nova-compute[75571]:       <nova:owner>
Nov 28 20:59:00 user nova-compute[75571]:         <nova:user uuid="fc8d37446f714002b8c5c4395ab82d58">tempest-TestVolumeBootPattern-845056434-project-member</nova:user>
Nov 28 20:59:00 user nova-compute[75571]:         <nova:project uuid="f852e1ca6d934711942031022097eb36">tempest-TestVolumeBootPattern-845056434</nova:project>
Nov 28 20:59:00 user nova-compute[75571]:       </nova:owner>
Nov 28 20:59:00 user nova-compute[75571]:       <nova:ports>
Nov 28 20:59:00 user nova-compute[75571]:         <nova:port uuid="3e8f3c87-f107-471d-ab79-72568b1b5e25">
Nov 28 20:59:00 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 20:59:00 user nova-compute[75571]:         </nova:port>
Nov 28 20:59:00 user nova-compute[75571]:       </nova:ports>
Nov 28 20:59:00 user nova-compute[75571]:     </nova:instance>
Nov 28 20:59:00 user nova-compute[75571]:   </metadata>
Nov 28 20:59:00 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 20:59:00 user nova-compute[75571]:     <system>
Nov 28 20:59:00 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 20:59:00 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 20:59:00 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 20:59:00 user nova-compute[75571]:       <entry name="serial">523bbab2-2a04-4bf9-9318-d80922e55cee</entry>
Nov 28 20:59:00 user nova-compute[75571]:       <entry name="uuid">523bbab2-2a04-4bf9-9318-d80922e55cee</entry>
Nov 28 20:59:00 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 20:59:00 user nova-compute[75571]:     </system>
Nov 28 20:59:00 user nova-compute[75571]:   </sysinfo>
Nov 28 20:59:00 user nova-compute[75571]:   <os>
Nov 28 20:59:00 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 20:59:00 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 20:59:00 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 20:59:00 user nova-compute[75571]:   </os>
Nov 28 20:59:00 user nova-compute[75571]:   <features>
Nov 28 20:59:00 user nova-compute[75571]:     <acpi/>
Nov 28 20:59:00 user nova-compute[75571]:     <apic/>
Nov 28 20:59:00 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 20:59:00 user nova-compute[75571]:   </features>
Nov 28 20:59:00 user nova-compute[75571]:   <clock offset="utc">
Nov 28 20:59:00 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 20:59:00 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 20:59:00 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 20:59:00 user nova-compute[75571]:   </clock>
Nov 28 20:59:00 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 20:59:00 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 20:59:00 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 20:59:00 user nova-compute[75571]:   </cpu>
Nov 28 20:59:00 user nova-compute[75571]:   <devices>
Nov 28 20:59:00 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 20:59:00 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 20:59:00 user nova-compute[75571]:       <source dev="/dev/sdb"/>
Nov 28 20:59:00 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 20:59:00 user nova-compute[75571]:       <serial>1a84308f-2fe7-4fb7-bcc3-525c0956e6fa</serial>
Nov 28 20:59:00 user nova-compute[75571]:     </disk>
Nov 28 20:59:00 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 20:59:00 user nova-compute[75571]:       <mac address="fa:16:3e:42:89:02"/>
Nov 28 20:59:00 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:59:00 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 20:59:00 user nova-compute[75571]:       <target dev="tap3e8f3c87-f1"/>
Nov 28 20:59:00 user nova-compute[75571]:     </interface>
Nov 28 20:59:00 user nova-compute[75571]:     <serial type="pty">
Nov 28 20:59:00 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/523bbab2-2a04-4bf9-9318-d80922e55cee/console.log" append="off"/>
Nov 28 20:59:00 user nova-compute[75571]:     </serial>
Nov 28 20:59:00 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 20:59:00 user nova-compute[75571]:     <video>
Nov 28 20:59:00 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 20:59:00 user nova-compute[75571]:     </video>
Nov 28 20:59:00 user nova-compute[75571]:     <rng model="virtio">
Nov 28 20:59:00 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 20:59:00 user nova-compute[75571]:     </rng>
Nov 28 20:59:00 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 20:59:00 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 20:59:00 user nova-compute[75571]:       <stats period="10"/>
Nov 28 20:59:00 user nova-compute[75571]:     </memballoon>
Nov 28 20:59:00 user nova-compute[75571]:   </devices>
Nov 28 20:59:00 user nova-compute[75571]: </domain>
Nov 28 20:59:00 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1315081543',display_name='tempest-TestVolumeBootPattern-server-1315081543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1315081543',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-uttjpvur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T20:58:46Z,user_data=None,user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=523bbab2-2a04-4bf9-9318-d80922e55cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "address": "fa:16:3e:42:89:02", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f3c87-f1", "ovs_interfaceid": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "address": "fa:16:3e:42:89:02", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f3c87-f1", "ovs_interfaceid": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:89:02,bridge_name='br-int',has_traffic_filtering=True,id=3e8f3c87-f107-471d-ab79-72568b1b5e25,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8f3c87-f1') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG os_vif [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:89:02,bridge_name='br-int',has_traffic_filtering=True,id=3e8f3c87-f107-471d-ab79-72568b1b5e25,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8f3c87-f1') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10012f43-84f9-5b78-85a4-fbb8bd84ed3b', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e8f3c87-f1, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e8f3c87-f1, col_values=(('qos', UUID('903c2aef-671f-4bcc-ab22-773ff56b712c')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e8f3c87-f1, col_values=(('external_ids', {'iface-id': '3e8f3c87-f107-471d-ab79-72568b1b5e25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:89:02', 'vm-uuid': '523bbab2-2a04-4bf9-9318-d80922e55cee'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:00 user nova-compute[75571]: INFO os_vif [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:89:02,bridge_name='br-int',has_traffic_filtering=True,id=3e8f3c87-f107-471d-ab79-72568b1b5e25,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8f3c87-f1')
Nov 28 20:59:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] No VIF found with MAC fa:16:3e:42:89:02, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 20:59:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:01 user nova-compute[75571]: DEBUG nova.compute.manager [req-04527119-32ef-4342-b74a-82d03453ef73 req-4a46a041-fece-46f5-8c16-efda22ea5123 service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Received event network-vif-plugged-3e8f3c87-f107-471d-ab79-72568b1b5e25 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:59:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-04527119-32ef-4342-b74a-82d03453ef73 req-4a46a041-fece-46f5-8c16-efda22ea5123 service nova] Acquiring lock "523bbab2-2a04-4bf9-9318-d80922e55cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:59:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-04527119-32ef-4342-b74a-82d03453ef73 req-4a46a041-fece-46f5-8c16-efda22ea5123 service nova] Lock "523bbab2-2a04-4bf9-9318-d80922e55cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:59:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-04527119-32ef-4342-b74a-82d03453ef73 req-4a46a041-fece-46f5-8c16-efda22ea5123 service nova] Lock "523bbab2-2a04-4bf9-9318-d80922e55cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:59:01 user nova-compute[75571]: DEBUG nova.compute.manager [req-04527119-32ef-4342-b74a-82d03453ef73 req-4a46a041-fece-46f5-8c16-efda22ea5123 service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] No waiting events found dispatching network-vif-plugged-3e8f3c87-f107-471d-ab79-72568b1b5e25 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:59:01 user nova-compute[75571]: WARNING nova.compute.manager [req-04527119-32ef-4342-b74a-82d03453ef73 req-4a46a041-fece-46f5-8c16-efda22ea5123 service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Received unexpected event network-vif-plugged-3e8f3c87-f107-471d-ab79-72568b1b5e25 for instance with vm_state building and task_state spawning.
Nov 28 20:59:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:03 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 20:59:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 20:59:03 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Instance spawned successfully.
Nov 28 20:59:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 20:59:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:59:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:59:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:59:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:59:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:59:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 20:59:03 user nova-compute[75571]: INFO nova.compute.manager [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 28 20:59:03 user nova-compute[75571]: DEBUG nova.compute.manager [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 20:59:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-050b2c3e-164b-4457-b29c-ec6d41fc2e13 req-2b55a7ac-eac6-4688-b869-daed3a204577 service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Received event network-vif-plugged-3e8f3c87-f107-471d-ab79-72568b1b5e25 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 20:59:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-050b2c3e-164b-4457-b29c-ec6d41fc2e13 req-2b55a7ac-eac6-4688-b869-daed3a204577 service nova] Acquiring lock "523bbab2-2a04-4bf9-9318-d80922e55cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:59:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-050b2c3e-164b-4457-b29c-ec6d41fc2e13 req-2b55a7ac-eac6-4688-b869-daed3a204577 service nova] Lock "523bbab2-2a04-4bf9-9318-d80922e55cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:59:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-050b2c3e-164b-4457-b29c-ec6d41fc2e13 req-2b55a7ac-eac6-4688-b869-daed3a204577 service nova] Lock "523bbab2-2a04-4bf9-9318-d80922e55cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:59:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-050b2c3e-164b-4457-b29c-ec6d41fc2e13 req-2b55a7ac-eac6-4688-b869-daed3a204577 service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] No waiting events found dispatching network-vif-plugged-3e8f3c87-f107-471d-ab79-72568b1b5e25 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 20:59:03 user nova-compute[75571]: WARNING nova.compute.manager [req-050b2c3e-164b-4457-b29c-ec6d41fc2e13 req-2b55a7ac-eac6-4688-b869-daed3a204577 service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Received unexpected event network-vif-plugged-3e8f3c87-f107-471d-ab79-72568b1b5e25 for instance with vm_state building and task_state spawning.
Nov 28 20:59:03 user nova-compute[75571]: INFO nova.compute.manager [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Took 18.00 seconds to build instance.
Nov 28 20:59:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "523bbab2-2a04-4bf9-9318-d80922e55cee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.109s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:59:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:59:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:59:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:59:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:59:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:25 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:59:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:34 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:59:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:59:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:37 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:59:37 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:59:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 20:59:38 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:59:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 20:59:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 20:59:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-523bbab2-2a04-4bf9-9318-d80922e55cee" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 20:59:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-523bbab2-2a04-4bf9-9318-d80922e55cee" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 20:59:38 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 20:59:38 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 523bbab2-2a04-4bf9-9318-d80922e55cee {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 20:59:38 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Updating instance_info_cache with network_info: [{"id": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "address": "fa:16:3e:42:89:02", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f3c87-f1", "ovs_interfaceid": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 20:59:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-523bbab2-2a04-4bf9-9318-d80922e55cee" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 20:59:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 20:59:38 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:59:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:41 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:59:42 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 20:59:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:59:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:59:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:59:42 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 20:59:42 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 20:59:42 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:59:42 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 20:59:42 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9083MB free_disk=25.016517639160156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 20:59:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 20:59:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 20:59:42 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 523bbab2-2a04-4bf9-9318-d80922e55cee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 20:59:42 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 20:59:42 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 20:59:42 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 20:59:42 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 20:59:42 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 20:59:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 20:59:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:59:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:59:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:59:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:59:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:59:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:59:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:59:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:59:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 20:59:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:59:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 20:59:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 20:59:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:59:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 20:59:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:00:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:00:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:00:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:00:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:00:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:00:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:00:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:00:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:27 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:00:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:34 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:00:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "523bbab2-2a04-4bf9-9318-d80922e55cee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "523bbab2-2a04-4bf9-9318-d80922e55cee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "523bbab2-2a04-4bf9-9318-d80922e55cee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "523bbab2-2a04-4bf9-9318-d80922e55cee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "523bbab2-2a04-4bf9-9318-d80922e55cee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:00:36 user nova-compute[75571]: INFO nova.compute.manager [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Terminating instance
Nov 28 21:00:36 user nova-compute[75571]: DEBUG nova.compute.manager [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG nova.compute.manager [req-24c598e3-298b-4564-b411-7420a0d169fc req-675146a3-24e9-4766-87ed-cc08936dbeea service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Received event network-vif-unplugged-3e8f3c87-f107-471d-ab79-72568b1b5e25 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-24c598e3-298b-4564-b411-7420a0d169fc req-675146a3-24e9-4766-87ed-cc08936dbeea service nova] Acquiring lock "523bbab2-2a04-4bf9-9318-d80922e55cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-24c598e3-298b-4564-b411-7420a0d169fc req-675146a3-24e9-4766-87ed-cc08936dbeea service nova] Lock "523bbab2-2a04-4bf9-9318-d80922e55cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-24c598e3-298b-4564-b411-7420a0d169fc req-675146a3-24e9-4766-87ed-cc08936dbeea service nova] Lock "523bbab2-2a04-4bf9-9318-d80922e55cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG nova.compute.manager [req-24c598e3-298b-4564-b411-7420a0d169fc req-675146a3-24e9-4766-87ed-cc08936dbeea service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] No waiting events found dispatching network-vif-unplugged-3e8f3c87-f107-471d-ab79-72568b1b5e25 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG nova.compute.manager [req-24c598e3-298b-4564-b411-7420a0d169fc req-675146a3-24e9-4766-87ed-cc08936dbeea service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Received event network-vif-unplugged-3e8f3c87-f107-471d-ab79-72568b1b5e25 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 21:00:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:37 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Instance destroyed successfully.
Nov 28 21:00:37 user nova-compute[75571]: DEBUG nova.objects.instance [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lazy-loading 'resources' on Instance uuid 523bbab2-2a04-4bf9-9318-d80922e55cee {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T20:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1315081543',display_name='tempest-TestVolumeBootPattern-server-1315081543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1315081543',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T20:59:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-uttjpvur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T20:59:04Z,user_data=None,user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=523bbab2-2a04-4bf9-9318-d80922e55cee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "address": "fa:16:3e:42:89:02", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f3c87-f1", "ovs_interfaceid": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "address": "fa:16:3e:42:89:02", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f3c87-f1", "ovs_interfaceid": "3e8f3c87-f107-471d-ab79-72568b1b5e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:89:02,bridge_name='br-int',has_traffic_filtering=True,id=3e8f3c87-f107-471d-ab79-72568b1b5e25,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8f3c87-f1') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_vif [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:89:02,bridge_name='br-int',has_traffic_filtering=True,id=3e8f3c87-f107-471d-ab79-72568b1b5e25,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8f3c87-f1') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e8f3c87-f1, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=903c2aef-671f-4bcc-ab22-773ff56b712c) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:00:37 user nova-compute[75571]: INFO os_vif [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:89:02,bridge_name='br-int',has_traffic_filtering=True,id=3e8f3c87-f107-471d-ab79-72568b1b5e25,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8f3c87-f1')
Nov 28 21:00:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUBnLCpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:00:37 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa68ab8-5cc9-4a26-a050-27e16b874920]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 21:00:37 user nova-compute[75571]: No targets found.
Nov 28 21:00:37 user nova-compute[75571]: iSNS:
Nov 28 21:00:37 user nova-compute[75571]: No targets found.
Nov 28 21:00:37 user nova-compute[75571]: STATIC:
Nov 28 21:00:37 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa
Nov 28 21:00:37 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 21:00:37 user nova-compute[75571]:                 Iface Name: default
Nov 28 21:00:37 user nova-compute[75571]: FIRMWARE:
Nov 28 21:00:37 user nova-compute[75571]: No targets found.
Nov 28 21:00:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 21:00:37 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 21:00:37 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc16bd30-ed21-4a14-bbd6-a72cffe5d2e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[048df53d-ab4d-4cad-956d-cacad40caa3e]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa (non-flash)
Nov 28 21:00:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa (non-flash)
Nov 28 21:00:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77682da050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d48fbaf-6aae-4778-8c09-da3ddf3c1ccb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43badef-7236-4c03-993b-5f411096fcb0]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a674f103-9438-4aec-bf11-2998902c3640]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.071s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[db14196f-3b3e-4196-8999-ed2cfd67f2e6]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cccb6b-ecf0-42af-8029-dc59d0214f4e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a16659-a427-453f-8a8d-3f0e8566192f]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa, portal: 172.16.0.220,3260]
Nov 28 21:00:37 user nova-compute[75571]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa, portal: 172.16.0.220,3260] successful.
Nov 28 21:00:37 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a84308f-2fe7-4fb7-bcc3-525c0956e6fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8929fa-2a77-4fd8-a35e-7b521d857e6f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== disconnect_volume: return (310ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 21:00:37 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Deleting instance files /opt/stack/data/nova/instances/523bbab2-2a04-4bf9-9318-d80922e55cee_del
Nov 28 21:00:37 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Deletion of /opt/stack/data/nova/instances/523bbab2-2a04-4bf9-9318-d80922e55cee_del complete
Nov 28 21:00:37 user nova-compute[75571]: INFO nova.compute.manager [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 28 21:00:37 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 21:00:37 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:00:37 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Took 0.43 seconds to deallocate network for instance.
Nov 28 21:00:38 user nova-compute[75571]: DEBUG nova.compute.manager [req-6b6f2382-43d7-4c29-9d11-4b7634c1e82b req-681beefd-072f-43b5-abdc-a951efa0dea3 service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Received event network-vif-plugged-3e8f3c87-f107-471d-ab79-72568b1b5e25 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:00:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6b6f2382-43d7-4c29-9d11-4b7634c1e82b req-681beefd-072f-43b5-abdc-a951efa0dea3 service nova] Acquiring lock "523bbab2-2a04-4bf9-9318-d80922e55cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:00:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6b6f2382-43d7-4c29-9d11-4b7634c1e82b req-681beefd-072f-43b5-abdc-a951efa0dea3 service nova] Lock "523bbab2-2a04-4bf9-9318-d80922e55cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:00:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6b6f2382-43d7-4c29-9d11-4b7634c1e82b req-681beefd-072f-43b5-abdc-a951efa0dea3 service nova] Lock "523bbab2-2a04-4bf9-9318-d80922e55cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:00:38 user nova-compute[75571]: DEBUG nova.compute.manager [req-6b6f2382-43d7-4c29-9d11-4b7634c1e82b req-681beefd-072f-43b5-abdc-a951efa0dea3 service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] No waiting events found dispatching network-vif-plugged-3e8f3c87-f107-471d-ab79-72568b1b5e25 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:00:38 user nova-compute[75571]: WARNING nova.compute.manager [req-6b6f2382-43d7-4c29-9d11-4b7634c1e82b req-681beefd-072f-43b5-abdc-a951efa0dea3 service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Received unexpected event network-vif-plugged-3e8f3c87-f107-471d-ab79-72568b1b5e25 for instance with vm_state active and task_state deleting.
Nov 28 21:00:38 user nova-compute[75571]: DEBUG nova.compute.manager [req-6b6f2382-43d7-4c29-9d11-4b7634c1e82b req-681beefd-072f-43b5-abdc-a951efa0dea3 service nova] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Received event network-vif-deleted-3e8f3c87-f107-471d-ab79-72568b1b5e25 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:00:38 user nova-compute[75571]: INFO nova.compute.manager [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Took 0.73 seconds to detach 1 volumes for instance.
Nov 28 21:00:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Deleting volume: 1a84308f-2fe7-4fb7-bcc3-525c0956e6fa {{(pid=75571) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 21:00:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:00:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:00:38 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:00:38 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:00:38 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:00:38 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Deleted allocations for instance 523bbab2-2a04-4bf9-9318-d80922e55cee
Nov 28 21:00:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "523bbab2-2a04-4bf9-9318-d80922e55cee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.709s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:00:39 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:00:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:00:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:00:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 21:00:39 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:00:39 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:00:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:43 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:00:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:00:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:00:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:00:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:00:44 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:00:44 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:00:44 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:00:44 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9184MB free_disk=25.015750885009766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:00:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:00:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:00:44 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:00:44 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:00:44 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:00:44 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:00:44 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:00:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:00:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:00:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:00:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:00:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:00:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:52 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:00:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:01:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:01:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:01:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:01:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:01:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:01:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:01:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:12 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:01:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:27 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:27 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:01:32 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:01:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:01:37 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:01:37 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:01:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:01:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:01:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:01:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:01:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:01:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:39 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:01:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:01:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:01:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 21:01:39 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:01:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:01:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:01:40 user nova-compute[75571]: DEBUG nova.compute.manager [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 21:01:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:01:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:01:40 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 21:01:40 user nova-compute[75571]: INFO nova.compute.claims [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Claim successful on node user
Nov 28 21:01:40 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:01:40 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:01:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:01:40 user nova-compute[75571]: DEBUG nova.compute.manager [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 21:01:40 user nova-compute[75571]: DEBUG nova.compute.manager [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 21:01:40 user nova-compute[75571]: DEBUG nova.network.neutron [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 21:01:40 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 21:01:40 user nova-compute[75571]: DEBUG nova.compute.manager [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 21:01:40 user nova-compute[75571]: INFO nova.virt.block_device [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Booting with volume 77bb07d6-673c-4282-b7e5-67a6ddc8d808 at /dev/vda
Nov 28 21:01:41 user nova-compute[75571]: DEBUG os_brick.utils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0453f5-eb10-4d42-83b4-870b1d8fdcee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c4ce5c-19c9-48bd-9619-205ff28107c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d4a724-4211-411b-9848-a25d27690d51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e4676d-1ab0-457f-b80f-3b52a6cc352e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:01:41 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 21:01:41 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[951a6f0d-a278-406c-9f8c-e439bd7ad86d]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG os_brick.utils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Updating existing volume attachment record: fd752b86-dbf8-4884-8ee4-251423dacee9 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG nova.policy [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 21:01:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Successfully created port: e36f67df-c2a4-4e01-802a-15cbb22e1cf8 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 21:01:42 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Successfully updated port: e36f67df-c2a4-4e01-802a-15cbb22e1cf8 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 21:01:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:01:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquired lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:01:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 21:01:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 21:01:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-25fde031-b444-4116-b882-90821d4f0365 req-e51d8cc7-5cc1-4751-adf0-8e36bd0a5714 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Received event network-changed-e36f67df-c2a4-4e01-802a-15cbb22e1cf8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:01:42 user nova-compute[75571]: DEBUG nova.compute.manager [req-25fde031-b444-4116-b882-90821d4f0365 req-e51d8cc7-5cc1-4751-adf0-8e36bd0a5714 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Refreshing instance network info cache due to event network-changed-e36f67df-c2a4-4e01-802a-15cbb22e1cf8. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 21:01:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-25fde031-b444-4116-b882-90821d4f0365 req-e51d8cc7-5cc1-4751-adf0-8e36bd0a5714 service nova] Acquiring lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:01:42 user nova-compute[75571]: DEBUG nova.network.neutron [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Updating instance_info_cache with network_info: [{"id": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "address": "fa:16:3e:60:39:3e", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36f67df-c2", "ovs_interfaceid": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:01:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Releasing lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:01:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Instance network_info: |[{"id": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "address": "fa:16:3e:60:39:3e", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36f67df-c2", "ovs_interfaceid": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 21:01:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-25fde031-b444-4116-b882-90821d4f0365 req-e51d8cc7-5cc1-4751-adf0-8e36bd0a5714 service nova] Acquired lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:01:42 user nova-compute[75571]: DEBUG nova.network.neutron [req-25fde031-b444-4116-b882-90821d4f0365 req-e51d8cc7-5cc1-4751-adf0-8e36bd0a5714 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Refreshing network info cache for port e36f67df-c2a4-4e01-802a-15cbb22e1cf8 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 21:01:43 user nova-compute[75571]: DEBUG nova.network.neutron [req-25fde031-b444-4116-b882-90821d4f0365 req-e51d8cc7-5cc1-4751-adf0-8e36bd0a5714 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Updated VIF entry in instance network info cache for port e36f67df-c2a4-4e01-802a-15cbb22e1cf8. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 21:01:43 user nova-compute[75571]: DEBUG nova.network.neutron [req-25fde031-b444-4116-b882-90821d4f0365 req-e51d8cc7-5cc1-4751-adf0-8e36bd0a5714 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Updating instance_info_cache with network_info: [{"id": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "address": "fa:16:3e:60:39:3e", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36f67df-c2", "ovs_interfaceid": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:01:43 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-25fde031-b444-4116-b882-90821d4f0365 req-e51d8cc7-5cc1-4751-adf0-8e36bd0a5714 service nova] Releasing lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:01:45 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:01:45 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:01:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:01:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:01:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:01:45 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:01:45 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:01:45 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:01:45 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9195MB free_disk=25.014469146728516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:01:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:01:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:01:45 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:01:45 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:01:45 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:01:45 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:01:45 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:01:45 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:01:45 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:01:47 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.compute.manager [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 21:01:48 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Creating image(s)
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Ensure instance console log exists: /opt/stack/data/nova/instances/95a5bda9-0bab-43f3-a77b-9dbfde4c0008/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Start _get_guest_xml network_info=[{"id": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "address": "fa:16:3e:60:39:3e", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36f67df-c2", "ovs_interfaceid": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OniAwfCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '95a5bda9-0bab-43f3-a77b-9dbfde4c0008', 'attached_at': '', 'detached_at': '', 'volume_id': '77bb07d6-673c-4282-b7e5-67a6ddc8d808', 'serial': '77bb07d6-673c-4282-b7e5-67a6ddc8d808'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'fd752b86-dbf8-4884-8ee4-251423dacee9', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 21:01:48 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:01:48 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OniAwfCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:01:48 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:01:48 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:01:48 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2573e11b-142b-4882-b594-1ae45a5736cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 21:01:48 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bca9bc5-63b3-4816-b26a-dccc468c0e0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808] added
Nov 28 21:01:48 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b75436b-15d0-457d-a359-c4397ef1735f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9757fd09-67fe-45ab-b2fc-202501bd3b51]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OniAwfCl {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OniAwfCl" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d6c6c7-2062-43e4-a821-500c98cbefbd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OniAwfCl'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[89139e61-71ad-4287-ada4-9da652319212]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[579c6e0e-e35c-40ae-adee-e38591705db4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 21:01:48 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 21:01:48 user nova-compute[75571]:  {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:01:48 user nova-compute[75571]: WARNING os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 21:01:48 user nova-compute[75571]: 
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3753efa-f2d6-4eb3-bd9f-c6de1b19c41c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808, portal: 172.16.0.220,3260]
Nov 28 21:01:48 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808, portal: 172.16.0.220,3260] successful.
Nov 28 21:01:48 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72d55a5-d108-40eb-b96a-3a6c3fab95c7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[553663a4-0596-4dec-a782-1f8ee0345be2]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 (non-flash)
Nov 28 21:01:48 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 (non-flash)
Nov 28 21:01:48 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d3b095-b10a-40fd-a0d3-a3f45f7171b8]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 21:01:48 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OniAwfCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23966656165353133', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966656165353133', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:01:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-529793188',display_name='tempest-TestVolumeBootPattern-volume-backed-server-529793188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-529793188',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/MkJk8yOJyVUDVMSAWkILaxwFgsrVHs1ekfKqJM0WoG/ObKz6549Z0YYDm+bA8H8MBa8yAktgYF0rT6LZ6SK2UGBhV/y9bcPH66+bXDNUd0nVL6S+nhT0itdm9L2qOsQ==',key_name='tempest-keypair-873960613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-5r3svfde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T21:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=95a5bda9-0bab-43f3-a77b-9dbfde4c0008,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "address": "fa:16:3e:60:39:3e", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36f67df-c2", "ovs_interfaceid": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "address": "fa:16:3e:60:39:3e", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36f67df-c2", "ovs_interfaceid": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:39:3e,bridge_name='br-int',has_traffic_filtering=True,id=e36f67df-c2a4-4e01-802a-15cbb22e1cf8,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36f67df-c2') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG nova.objects.instance [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lazy-loading 'pci_devices' on Instance uuid 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] End _get_guest_xml xml=<domain type="kvm">
Nov 28 21:01:49 user nova-compute[75571]:   <uuid>95a5bda9-0bab-43f3-a77b-9dbfde4c0008</uuid>
Nov 28 21:01:49 user nova-compute[75571]:   <name>instance-00000030</name>
Nov 28 21:01:49 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 21:01:49 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 21:01:49 user nova-compute[75571]:   <metadata>
Nov 28 21:01:49 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 21:01:49 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 21:01:49 user nova-compute[75571]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-529793188</nova:name>
Nov 28 21:01:49 user nova-compute[75571]:       <nova:creationTime>2023-11-28 21:01:48</nova:creationTime>
Nov 28 21:01:49 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 21:01:49 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 21:01:49 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 21:01:49 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 21:01:49 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 21:01:49 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 21:01:49 user nova-compute[75571]:       </nova:flavor>
Nov 28 21:01:49 user nova-compute[75571]:       <nova:owner>
Nov 28 21:01:49 user nova-compute[75571]:         <nova:user uuid="fc8d37446f714002b8c5c4395ab82d58">tempest-TestVolumeBootPattern-845056434-project-member</nova:user>
Nov 28 21:01:49 user nova-compute[75571]:         <nova:project uuid="f852e1ca6d934711942031022097eb36">tempest-TestVolumeBootPattern-845056434</nova:project>
Nov 28 21:01:49 user nova-compute[75571]:       </nova:owner>
Nov 28 21:01:49 user nova-compute[75571]:       <nova:ports>
Nov 28 21:01:49 user nova-compute[75571]:         <nova:port uuid="e36f67df-c2a4-4e01-802a-15cbb22e1cf8">
Nov 28 21:01:49 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 21:01:49 user nova-compute[75571]:         </nova:port>
Nov 28 21:01:49 user nova-compute[75571]:       </nova:ports>
Nov 28 21:01:49 user nova-compute[75571]:     </nova:instance>
Nov 28 21:01:49 user nova-compute[75571]:   </metadata>
Nov 28 21:01:49 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 21:01:49 user nova-compute[75571]:     <system>
Nov 28 21:01:49 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 21:01:49 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 21:01:49 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 21:01:49 user nova-compute[75571]:       <entry name="serial">95a5bda9-0bab-43f3-a77b-9dbfde4c0008</entry>
Nov 28 21:01:49 user nova-compute[75571]:       <entry name="uuid">95a5bda9-0bab-43f3-a77b-9dbfde4c0008</entry>
Nov 28 21:01:49 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 21:01:49 user nova-compute[75571]:     </system>
Nov 28 21:01:49 user nova-compute[75571]:   </sysinfo>
Nov 28 21:01:49 user nova-compute[75571]:   <os>
Nov 28 21:01:49 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 21:01:49 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 21:01:49 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 21:01:49 user nova-compute[75571]:   </os>
Nov 28 21:01:49 user nova-compute[75571]:   <features>
Nov 28 21:01:49 user nova-compute[75571]:     <acpi/>
Nov 28 21:01:49 user nova-compute[75571]:     <apic/>
Nov 28 21:01:49 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 21:01:49 user nova-compute[75571]:   </features>
Nov 28 21:01:49 user nova-compute[75571]:   <clock offset="utc">
Nov 28 21:01:49 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 21:01:49 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 21:01:49 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 21:01:49 user nova-compute[75571]:   </clock>
Nov 28 21:01:49 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 21:01:49 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 21:01:49 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 21:01:49 user nova-compute[75571]:   </cpu>
Nov 28 21:01:49 user nova-compute[75571]:   <devices>
Nov 28 21:01:49 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 21:01:49 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:01:49 user nova-compute[75571]:       <source dev="/dev/sdb"/>
Nov 28 21:01:49 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 21:01:49 user nova-compute[75571]:       <serial>77bb07d6-673c-4282-b7e5-67a6ddc8d808</serial>
Nov 28 21:01:49 user nova-compute[75571]:     </disk>
Nov 28 21:01:49 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 21:01:49 user nova-compute[75571]:       <mac address="fa:16:3e:60:39:3e"/>
Nov 28 21:01:49 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 21:01:49 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 21:01:49 user nova-compute[75571]:       <target dev="tape36f67df-c2"/>
Nov 28 21:01:49 user nova-compute[75571]:     </interface>
Nov 28 21:01:49 user nova-compute[75571]:     <serial type="pty">
Nov 28 21:01:49 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/95a5bda9-0bab-43f3-a77b-9dbfde4c0008/console.log" append="off"/>
Nov 28 21:01:49 user nova-compute[75571]:     </serial>
Nov 28 21:01:49 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 21:01:49 user nova-compute[75571]:     <video>
Nov 28 21:01:49 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 21:01:49 user nova-compute[75571]:     </video>
Nov 28 21:01:49 user nova-compute[75571]:     <rng model="virtio">
Nov 28 21:01:49 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 21:01:49 user nova-compute[75571]:     </rng>
Nov 28 21:01:49 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 21:01:49 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 21:01:49 user nova-compute[75571]:       <stats period="10"/>
Nov 28 21:01:49 user nova-compute[75571]:     </memballoon>
Nov 28 21:01:49 user nova-compute[75571]:   </devices>
Nov 28 21:01:49 user nova-compute[75571]: </domain>
Nov 28 21:01:49 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:01:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-529793188',display_name='tempest-TestVolumeBootPattern-volume-backed-server-529793188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-529793188',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/MkJk8yOJyVUDVMSAWkILaxwFgsrVHs1ekfKqJM0WoG/ObKz6549Z0YYDm+bA8H8MBa8yAktgYF0rT6LZ6SK2UGBhV/y9bcPH66+bXDNUd0nVL6S+nhT0itdm9L2qOsQ==',key_name='tempest-keypair-873960613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-5r3svfde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T21:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=95a5bda9-0bab-43f3-a77b-9dbfde4c0008,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "address": "fa:16:3e:60:39:3e", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36f67df-c2", "ovs_interfaceid": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "address": "fa:16:3e:60:39:3e", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36f67df-c2", "ovs_interfaceid": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:39:3e,bridge_name='br-int',has_traffic_filtering=True,id=e36f67df-c2a4-4e01-802a-15cbb22e1cf8,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36f67df-c2') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG os_vif [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:39:3e,bridge_name='br-int',has_traffic_filtering=True,id=e36f67df-c2a4-4e01-802a-15cbb22e1cf8,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36f67df-c2') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '359c7237-3fa7-57ef-a535-d5b34ef6a8a3', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape36f67df-c2, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape36f67df-c2, col_values=(('qos', UUID('1ed4328e-4162-4c05-8dea-3e4d33f37a42')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape36f67df-c2, col_values=(('external_ids', {'iface-id': 'e36f67df-c2a4-4e01-802a-15cbb22e1cf8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:39:3e', 'vm-uuid': '95a5bda9-0bab-43f3-a77b-9dbfde4c0008'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:49 user nova-compute[75571]: INFO os_vif [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:39:3e,bridge_name='br-int',has_traffic_filtering=True,id=e36f67df-c2a4-4e01-802a-15cbb22e1cf8,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36f67df-c2')
Nov 28 21:01:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 21:01:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] No VIF found with MAC fa:16:3e:60:39:3e, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 21:01:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:50 user nova-compute[75571]: DEBUG nova.compute.manager [req-80790c22-2421-4231-991d-de3be62c55ca req-1bc65d30-be63-47fb-bd57-b2c88da62d4e service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Received event network-vif-plugged-e36f67df-c2a4-4e01-802a-15cbb22e1cf8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:01:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-80790c22-2421-4231-991d-de3be62c55ca req-1bc65d30-be63-47fb-bd57-b2c88da62d4e service nova] Acquiring lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:01:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-80790c22-2421-4231-991d-de3be62c55ca req-1bc65d30-be63-47fb-bd57-b2c88da62d4e service nova] Lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:01:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-80790c22-2421-4231-991d-de3be62c55ca req-1bc65d30-be63-47fb-bd57-b2c88da62d4e service nova] Lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:01:50 user nova-compute[75571]: DEBUG nova.compute.manager [req-80790c22-2421-4231-991d-de3be62c55ca req-1bc65d30-be63-47fb-bd57-b2c88da62d4e service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] No waiting events found dispatching network-vif-plugged-e36f67df-c2a4-4e01-802a-15cbb22e1cf8 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:01:50 user nova-compute[75571]: WARNING nova.compute.manager [req-80790c22-2421-4231-991d-de3be62c55ca req-1bc65d30-be63-47fb-bd57-b2c88da62d4e service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Received unexpected event network-vif-plugged-e36f67df-c2a4-4e01-802a-15cbb22e1cf8 for instance with vm_state building and task_state spawning.
Nov 28 21:01:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:52 user nova-compute[75571]: DEBUG nova.compute.manager [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 21:01:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 21:01:52 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Instance spawned successfully.
Nov 28 21:01:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 21:01:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:01:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:01:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:01:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:01:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:01:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:01:52 user nova-compute[75571]: INFO nova.compute.manager [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 28 21:01:52 user nova-compute[75571]: DEBUG nova.compute.manager [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 21:01:53 user nova-compute[75571]: DEBUG nova.compute.manager [req-d147cc5f-638f-414d-ab4c-8c69cb799dc7 req-71073e14-11a6-4fbd-afe0-440aa5e69eb4 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Received event network-vif-plugged-e36f67df-c2a4-4e01-802a-15cbb22e1cf8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:01:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d147cc5f-638f-414d-ab4c-8c69cb799dc7 req-71073e14-11a6-4fbd-afe0-440aa5e69eb4 service nova] Acquiring lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:01:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d147cc5f-638f-414d-ab4c-8c69cb799dc7 req-71073e14-11a6-4fbd-afe0-440aa5e69eb4 service nova] Lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:01:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d147cc5f-638f-414d-ab4c-8c69cb799dc7 req-71073e14-11a6-4fbd-afe0-440aa5e69eb4 service nova] Lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:01:53 user nova-compute[75571]: DEBUG nova.compute.manager [req-d147cc5f-638f-414d-ab4c-8c69cb799dc7 req-71073e14-11a6-4fbd-afe0-440aa5e69eb4 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] No waiting events found dispatching network-vif-plugged-e36f67df-c2a4-4e01-802a-15cbb22e1cf8 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:01:53 user nova-compute[75571]: WARNING nova.compute.manager [req-d147cc5f-638f-414d-ab4c-8c69cb799dc7 req-71073e14-11a6-4fbd-afe0-440aa5e69eb4 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Received unexpected event network-vif-plugged-e36f67df-c2a4-4e01-802a-15cbb22e1cf8 for instance with vm_state building and task_state spawning.
Nov 28 21:01:53 user nova-compute[75571]: INFO nova.compute.manager [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Took 12.56 seconds to build instance.
Nov 28 21:01:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.668s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:01:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:01:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:02:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:02:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:02:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:02:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:02:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:02:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:02:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:02:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:02:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:02:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:02:27 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:02:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:02:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:02:36 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:02:38 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:02:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:02:39 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:02:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:02:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:02:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:02:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:02:39 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:02:39 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:02:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:02:39 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Updating instance_info_cache with network_info: [{"id": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "address": "fa:16:3e:60:39:3e", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36f67df-c2", "ovs_interfaceid": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:02:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:02:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:02:39 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:02:41 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:02:42 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:02:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:02:46 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:02:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:02:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:02:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:02:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:02:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 21:02:46 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:02:46 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:02:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9085MB free_disk=25.013103485107422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:02:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:02:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:02:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:02:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:02:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:02:46 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing inventories for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 21:02:46 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating ProviderTree inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 21:02:46 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 21:02:46 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing aggregate associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, aggregates: None {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 21:02:47 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing trait associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 21:02:47 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:02:47 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:02:47 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:02:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:02:48 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:02:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:02:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:02:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75571) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 21:02:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:02:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:02:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:02:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:02:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:02:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:02:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:03:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 21:03:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] There are 0 instances to clean {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 21:03:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:03:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:03:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:03:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:03:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:03:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:03:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:03:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:03:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:03:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:29 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:03:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:03:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:03:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:03:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:03:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:31 user nova-compute[75571]: DEBUG nova.compute.manager [req-6d301f40-293b-43df-8210-8025e439d5a6 req-8541a4e4-2fb9-44c4-94f7-9ad5fbe840e2 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Received event network-changed-e36f67df-c2a4-4e01-802a-15cbb22e1cf8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:03:31 user nova-compute[75571]: DEBUG nova.compute.manager [req-6d301f40-293b-43df-8210-8025e439d5a6 req-8541a4e4-2fb9-44c4-94f7-9ad5fbe840e2 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Refreshing instance network info cache due to event network-changed-e36f67df-c2a4-4e01-802a-15cbb22e1cf8. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 21:03:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6d301f40-293b-43df-8210-8025e439d5a6 req-8541a4e4-2fb9-44c4-94f7-9ad5fbe840e2 service nova] Acquiring lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:03:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6d301f40-293b-43df-8210-8025e439d5a6 req-8541a4e4-2fb9-44c4-94f7-9ad5fbe840e2 service nova] Acquired lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:03:31 user nova-compute[75571]: DEBUG nova.network.neutron [req-6d301f40-293b-43df-8210-8025e439d5a6 req-8541a4e4-2fb9-44c4-94f7-9ad5fbe840e2 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Refreshing network info cache for port e36f67df-c2a4-4e01-802a-15cbb22e1cf8 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 21:03:32 user nova-compute[75571]: DEBUG nova.network.neutron [req-6d301f40-293b-43df-8210-8025e439d5a6 req-8541a4e4-2fb9-44c4-94f7-9ad5fbe840e2 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Updated VIF entry in instance network info cache for port e36f67df-c2a4-4e01-802a-15cbb22e1cf8. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 21:03:32 user nova-compute[75571]: DEBUG nova.network.neutron [req-6d301f40-293b-43df-8210-8025e439d5a6 req-8541a4e4-2fb9-44c4-94f7-9ad5fbe840e2 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Updating instance_info_cache with network_info: [{"id": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "address": "fa:16:3e:60:39:3e", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36f67df-c2", "ovs_interfaceid": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:03:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-6d301f40-293b-43df-8210-8025e439d5a6 req-8541a4e4-2fb9-44c4-94f7-9ad5fbe840e2 service nova] Releasing lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:03:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:03:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:37 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:38 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:03:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "64096bfc-b1c0-4bdb-8268-64568428f586" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:03:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "64096bfc-b1c0-4bdb-8268-64568428f586" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:03:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 21:03:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:03:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:03:39 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 21:03:39 user nova-compute[75571]: INFO nova.compute.claims [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Claim successful on node user
Nov 28 21:03:39 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:03:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:39 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:03:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:03:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 21:03:39 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 21:03:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 21:03:39 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 21:03:39 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 21:03:39 user nova-compute[75571]: DEBUG nova.policy [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 21:03:39 user nova-compute[75571]: INFO nova.virt.block_device [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Booting with volume snapshot af2408f6-5ac6-41ae-bb41-d186572a1c9c at /dev/vda
Nov 28 21:03:40 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:03:40 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:03:40 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:03:40 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Skipping network cache update for instance because it is Building. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 21:03:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:03:40 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:03:40 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:03:40 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:03:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:40 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Successfully created port: 666c4820-03e7-4bf8-9a14-a14f7e9e70e6 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Updating instance_info_cache with network_info: [{"id": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "address": "fa:16:3e:60:39:3e", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36f67df-c2", "ovs_interfaceid": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Successfully updated port: 666c4820-03e7-4bf8-9a14-a14f7e9e70e6 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "refresh_cache-64096bfc-b1c0-4bdb-8268-64568428f586" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquired lock "refresh_cache-64096bfc-b1c0-4bdb-8268-64568428f586" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-3d7d91d1-0dac-4c60-a4b9-14650b55a2ce req-86fa75e4-75f8-45f7-ae51-61178a0f4507 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Received event network-changed-666c4820-03e7-4bf8-9a14-a14f7e9e70e6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG nova.compute.manager [req-3d7d91d1-0dac-4c60-a4b9-14650b55a2ce req-86fa75e4-75f8-45f7-ae51-61178a0f4507 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Refreshing instance network info cache due to event network-changed-666c4820-03e7-4bf8-9a14-a14f7e9e70e6. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3d7d91d1-0dac-4c60-a4b9-14650b55a2ce req-86fa75e4-75f8-45f7-ae51-61178a0f4507 service nova] Acquiring lock "refresh_cache-64096bfc-b1c0-4bdb-8268-64568428f586" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Updating instance_info_cache with network_info: [{"id": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "address": "fa:16:3e:9a:ee:34", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666c4820-03", "ovs_interfaceid": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Releasing lock "refresh_cache-64096bfc-b1c0-4bdb-8268-64568428f586" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Instance network_info: |[{"id": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "address": "fa:16:3e:9a:ee:34", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666c4820-03", "ovs_interfaceid": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3d7d91d1-0dac-4c60-a4b9-14650b55a2ce req-86fa75e4-75f8-45f7-ae51-61178a0f4507 service nova] Acquired lock "refresh_cache-64096bfc-b1c0-4bdb-8268-64568428f586" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:03:41 user nova-compute[75571]: DEBUG nova.network.neutron [req-3d7d91d1-0dac-4c60-a4b9-14650b55a2ce req-86fa75e4-75f8-45f7-ae51-61178a0f4507 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Refreshing network info cache for port 666c4820-03e7-4bf8-9a14-a14f7e9e70e6 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 21:03:42 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:03:42 user nova-compute[75571]: DEBUG nova.network.neutron [req-3d7d91d1-0dac-4c60-a4b9-14650b55a2ce req-86fa75e4-75f8-45f7-ae51-61178a0f4507 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Updated VIF entry in instance network info cache for port 666c4820-03e7-4bf8-9a14-a14f7e9e70e6. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 21:03:42 user nova-compute[75571]: DEBUG nova.network.neutron [req-3d7d91d1-0dac-4c60-a4b9-14650b55a2ce req-86fa75e4-75f8-45f7-ae51-61178a0f4507 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Updating instance_info_cache with network_info: [{"id": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "address": "fa:16:3e:9a:ee:34", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666c4820-03", "ovs_interfaceid": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:03:42 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3d7d91d1-0dac-4c60-a4b9-14650b55a2ce req-86fa75e4-75f8-45f7-ae51-61178a0f4507 service nova] Releasing lock "refresh_cache-64096bfc-b1c0-4bdb-8268-64568428f586" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:03:43 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:03:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG os_brick.utils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[40661428-4527-479d-8e4c-893f135cbc42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[39211e2c-0b8b-4d9b-a90d-12656dd62750]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2b51e7-69e8-4793-84df-f8ae75b8d2cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1fa7c6-e71f-4353-8e12-a58d4e676f6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:03:45 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 21:03:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[875418a4-4dab-4d69-a757-4768647c04c5]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG os_brick.utils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:03:45 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Updating existing volume attachment record: cec969f8-709a-42f1-a0c1-2f4f0f2b4f2a {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 21:03:46 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:03:46 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:03:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9041MB free_disk=25.011825561523438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 64096bfc-b1c0-4bdb-8268-64568428f586 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:03:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:03:48 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:03:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:03:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:03:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:03:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:03:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 21:03:52 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Creating image(s)
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Ensure instance console log exists: /opt/stack/data/nova/instances/64096bfc-b1c0-4bdb-8268-64568428f586/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Start _get_guest_xml network_info=[{"id": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "address": "fa:16:3e:9a:ee:34", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666c4820-03", "ovs_interfaceid": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T21:03:34Z,direct_url=<?>,disk_format='qcow2',id=a501c866-c0be-4693-84f0-15759ab42ff6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1468595788',owner='f852e1ca6d934711942031022097eb36',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T21:03:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKzUsaqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64096bfc-b1c0-4bdb-8268-64568428f586', 'attached_at': '', 'detached_at': '', 'volume_id': 'b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1', 'serial': 'b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'cec969f8-709a-42f1-a0c1-2f4f0f2b4f2a', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 21:03:52 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:03:52 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T21:03:34Z,direct_url=<?>,disk_format='qcow2',id=a501c866-c0be-4693-84f0-15759ab42ff6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1468595788',owner='f852e1ca6d934711942031022097eb36',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T21:03:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKzUsaqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:03:52 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:03:52 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:03:52 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a050a023-4608-45e9-a32c-c2937e16b589]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 21:03:52 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27603a8-859c-4e8c-a447-5ec0588d4c49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1] added
Nov 28 21:03:52 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bfc26d-ad52-47ff-ae19-ac58a964f5b8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd59a54-88d6-4e32-b338-f5a5ebaba3e3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kKzUsaqt {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kKzUsaqt" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8096a1-e6bc-4499-b293-66b2888365c4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kKzUsaqt'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce13e32-ce3c-4de2-ad67-02d7966f10f5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2669ca-1ec6-47ea-895d-e096b03318c0]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 (non-flash)
Nov 28 21:03:52 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 (non-flash)
Nov 28 21:03:52 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9ad967-2285-4207-9463-399a36de5de7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1, portal: 172.16.0.220,3260]
Nov 28 21:03:52 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1, portal: 172.16.0.220,3260] successful.
Nov 28 21:03:52 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8d8e60-79ad-47d8-a426-87d4ce40aa11]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[93300fff-548b-4bb1-8c10-d678e7eb52c0]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 (non-flash)
Nov 28 21:03:52 user nova-compute[75571]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 (non-flash)
Nov 28 21:03:52 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 (non-flash)
Nov 28 21:03:52 user nova-compute[75571]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 (non-flash)
Nov 28 21:03:52 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[605e5a6c-0572-426b-b6b8-dffde1041ed1]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 21:03:52 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKzUsaqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23966626238303062', 'path': '/dev/sdc'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966626238303062', 'path': '/dev/sdc'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-108070366',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-108070366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-108070366',id=49,image_ref='a501c866-c0be-4693-84f0-15759ab42ff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf2ys1XQYYretN2P0dIu5wFF+MXALvH7zK0bbIOgyhUxST+CUXGnbDQroRw6gXDf2nrzmq0MgeyBR1God057nVDYNWRKaTGZwtUot9+e9ipYZq6EKK2CYFICRpb1AqBtA==',key_name='tempest-keypair-1255583566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-m62yuseb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-845056434',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T21:03:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=64096bfc-b1c0-4bdb-8268-64568428f586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "address": "fa:16:3e:9a:ee:34", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666c4820-03", "ovs_interfaceid": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "address": "fa:16:3e:9a:ee:34", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666c4820-03", "ovs_interfaceid": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ee:34,bridge_name='br-int',has_traffic_filtering=True,id=666c4820-03e7-4bf8-9a14-a14f7e9e70e6,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666c4820-03') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG nova.objects.instance [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lazy-loading 'pci_devices' on Instance uuid 64096bfc-b1c0-4bdb-8268-64568428f586 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] End _get_guest_xml xml=<domain type="kvm">
Nov 28 21:03:53 user nova-compute[75571]:   <uuid>64096bfc-b1c0-4bdb-8268-64568428f586</uuid>
Nov 28 21:03:53 user nova-compute[75571]:   <name>instance-00000031</name>
Nov 28 21:03:53 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 21:03:53 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 21:03:53 user nova-compute[75571]:   <metadata>
Nov 28 21:03:53 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 21:03:53 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 21:03:53 user nova-compute[75571]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-108070366</nova:name>
Nov 28 21:03:53 user nova-compute[75571]:       <nova:creationTime>2023-11-28 21:03:52</nova:creationTime>
Nov 28 21:03:53 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 21:03:53 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 21:03:53 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 21:03:53 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 21:03:53 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 21:03:53 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 21:03:53 user nova-compute[75571]:       </nova:flavor>
Nov 28 21:03:53 user nova-compute[75571]:       <nova:owner>
Nov 28 21:03:53 user nova-compute[75571]:         <nova:user uuid="fc8d37446f714002b8c5c4395ab82d58">tempest-TestVolumeBootPattern-845056434-project-member</nova:user>
Nov 28 21:03:53 user nova-compute[75571]:         <nova:project uuid="f852e1ca6d934711942031022097eb36">tempest-TestVolumeBootPattern-845056434</nova:project>
Nov 28 21:03:53 user nova-compute[75571]:       </nova:owner>
Nov 28 21:03:53 user nova-compute[75571]:       <nova:root type="image" uuid="a501c866-c0be-4693-84f0-15759ab42ff6"/>
Nov 28 21:03:53 user nova-compute[75571]:       <nova:ports>
Nov 28 21:03:53 user nova-compute[75571]:         <nova:port uuid="666c4820-03e7-4bf8-9a14-a14f7e9e70e6">
Nov 28 21:03:53 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 21:03:53 user nova-compute[75571]:         </nova:port>
Nov 28 21:03:53 user nova-compute[75571]:       </nova:ports>
Nov 28 21:03:53 user nova-compute[75571]:     </nova:instance>
Nov 28 21:03:53 user nova-compute[75571]:   </metadata>
Nov 28 21:03:53 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 21:03:53 user nova-compute[75571]:     <system>
Nov 28 21:03:53 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 21:03:53 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 21:03:53 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 21:03:53 user nova-compute[75571]:       <entry name="serial">64096bfc-b1c0-4bdb-8268-64568428f586</entry>
Nov 28 21:03:53 user nova-compute[75571]:       <entry name="uuid">64096bfc-b1c0-4bdb-8268-64568428f586</entry>
Nov 28 21:03:53 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 21:03:53 user nova-compute[75571]:     </system>
Nov 28 21:03:53 user nova-compute[75571]:   </sysinfo>
Nov 28 21:03:53 user nova-compute[75571]:   <os>
Nov 28 21:03:53 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 21:03:53 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 21:03:53 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 21:03:53 user nova-compute[75571]:   </os>
Nov 28 21:03:53 user nova-compute[75571]:   <features>
Nov 28 21:03:53 user nova-compute[75571]:     <acpi/>
Nov 28 21:03:53 user nova-compute[75571]:     <apic/>
Nov 28 21:03:53 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 21:03:53 user nova-compute[75571]:   </features>
Nov 28 21:03:53 user nova-compute[75571]:   <clock offset="utc">
Nov 28 21:03:53 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 21:03:53 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 21:03:53 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 21:03:53 user nova-compute[75571]:   </clock>
Nov 28 21:03:53 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 21:03:53 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 21:03:53 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 21:03:53 user nova-compute[75571]:   </cpu>
Nov 28 21:03:53 user nova-compute[75571]:   <devices>
Nov 28 21:03:53 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 21:03:53 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:03:53 user nova-compute[75571]:       <source dev="/dev/sdc"/>
Nov 28 21:03:53 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 21:03:53 user nova-compute[75571]:       <serial>b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1</serial>
Nov 28 21:03:53 user nova-compute[75571]:     </disk>
Nov 28 21:03:53 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 21:03:53 user nova-compute[75571]:       <mac address="fa:16:3e:9a:ee:34"/>
Nov 28 21:03:53 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 21:03:53 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 21:03:53 user nova-compute[75571]:       <target dev="tap666c4820-03"/>
Nov 28 21:03:53 user nova-compute[75571]:     </interface>
Nov 28 21:03:53 user nova-compute[75571]:     <serial type="pty">
Nov 28 21:03:53 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/64096bfc-b1c0-4bdb-8268-64568428f586/console.log" append="off"/>
Nov 28 21:03:53 user nova-compute[75571]:     </serial>
Nov 28 21:03:53 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 21:03:53 user nova-compute[75571]:     <video>
Nov 28 21:03:53 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 21:03:53 user nova-compute[75571]:     </video>
Nov 28 21:03:53 user nova-compute[75571]:     <rng model="virtio">
Nov 28 21:03:53 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 21:03:53 user nova-compute[75571]:     </rng>
Nov 28 21:03:53 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 21:03:53 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 21:03:53 user nova-compute[75571]:       <stats period="10"/>
Nov 28 21:03:53 user nova-compute[75571]:     </memballoon>
Nov 28 21:03:53 user nova-compute[75571]:   </devices>
Nov 28 21:03:53 user nova-compute[75571]: </domain>
Nov 28 21:03:53 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-108070366',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-108070366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-108070366',id=49,image_ref='a501c866-c0be-4693-84f0-15759ab42ff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf2ys1XQYYretN2P0dIu5wFF+MXALvH7zK0bbIOgyhUxST+CUXGnbDQroRw6gXDf2nrzmq0MgeyBR1God057nVDYNWRKaTGZwtUot9+e9ipYZq6EKK2CYFICRpb1AqBtA==',key_name='tempest-keypair-1255583566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-m62yuseb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-845056434',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T21:03:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=64096bfc-b1c0-4bdb-8268-64568428f586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "address": "fa:16:3e:9a:ee:34", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666c4820-03", "ovs_interfaceid": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "address": "fa:16:3e:9a:ee:34", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666c4820-03", "ovs_interfaceid": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ee:34,bridge_name='br-int',has_traffic_filtering=True,id=666c4820-03e7-4bf8-9a14-a14f7e9e70e6,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666c4820-03') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG os_vif [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ee:34,bridge_name='br-int',has_traffic_filtering=True,id=666c4820-03e7-4bf8-9a14-a14f7e9e70e6,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666c4820-03') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca507eb6-2a1b-592f-b628-bf16758b6fe8', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap666c4820-03, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap666c4820-03, col_values=(('qos', UUID('3dc26418-ee43-415a-894c-16954d3e71c0')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap666c4820-03, col_values=(('external_ids', {'iface-id': '666c4820-03e7-4bf8-9a14-a14f7e9e70e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:ee:34', 'vm-uuid': '64096bfc-b1c0-4bdb-8268-64568428f586'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:03:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:53 user nova-compute[75571]: INFO os_vif [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ee:34,bridge_name='br-int',has_traffic_filtering=True,id=666c4820-03e7-4bf8-9a14-a14f7e9e70e6,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666c4820-03')
Nov 28 21:03:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 21:03:54 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] No VIF found with MAC fa:16:3e:9a:ee:34, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 21:03:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-eb59cde7-c137-44a3-8dbb-8bebe2ddeb21 req-81e1024e-baa0-4a63-a5fd-9bca2940e8d1 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Received event network-vif-plugged-666c4820-03e7-4bf8-9a14-a14f7e9e70e6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:03:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-eb59cde7-c137-44a3-8dbb-8bebe2ddeb21 req-81e1024e-baa0-4a63-a5fd-9bca2940e8d1 service nova] Acquiring lock "64096bfc-b1c0-4bdb-8268-64568428f586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:03:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-eb59cde7-c137-44a3-8dbb-8bebe2ddeb21 req-81e1024e-baa0-4a63-a5fd-9bca2940e8d1 service nova] Lock "64096bfc-b1c0-4bdb-8268-64568428f586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:03:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-eb59cde7-c137-44a3-8dbb-8bebe2ddeb21 req-81e1024e-baa0-4a63-a5fd-9bca2940e8d1 service nova] Lock "64096bfc-b1c0-4bdb-8268-64568428f586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:03:55 user nova-compute[75571]: DEBUG nova.compute.manager [req-eb59cde7-c137-44a3-8dbb-8bebe2ddeb21 req-81e1024e-baa0-4a63-a5fd-9bca2940e8d1 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] No waiting events found dispatching network-vif-plugged-666c4820-03e7-4bf8-9a14-a14f7e9e70e6 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:03:55 user nova-compute[75571]: WARNING nova.compute.manager [req-eb59cde7-c137-44a3-8dbb-8bebe2ddeb21 req-81e1024e-baa0-4a63-a5fd-9bca2940e8d1 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Received unexpected event network-vif-plugged-666c4820-03e7-4bf8-9a14-a14f7e9e70e6 for instance with vm_state building and task_state spawning.
Nov 28 21:03:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:03:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 21:03:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 21:03:57 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Instance spawned successfully.
Nov 28 21:03:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 21:03:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:03:57 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:03:57 user nova-compute[75571]: INFO nova.compute.manager [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Took 4.86 seconds to spawn the instance on the hypervisor.
Nov 28 21:03:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 21:03:57 user nova-compute[75571]: DEBUG nova.compute.manager [req-925ba2e1-a314-4a94-ba2f-1a1150af069f req-a450348a-0cea-46aa-b975-dd95733fc5c4 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Received event network-vif-plugged-666c4820-03e7-4bf8-9a14-a14f7e9e70e6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:03:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-925ba2e1-a314-4a94-ba2f-1a1150af069f req-a450348a-0cea-46aa-b975-dd95733fc5c4 service nova] Acquiring lock "64096bfc-b1c0-4bdb-8268-64568428f586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:03:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-925ba2e1-a314-4a94-ba2f-1a1150af069f req-a450348a-0cea-46aa-b975-dd95733fc5c4 service nova] Lock "64096bfc-b1c0-4bdb-8268-64568428f586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:03:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-925ba2e1-a314-4a94-ba2f-1a1150af069f req-a450348a-0cea-46aa-b975-dd95733fc5c4 service nova] Lock "64096bfc-b1c0-4bdb-8268-64568428f586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:03:57 user nova-compute[75571]: DEBUG nova.compute.manager [req-925ba2e1-a314-4a94-ba2f-1a1150af069f req-a450348a-0cea-46aa-b975-dd95733fc5c4 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] No waiting events found dispatching network-vif-plugged-666c4820-03e7-4bf8-9a14-a14f7e9e70e6 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:03:57 user nova-compute[75571]: WARNING nova.compute.manager [req-925ba2e1-a314-4a94-ba2f-1a1150af069f req-a450348a-0cea-46aa-b975-dd95733fc5c4 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Received unexpected event network-vif-plugged-666c4820-03e7-4bf8-9a14-a14f7e9e70e6 for instance with vm_state active and task_state None.
Nov 28 21:03:57 user nova-compute[75571]: INFO nova.compute.manager [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Took 18.12 seconds to build instance.
Nov 28 21:03:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "64096bfc-b1c0-4bdb-8268-64568428f586" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.213s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:03:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:04:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:29 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:04:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:40 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:04:41 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:04:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:04:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:04:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:04:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:04:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:04:41 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:04:41 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Updating instance_info_cache with network_info: [{"id": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "address": "fa:16:3e:60:39:3e", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36f67df-c2", "ovs_interfaceid": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:04:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-95a5bda9-0bab-43f3-a77b-9dbfde4c0008" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:04:41 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:04:42 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:04:42 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:04:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:04:43 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:04:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 21:04:46 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:04:46 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:04:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=25.01049041748047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 64096bfc-b1c0-4bdb-8268-64568428f586 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:04:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:04:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:04:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:04:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:04:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:04:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:04:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:04:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:29 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:05:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:30 user nova-compute[75571]: DEBUG nova.compute.manager [req-db4b89f2-ed78-46d5-a569-9e755653d616 req-e85b57c2-ee77-44c6-af60-492bc677369b service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Received event network-changed-666c4820-03e7-4bf8-9a14-a14f7e9e70e6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:05:30 user nova-compute[75571]: DEBUG nova.compute.manager [req-db4b89f2-ed78-46d5-a569-9e755653d616 req-e85b57c2-ee77-44c6-af60-492bc677369b service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Refreshing instance network info cache due to event network-changed-666c4820-03e7-4bf8-9a14-a14f7e9e70e6. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 21:05:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-db4b89f2-ed78-46d5-a569-9e755653d616 req-e85b57c2-ee77-44c6-af60-492bc677369b service nova] Acquiring lock "refresh_cache-64096bfc-b1c0-4bdb-8268-64568428f586" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:05:30 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-db4b89f2-ed78-46d5-a569-9e755653d616 req-e85b57c2-ee77-44c6-af60-492bc677369b service nova] Acquired lock "refresh_cache-64096bfc-b1c0-4bdb-8268-64568428f586" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:05:30 user nova-compute[75571]: DEBUG nova.network.neutron [req-db4b89f2-ed78-46d5-a569-9e755653d616 req-e85b57c2-ee77-44c6-af60-492bc677369b service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Refreshing network info cache for port 666c4820-03e7-4bf8-9a14-a14f7e9e70e6 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 21:05:30 user nova-compute[75571]: DEBUG nova.network.neutron [req-db4b89f2-ed78-46d5-a569-9e755653d616 req-e85b57c2-ee77-44c6-af60-492bc677369b service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Updated VIF entry in instance network info cache for port 666c4820-03e7-4bf8-9a14-a14f7e9e70e6. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 21:05:30 user nova-compute[75571]: DEBUG nova.network.neutron [req-db4b89f2-ed78-46d5-a569-9e755653d616 req-e85b57c2-ee77-44c6-af60-492bc677369b service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Updating instance_info_cache with network_info: [{"id": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "address": "fa:16:3e:9a:ee:34", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666c4820-03", "ovs_interfaceid": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-db4b89f2-ed78-46d5-a569-9e755653d616 req-e85b57c2-ee77-44c6-af60-492bc677369b service nova] Releasing lock "refresh_cache-64096bfc-b1c0-4bdb-8268-64568428f586" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "64096bfc-b1c0-4bdb-8268-64568428f586" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "64096bfc-b1c0-4bdb-8268-64568428f586" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "64096bfc-b1c0-4bdb-8268-64568428f586-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "64096bfc-b1c0-4bdb-8268-64568428f586-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "64096bfc-b1c0-4bdb-8268-64568428f586-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:05:31 user nova-compute[75571]: INFO nova.compute.manager [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Terminating instance
Nov 28 21:05:31 user nova-compute[75571]: DEBUG nova.compute.manager [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG nova.compute.manager [req-e23c8333-2abb-4680-b118-e8b4f3cbbae1 req-99eb7c9a-c1de-45a4-80f5-a26b5b81a746 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Received event network-vif-unplugged-666c4820-03e7-4bf8-9a14-a14f7e9e70e6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e23c8333-2abb-4680-b118-e8b4f3cbbae1 req-99eb7c9a-c1de-45a4-80f5-a26b5b81a746 service nova] Acquiring lock "64096bfc-b1c0-4bdb-8268-64568428f586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e23c8333-2abb-4680-b118-e8b4f3cbbae1 req-99eb7c9a-c1de-45a4-80f5-a26b5b81a746 service nova] Lock "64096bfc-b1c0-4bdb-8268-64568428f586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e23c8333-2abb-4680-b118-e8b4f3cbbae1 req-99eb7c9a-c1de-45a4-80f5-a26b5b81a746 service nova] Lock "64096bfc-b1c0-4bdb-8268-64568428f586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG nova.compute.manager [req-e23c8333-2abb-4680-b118-e8b4f3cbbae1 req-99eb7c9a-c1de-45a4-80f5-a26b5b81a746 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] No waiting events found dispatching network-vif-unplugged-666c4820-03e7-4bf8-9a14-a14f7e9e70e6 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG nova.compute.manager [req-e23c8333-2abb-4680-b118-e8b4f3cbbae1 req-99eb7c9a-c1de-45a4-80f5-a26b5b81a746 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Received event network-vif-unplugged-666c4820-03e7-4bf8-9a14-a14f7e9e70e6 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:31 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Instance destroyed successfully.
Nov 28 21:05:31 user nova-compute[75571]: DEBUG nova.objects.instance [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lazy-loading 'resources' on Instance uuid 64096bfc-b1c0-4bdb-8268-64568428f586 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-108070366',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-108070366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-108070366',id=49,image_ref='a501c866-c0be-4693-84f0-15759ab42ff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf2ys1XQYYretN2P0dIu5wFF+MXALvH7zK0bbIOgyhUxST+CUXGnbDQroRw6gXDf2nrzmq0MgeyBR1God057nVDYNWRKaTGZwtUot9+e9ipYZq6EKK2CYFICRpb1AqBtA==',key_name='tempest-keypair-1255583566',keypairs=<?>,launch_index=0,launched_at=2023-11-28T21:03:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-m62yuseb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-845056434',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T21:03:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=64096bfc-b1c0-4bdb-8268-64568428f586,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "address": "fa:16:3e:9a:ee:34", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666c4820-03", "ovs_interfaceid": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "address": "fa:16:3e:9a:ee:34", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666c4820-03", "ovs_interfaceid": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ee:34,bridge_name='br-int',has_traffic_filtering=True,id=666c4820-03e7-4bf8-9a14-a14f7e9e70e6,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666c4820-03') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG os_vif [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ee:34,bridge_name='br-int',has_traffic_filtering=True,id=666c4820-03e7-4bf8-9a14-a14f7e9e70e6,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666c4820-03') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap666c4820-03, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3dc26418-ee43-415a-894c-16954d3e71c0) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:05:31 user nova-compute[75571]: INFO os_vif [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ee:34,bridge_name='br-int',has_traffic_filtering=True,id=666c4820-03e7-4bf8-9a14-a14f7e9e70e6,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666c4820-03')
Nov 28 21:05:31 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKzUsaqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:05:31 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:05:31 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55a84e6-e67c-4365-8653-22ace0e65caa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 21:05:31 user nova-compute[75571]: No targets found.
Nov 28 21:05:31 user nova-compute[75571]: iSNS:
Nov 28 21:05:31 user nova-compute[75571]: No targets found.
Nov 28 21:05:31 user nova-compute[75571]: STATIC:
Nov 28 21:05:31 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808
Nov 28 21:05:31 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 21:05:31 user nova-compute[75571]:                 Iface Name: default
Nov 28 21:05:31 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1
Nov 28 21:05:31 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 21:05:31 user nova-compute[75571]:                 Iface Name: default
Nov 28 21:05:31 user nova-compute[75571]: FIRMWARE:
Nov 28 21:05:31 user nova-compute[75571]: No targets found.
Nov 28 21:05:31 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 21:05:31 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 21:05:31 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[436f85c4-5834-4242-8b91-77b3623951f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec2dbe9-c9c3-4b9d-a773-73aa4336af74]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 (non-flash)
Nov 28 21:05:31 user nova-compute[75571]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 (non-flash)
Nov 28 21:05:31 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:05:31 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 (non-flash)
Nov 28 21:05:31 user nova-compute[75571]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 (non-flash)
Nov 28 21:05:31 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77682d97e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1'): ({'sdc'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Removing single pathed devices sdc {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7edb7c-13e7-45e1-b9e4-1b88c0560906]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[682d5edc-2f95-4801-bb3e-fb18f165c29c]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flushing IO for device /dev/sdc {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d94f561-9e96-4085-be50-50d3bc971573]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ad35f2-de26-4ba4-8b0f-dd9866bb633c]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23966626238303062', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bbdb1a60', '/dev/disk/by-id/scsi-1SCST_BIObbdb1a60-9fbb800b186a59aa') {{(pid=86013) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[197ffecd-bfeb-4980-8664-5b764ec62bca]: (4, None) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3c047a-315b-4dc2-86f7-5db943d5780a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdf5fc2-4bb7-4b71-b701-ac353479971e]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1, portal: 172.16.0.220,3260]
Nov 28 21:05:32 user nova-compute[75571]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1, portal: 172.16.0.220,3260] successful.
Nov 28 21:05:32 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6dade0-e7c6-4e08-8955-5fc6abf0cb29]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== disconnect_volume: return (328ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 21:05:32 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Deleting instance files /opt/stack/data/nova/instances/64096bfc-b1c0-4bdb-8268-64568428f586_del
Nov 28 21:05:32 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Deletion of /opt/stack/data/nova/instances/64096bfc-b1c0-4bdb-8268-64568428f586_del complete
Nov 28 21:05:32 user nova-compute[75571]: INFO nova.compute.manager [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 28 21:05:32 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 21:05:32 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 21:05:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-dbfaa076-442b-4bca-ae6e-a1be807da8b0 req-fbd891a9-ef57-4110-8743-c9edc6fff9a9 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Received event network-vif-plugged-666c4820-03e7-4bf8-9a14-a14f7e9e70e6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:05:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-dbfaa076-442b-4bca-ae6e-a1be807da8b0 req-fbd891a9-ef57-4110-8743-c9edc6fff9a9 service nova] Acquiring lock "64096bfc-b1c0-4bdb-8268-64568428f586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:05:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-dbfaa076-442b-4bca-ae6e-a1be807da8b0 req-fbd891a9-ef57-4110-8743-c9edc6fff9a9 service nova] Lock "64096bfc-b1c0-4bdb-8268-64568428f586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:05:33 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-dbfaa076-442b-4bca-ae6e-a1be807da8b0 req-fbd891a9-ef57-4110-8743-c9edc6fff9a9 service nova] Lock "64096bfc-b1c0-4bdb-8268-64568428f586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:05:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-dbfaa076-442b-4bca-ae6e-a1be807da8b0 req-fbd891a9-ef57-4110-8743-c9edc6fff9a9 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] No waiting events found dispatching network-vif-plugged-666c4820-03e7-4bf8-9a14-a14f7e9e70e6 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:05:33 user nova-compute[75571]: WARNING nova.compute.manager [req-dbfaa076-442b-4bca-ae6e-a1be807da8b0 req-fbd891a9-ef57-4110-8743-c9edc6fff9a9 service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Received unexpected event network-vif-plugged-666c4820-03e7-4bf8-9a14-a14f7e9e70e6 for instance with vm_state active and task_state deleting.
Nov 28 21:05:33 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:05:33 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Took 1.24 seconds to deallocate network for instance.
Nov 28 21:05:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-84bc88c0-2a45-41f8-ab11-08770e8c0861 req-3e33b786-0263-433f-81a4-0c0faceb996c service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Received event network-vif-deleted-666c4820-03e7-4bf8-9a14-a14f7e9e70e6 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:05:33 user nova-compute[75571]: INFO nova.compute.manager [req-84bc88c0-2a45-41f8-ab11-08770e8c0861 req-3e33b786-0263-433f-81a4-0c0faceb996c service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Neutron deleted interface 666c4820-03e7-4bf8-9a14-a14f7e9e70e6; detaching it from the instance and deleting it from the info cache
Nov 28 21:05:33 user nova-compute[75571]: DEBUG nova.network.neutron [req-84bc88c0-2a45-41f8-ab11-08770e8c0861 req-3e33b786-0263-433f-81a4-0c0faceb996c service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:05:33 user nova-compute[75571]: DEBUG nova.compute.manager [req-84bc88c0-2a45-41f8-ab11-08770e8c0861 req-3e33b786-0263-433f-81a4-0c0faceb996c service nova] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Detach interface failed, port_id=666c4820-03e7-4bf8-9a14-a14f7e9e70e6, reason: Instance 64096bfc-b1c0-4bdb-8268-64568428f586 could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 21:05:34 user nova-compute[75571]: INFO nova.compute.manager [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Took 0.80 seconds to detach 1 volumes for instance.
Nov 28 21:05:34 user nova-compute[75571]: DEBUG nova.compute.manager [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Deleting volume: b61d3bb4-6996-41f5-9d9d-ddf07f1e72e1 {{(pid=75571) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 21:05:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:05:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:05:34 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:05:34 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:05:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:05:34 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Deleted allocations for instance 64096bfc-b1c0-4bdb-8268-64568428f586
Nov 28 21:05:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "64096bfc-b1c0-4bdb-8268-64568428f586" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.822s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:05:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:36 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:05:40 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:05:41 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:05:42 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:05:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:05:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 21:05:42 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:05:42 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:05:42 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:05:43 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:05:45 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:05:46 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:05:48 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:05:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:05:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:05:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:05:48 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:05:48 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 21:05:48 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:05:48 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:05:48 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9041MB free_disk=25.009597778320312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:05:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:05:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:05:48 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:05:48 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:05:48 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:05:48 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:05:48 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:05:48 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:05:48 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:05:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:05:51 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:05:56 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:06:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:06:06 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:06:10 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:06:11 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:06:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:06:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:06:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:06:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:06:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:06:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:06:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:06:24 user nova-compute[75571]: INFO nova.compute.manager [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Terminating instance
Nov 28 21:06:24 user nova-compute[75571]: DEBUG nova.compute.manager [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 21:06:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:06:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:06:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:06:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG nova.compute.manager [req-3685d617-3ff6-4a8f-8296-681381b7b612 req-69b18184-2b77-40ac-acd9-09f3fc1fcc47 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Received event network-vif-unplugged-e36f67df-c2a4-4e01-802a-15cbb22e1cf8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3685d617-3ff6-4a8f-8296-681381b7b612 req-69b18184-2b77-40ac-acd9-09f3fc1fcc47 service nova] Acquiring lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3685d617-3ff6-4a8f-8296-681381b7b612 req-69b18184-2b77-40ac-acd9-09f3fc1fcc47 service nova] Lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-3685d617-3ff6-4a8f-8296-681381b7b612 req-69b18184-2b77-40ac-acd9-09f3fc1fcc47 service nova] Lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG nova.compute.manager [req-3685d617-3ff6-4a8f-8296-681381b7b612 req-69b18184-2b77-40ac-acd9-09f3fc1fcc47 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] No waiting events found dispatching network-vif-unplugged-e36f67df-c2a4-4e01-802a-15cbb22e1cf8 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG nova.compute.manager [req-3685d617-3ff6-4a8f-8296-681381b7b612 req-69b18184-2b77-40ac-acd9-09f3fc1fcc47 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Received event network-vif-unplugged-e36f67df-c2a4-4e01-802a-15cbb22e1cf8 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 21:06:25 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Instance destroyed successfully.
Nov 28 21:06:25 user nova-compute[75571]: DEBUG nova.objects.instance [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lazy-loading 'resources' on Instance uuid 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:01:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-529793188',display_name='tempest-TestVolumeBootPattern-volume-backed-server-529793188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-529793188',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/MkJk8yOJyVUDVMSAWkILaxwFgsrVHs1ekfKqJM0WoG/ObKz6549Z0YYDm+bA8H8MBa8yAktgYF0rT6LZ6SK2UGBhV/y9bcPH66+bXDNUd0nVL6S+nhT0itdm9L2qOsQ==',key_name='tempest-keypair-873960613',keypairs=<?>,launch_index=0,launched_at=2023-11-28T21:01:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-5r3svfde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T21:01:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=95a5bda9-0bab-43f3-a77b-9dbfde4c0008,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "address": "fa:16:3e:60:39:3e", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36f67df-c2", "ovs_interfaceid": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "address": "fa:16:3e:60:39:3e", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36f67df-c2", "ovs_interfaceid": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:39:3e,bridge_name='br-int',has_traffic_filtering=True,id=e36f67df-c2a4-4e01-802a-15cbb22e1cf8,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36f67df-c2') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_vif [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:39:3e,bridge_name='br-int',has_traffic_filtering=True,id=e36f67df-c2a4-4e01-802a-15cbb22e1cf8,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36f67df-c2') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape36f67df-c2, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ed4328e-4162-4c05-8dea-3e4d33f37a42) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:06:25 user nova-compute[75571]: INFO os_vif [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:39:3e,bridge_name='br-int',has_traffic_filtering=True,id=e36f67df-c2a4-4e01-802a-15cbb22e1cf8,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36f67df-c2')
Nov 28 21:06:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OniAwfCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:06:25 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff541b8-5f4b-4767-b368-ae094599a318]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 21:06:25 user nova-compute[75571]: No targets found.
Nov 28 21:06:25 user nova-compute[75571]: iSNS:
Nov 28 21:06:25 user nova-compute[75571]: No targets found.
Nov 28 21:06:25 user nova-compute[75571]: STATIC:
Nov 28 21:06:25 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808
Nov 28 21:06:25 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 21:06:25 user nova-compute[75571]:                 Iface Name: default
Nov 28 21:06:25 user nova-compute[75571]: FIRMWARE:
Nov 28 21:06:25 user nova-compute[75571]: No targets found.
Nov 28 21:06:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 21:06:25 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 21:06:25 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[17249985-1f1c-42b9-af9c-603659dcac41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8f3c0c-4785-4b54-9f28-0684427f1f07]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 (non-flash)
Nov 28 21:06:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 (non-flash)
Nov 28 21:06:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7778292290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57bf285-5ce6-4578-a4fe-2a0570ad31ca]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e3eefe-1f54-449f-89d0-cb45c437562f]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9a9bf6-927a-4d3d-83ed-dc28fb479659]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6273b275-1da7-4d83-a76e-97dc44870788]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23966656165353133', '/dev/disk/by-id/scsi-1SCST_BIO2a1021ae-9feae51349659078', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2a1021ae') {{(pid=86013) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb15c3b-a6f1-429f-b198-56c39bbe1d10]: (4, None) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4b61e4-087a-4d69-9db3-20d4b2acd05a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[475f10f5-56c3-4726-9dab-495a0bd6c5ea]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808, portal: 172.16.0.220,3260]
Nov 28 21:06:25 user nova-compute[75571]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808, portal: 172.16.0.220,3260] successful.
Nov 28 21:06:25 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bb07d6-673c-4282-b7e5-67a6ddc8d808 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02f0397-6640-469e-8a8e-6310bad005ef]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== disconnect_volume: return (281ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 21:06:25 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Deleting instance files /opt/stack/data/nova/instances/95a5bda9-0bab-43f3-a77b-9dbfde4c0008_del
Nov 28 21:06:25 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Deletion of /opt/stack/data/nova/instances/95a5bda9-0bab-43f3-a77b-9dbfde4c0008_del complete
Nov 28 21:06:25 user nova-compute[75571]: INFO nova.compute.manager [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 28 21:06:25 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 21:06:25 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 21:06:26 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:06:26 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Took 0.76 seconds to deallocate network for instance.
Nov 28 21:06:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-1d12ed48-d4df-4380-b740-ee03775a1b1e req-199df33d-a44e-493b-bdf8-7917f3d3a315 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Received event network-vif-plugged-e36f67df-c2a4-4e01-802a-15cbb22e1cf8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:06:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1d12ed48-d4df-4380-b740-ee03775a1b1e req-199df33d-a44e-493b-bdf8-7917f3d3a315 service nova] Acquiring lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:06:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1d12ed48-d4df-4380-b740-ee03775a1b1e req-199df33d-a44e-493b-bdf8-7917f3d3a315 service nova] Lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:06:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-1d12ed48-d4df-4380-b740-ee03775a1b1e req-199df33d-a44e-493b-bdf8-7917f3d3a315 service nova] Lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:06:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-1d12ed48-d4df-4380-b740-ee03775a1b1e req-199df33d-a44e-493b-bdf8-7917f3d3a315 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] No waiting events found dispatching network-vif-plugged-e36f67df-c2a4-4e01-802a-15cbb22e1cf8 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:06:27 user nova-compute[75571]: WARNING nova.compute.manager [req-1d12ed48-d4df-4380-b740-ee03775a1b1e req-199df33d-a44e-493b-bdf8-7917f3d3a315 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Received unexpected event network-vif-plugged-e36f67df-c2a4-4e01-802a-15cbb22e1cf8 for instance with vm_state active and task_state deleting.
Nov 28 21:06:27 user nova-compute[75571]: DEBUG nova.compute.manager [req-1d12ed48-d4df-4380-b740-ee03775a1b1e req-199df33d-a44e-493b-bdf8-7917f3d3a315 service nova] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Received event network-vif-deleted-e36f67df-c2a4-4e01-802a-15cbb22e1cf8 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:06:27 user nova-compute[75571]: INFO nova.compute.manager [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Took 0.76 seconds to detach 1 volumes for instance.
Nov 28 21:06:27 user nova-compute[75571]: DEBUG nova.compute.manager [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Deleting volume: 77bb07d6-673c-4282-b7e5-67a6ddc8d808 {{(pid=75571) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 21:06:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:06:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:06:27 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:06:27 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:06:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:06:27 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Deleted allocations for instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008
Nov 28 21:06:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "95a5bda9-0bab-43f3-a77b-9dbfde4c0008" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.153s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:06:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:06:31 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:06:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:06:40 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:06:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:06:43 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:06:43 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:06:43 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:06:43 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 21:06:43 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:06:43 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:06:43 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:06:43 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:06:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:06:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:06:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:06:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:06:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:06:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:06:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:06:49 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:06:49 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:06:49 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:06:49 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9173MB free_disk=25.00879669189453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:06:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:06:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:06:49 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:06:49 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:06:49 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:06:49 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:06:49 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:06:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:06:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:06:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:06:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:06:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:06:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:06:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:06:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:06:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:07:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:07:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:07:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:07:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "86ee3671-369b-4689-aad8-6d6dae45e786" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:07:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "86ee3671-369b-4689-aad8-6d6dae45e786" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:07:24 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 21:07:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:07:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:07:24 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 21:07:24 user nova-compute[75571]: INFO nova.compute.claims [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Claim successful on node user
Nov 28 21:07:24 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:07:24 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:07:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:07:24 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 21:07:24 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 21:07:24 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 21:07:24 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 21:07:24 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 21:07:24 user nova-compute[75571]: INFO nova.virt.block_device [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Booting with volume dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 at /dev/vda
Nov 28 21:07:25 user nova-compute[75571]: DEBUG nova.policy [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG os_brick.utils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d62b234-5db5-4fd8-bf60-180e5fbeb74e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[72236b80-9005-4d32-9890-2e8442bc058f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2a17e0-46db-4d65-a9d1-d576a7ae8efe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f78f44a-04a0-4946-be20-e25c33db1abf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:07:25 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 21:07:25 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f929b7e8-56dd-4354-b849-459f5996ba0b]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG os_brick.utils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Updating existing volume attachment record: c0cfa872-70a4-421d-b086-a8f9ba31d925 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Successfully created port: 38a62a74-cd61-47f8-9fae-c2e1a372cebe {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 21:07:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Successfully updated port: 38a62a74-cd61-47f8-9fae-c2e1a372cebe {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "refresh_cache-86ee3671-369b-4689-aad8-6d6dae45e786" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquired lock "refresh_cache-86ee3671-369b-4689-aad8-6d6dae45e786" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-e5bcc947-98b5-415c-9c77-46b66629f61f req-ec5c5c4f-7d84-42e1-bd13-0b12e3258e61 service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Received event network-changed-38a62a74-cd61-47f8-9fae-c2e1a372cebe {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG nova.compute.manager [req-e5bcc947-98b5-415c-9c77-46b66629f61f req-ec5c5c4f-7d84-42e1-bd13-0b12e3258e61 service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Refreshing instance network info cache due to event network-changed-38a62a74-cd61-47f8-9fae-c2e1a372cebe. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e5bcc947-98b5-415c-9c77-46b66629f61f req-ec5c5c4f-7d84-42e1-bd13-0b12e3258e61 service nova] Acquiring lock "refresh_cache-86ee3671-369b-4689-aad8-6d6dae45e786" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Updating instance_info_cache with network_info: [{"id": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "address": "fa:16:3e:4c:9f:b0", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62a74-cd", "ovs_interfaceid": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Releasing lock "refresh_cache-86ee3671-369b-4689-aad8-6d6dae45e786" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Instance network_info: |[{"id": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "address": "fa:16:3e:4c:9f:b0", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62a74-cd", "ovs_interfaceid": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e5bcc947-98b5-415c-9c77-46b66629f61f req-ec5c5c4f-7d84-42e1-bd13-0b12e3258e61 service nova] Acquired lock "refresh_cache-86ee3671-369b-4689-aad8-6d6dae45e786" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG nova.network.neutron [req-e5bcc947-98b5-415c-9c77-46b66629f61f req-ec5c5c4f-7d84-42e1-bd13-0b12e3258e61 service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Refreshing network info cache for port 38a62a74-cd61-47f8-9fae-c2e1a372cebe {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG nova.network.neutron [req-e5bcc947-98b5-415c-9c77-46b66629f61f req-ec5c5c4f-7d84-42e1-bd13-0b12e3258e61 service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Updated VIF entry in instance network info cache for port 38a62a74-cd61-47f8-9fae-c2e1a372cebe. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG nova.network.neutron [req-e5bcc947-98b5-415c-9c77-46b66629f61f req-ec5c5c4f-7d84-42e1-bd13-0b12e3258e61 service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Updating instance_info_cache with network_info: [{"id": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "address": "fa:16:3e:4c:9f:b0", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62a74-cd", "ovs_interfaceid": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:07:26 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e5bcc947-98b5-415c-9c77-46b66629f61f req-ec5c5c4f-7d84-42e1-bd13-0b12e3258e61 service nova] Releasing lock "refresh_cache-86ee3671-369b-4689-aad8-6d6dae45e786" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:07:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:31 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 21:07:32 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Creating image(s)
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Ensure instance console log exists: /opt/stack/data/nova/instances/86ee3671-369b-4689-aad8-6d6dae45e786/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Start _get_guest_xml network_info=[{"id": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "address": "fa:16:3e:4c:9f:b0", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62a74-cd", "ovs_interfaceid": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCGhbmQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '86ee3671-369b-4689-aad8-6d6dae45e786', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5', 'serial': 'dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'c0cfa872-70a4-421d-b086-a8f9ba31d925', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 21:07:32 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:07:32 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCGhbmQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:07:32 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:07:32 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:07:32 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e314b5-cc3e-494c-93c6-132a93a87ffb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 21:07:32 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d43230b-d50e-4acf-a8f2-2c96ffa50ff2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5] added
Nov 28 21:07:32 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb0ce51-cc61-4411-8645-6910347f6ba8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.049s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a8da89-af46-4797-bdde-75631a1131c1]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oCGhbmQt {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oCGhbmQt" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[05107ec1-31c6-4403-b8e5-7ad9b23292c2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oCGhbmQt'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4f82ff-81e0-40d4-9d18-a296b9d62076]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[489f17cc-9b0d-414c-987c-76afda26adbe]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 21:07:32 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 21:07:32 user nova-compute[75571]:  {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:07:32 user nova-compute[75571]: WARNING os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 21:07:32 user nova-compute[75571]: 
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dceac55-707f-4fad-a736-52efbba5318e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260]
Nov 28 21:07:32 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260] successful.
Nov 28 21:07:32 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5ea29e-74c7-424c-9fbb-fd2cdf205138]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a8f35d-1bef-4bad-9407-3593acdf986b]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)
Nov 28 21:07:32 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)
Nov 28 21:07:32 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5138ac3-ae5c-45c3-9f67-03d97a11e1da]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:07:32 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCGhbmQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26231376531613039', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231376531613039', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1869233185',display_name='tempest-TestVolumeBootPattern-server-1869233185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1869233185',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGBrnh5f2cItdPfJzsexfZNk2hdyXzj152ZtqQ9Dor6rVz8HgZT9NNlrjLjwllNv6HIex4SrodZhI/wURy2F3kX7ieRaGyNBcRFhM7hNUlDgud3W2BORHw9s0Uz7PxaoQ==',key_name='tempest-TestVolumeBootPattern-71941204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-egw1g647',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T21:07:25Z,user_data=None,user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=86ee3671-369b-4689-aad8-6d6dae45e786,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "address": "fa:16:3e:4c:9f:b0", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62a74-cd", "ovs_interfaceid": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "address": "fa:16:3e:4c:9f:b0", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62a74-cd", "ovs_interfaceid": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:9f:b0,bridge_name='br-int',has_traffic_filtering=True,id=38a62a74-cd61-47f8-9fae-c2e1a372cebe,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a62a74-cd') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lazy-loading 'pci_devices' on Instance uuid 86ee3671-369b-4689-aad8-6d6dae45e786 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] End _get_guest_xml xml=<domain type="kvm">
Nov 28 21:07:33 user nova-compute[75571]:   <uuid>86ee3671-369b-4689-aad8-6d6dae45e786</uuid>
Nov 28 21:07:33 user nova-compute[75571]:   <name>instance-00000032</name>
Nov 28 21:07:33 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 21:07:33 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 21:07:33 user nova-compute[75571]:   <metadata>
Nov 28 21:07:33 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 21:07:33 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 21:07:33 user nova-compute[75571]:       <nova:name>tempest-TestVolumeBootPattern-server-1869233185</nova:name>
Nov 28 21:07:33 user nova-compute[75571]:       <nova:creationTime>2023-11-28 21:07:32</nova:creationTime>
Nov 28 21:07:33 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 21:07:33 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 21:07:33 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 21:07:33 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 21:07:33 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 21:07:33 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 21:07:33 user nova-compute[75571]:       </nova:flavor>
Nov 28 21:07:33 user nova-compute[75571]:       <nova:owner>
Nov 28 21:07:33 user nova-compute[75571]:         <nova:user uuid="fc8d37446f714002b8c5c4395ab82d58">tempest-TestVolumeBootPattern-845056434-project-member</nova:user>
Nov 28 21:07:33 user nova-compute[75571]:         <nova:project uuid="f852e1ca6d934711942031022097eb36">tempest-TestVolumeBootPattern-845056434</nova:project>
Nov 28 21:07:33 user nova-compute[75571]:       </nova:owner>
Nov 28 21:07:33 user nova-compute[75571]:       <nova:ports>
Nov 28 21:07:33 user nova-compute[75571]:         <nova:port uuid="38a62a74-cd61-47f8-9fae-c2e1a372cebe">
Nov 28 21:07:33 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 21:07:33 user nova-compute[75571]:         </nova:port>
Nov 28 21:07:33 user nova-compute[75571]:       </nova:ports>
Nov 28 21:07:33 user nova-compute[75571]:     </nova:instance>
Nov 28 21:07:33 user nova-compute[75571]:   </metadata>
Nov 28 21:07:33 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 21:07:33 user nova-compute[75571]:     <system>
Nov 28 21:07:33 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 21:07:33 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 21:07:33 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 21:07:33 user nova-compute[75571]:       <entry name="serial">86ee3671-369b-4689-aad8-6d6dae45e786</entry>
Nov 28 21:07:33 user nova-compute[75571]:       <entry name="uuid">86ee3671-369b-4689-aad8-6d6dae45e786</entry>
Nov 28 21:07:33 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 21:07:33 user nova-compute[75571]:     </system>
Nov 28 21:07:33 user nova-compute[75571]:   </sysinfo>
Nov 28 21:07:33 user nova-compute[75571]:   <os>
Nov 28 21:07:33 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 21:07:33 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 21:07:33 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 21:07:33 user nova-compute[75571]:   </os>
Nov 28 21:07:33 user nova-compute[75571]:   <features>
Nov 28 21:07:33 user nova-compute[75571]:     <acpi/>
Nov 28 21:07:33 user nova-compute[75571]:     <apic/>
Nov 28 21:07:33 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 21:07:33 user nova-compute[75571]:   </features>
Nov 28 21:07:33 user nova-compute[75571]:   <clock offset="utc">
Nov 28 21:07:33 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 21:07:33 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 21:07:33 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 21:07:33 user nova-compute[75571]:   </clock>
Nov 28 21:07:33 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 21:07:33 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 21:07:33 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 21:07:33 user nova-compute[75571]:   </cpu>
Nov 28 21:07:33 user nova-compute[75571]:   <devices>
Nov 28 21:07:33 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 21:07:33 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:07:33 user nova-compute[75571]:       <source dev="/dev/sdb"/>
Nov 28 21:07:33 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 21:07:33 user nova-compute[75571]:       <serial>dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5</serial>
Nov 28 21:07:33 user nova-compute[75571]:     </disk>
Nov 28 21:07:33 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 21:07:33 user nova-compute[75571]:       <mac address="fa:16:3e:4c:9f:b0"/>
Nov 28 21:07:33 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 21:07:33 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 21:07:33 user nova-compute[75571]:       <target dev="tap38a62a74-cd"/>
Nov 28 21:07:33 user nova-compute[75571]:     </interface>
Nov 28 21:07:33 user nova-compute[75571]:     <serial type="pty">
Nov 28 21:07:33 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/86ee3671-369b-4689-aad8-6d6dae45e786/console.log" append="off"/>
Nov 28 21:07:33 user nova-compute[75571]:     </serial>
Nov 28 21:07:33 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 21:07:33 user nova-compute[75571]:     <video>
Nov 28 21:07:33 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 21:07:33 user nova-compute[75571]:     </video>
Nov 28 21:07:33 user nova-compute[75571]:     <rng model="virtio">
Nov 28 21:07:33 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 21:07:33 user nova-compute[75571]:     </rng>
Nov 28 21:07:33 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 21:07:33 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 21:07:33 user nova-compute[75571]:       <stats period="10"/>
Nov 28 21:07:33 user nova-compute[75571]:     </memballoon>
Nov 28 21:07:33 user nova-compute[75571]:   </devices>
Nov 28 21:07:33 user nova-compute[75571]: </domain>
Nov 28 21:07:33 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1869233185',display_name='tempest-TestVolumeBootPattern-server-1869233185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1869233185',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGBrnh5f2cItdPfJzsexfZNk2hdyXzj152ZtqQ9Dor6rVz8HgZT9NNlrjLjwllNv6HIex4SrodZhI/wURy2F3kX7ieRaGyNBcRFhM7hNUlDgud3W2BORHw9s0Uz7PxaoQ==',key_name='tempest-TestVolumeBootPattern-71941204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-egw1g647',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T21:07:25Z,user_data=None,user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=86ee3671-369b-4689-aad8-6d6dae45e786,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "address": "fa:16:3e:4c:9f:b0", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62a74-cd", "ovs_interfaceid": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "address": "fa:16:3e:4c:9f:b0", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62a74-cd", "ovs_interfaceid": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:9f:b0,bridge_name='br-int',has_traffic_filtering=True,id=38a62a74-cd61-47f8-9fae-c2e1a372cebe,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a62a74-cd') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG os_vif [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:9f:b0,bridge_name='br-int',has_traffic_filtering=True,id=38a62a74-cd61-47f8-9fae-c2e1a372cebe,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a62a74-cd') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'acea5bb7-a1a6-5e33-90ef-771a74ef4980', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38a62a74-cd, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38a62a74-cd, col_values=(('qos', UUID('b59b6de2-4f50-4292-bef1-456633b9a0da')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38a62a74-cd, col_values=(('external_ids', {'iface-id': '38a62a74-cd61-47f8-9fae-c2e1a372cebe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:9f:b0', 'vm-uuid': '86ee3671-369b-4689-aad8-6d6dae45e786'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:33 user nova-compute[75571]: INFO os_vif [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:9f:b0,bridge_name='br-int',has_traffic_filtering=True,id=38a62a74-cd61-47f8-9fae-c2e1a372cebe,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a62a74-cd')
Nov 28 21:07:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 21:07:33 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] No VIF found with MAC fa:16:3e:4c:9f:b0, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 21:07:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-ef55ee7b-5507-4960-bb9b-78e7a5c54679 req-ea989c3e-758c-40b8-9b34-313dd66be141 service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Received event network-vif-plugged-38a62a74-cd61-47f8-9fae-c2e1a372cebe {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:07:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ef55ee7b-5507-4960-bb9b-78e7a5c54679 req-ea989c3e-758c-40b8-9b34-313dd66be141 service nova] Acquiring lock "86ee3671-369b-4689-aad8-6d6dae45e786-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:07:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ef55ee7b-5507-4960-bb9b-78e7a5c54679 req-ea989c3e-758c-40b8-9b34-313dd66be141 service nova] Lock "86ee3671-369b-4689-aad8-6d6dae45e786-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:07:35 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-ef55ee7b-5507-4960-bb9b-78e7a5c54679 req-ea989c3e-758c-40b8-9b34-313dd66be141 service nova] Lock "86ee3671-369b-4689-aad8-6d6dae45e786-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:07:35 user nova-compute[75571]: DEBUG nova.compute.manager [req-ef55ee7b-5507-4960-bb9b-78e7a5c54679 req-ea989c3e-758c-40b8-9b34-313dd66be141 service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] No waiting events found dispatching network-vif-plugged-38a62a74-cd61-47f8-9fae-c2e1a372cebe {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:07:35 user nova-compute[75571]: WARNING nova.compute.manager [req-ef55ee7b-5507-4960-bb9b-78e7a5c54679 req-ea989c3e-758c-40b8-9b34-313dd66be141 service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Received unexpected event network-vif-plugged-38a62a74-cd61-47f8-9fae-c2e1a372cebe for instance with vm_state building and task_state spawning.
Nov 28 21:07:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:36 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 21:07:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 21:07:36 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Instance spawned successfully.
Nov 28 21:07:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 21:07:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:07:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:07:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:07:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:07:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:07:37 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:07:37 user nova-compute[75571]: INFO nova.compute.manager [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 28 21:07:37 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 21:07:37 user nova-compute[75571]: INFO nova.compute.manager [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Took 12.59 seconds to build instance.
Nov 28 21:07:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "86ee3671-369b-4689-aad8-6d6dae45e786" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.698s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:07:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-514a6c5f-5932-4dc7-93b0-b03bbac786f8 req-41b9f5c7-51dd-49e3-ad41-26bda40a1d3b service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Received event network-vif-plugged-38a62a74-cd61-47f8-9fae-c2e1a372cebe {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:07:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-514a6c5f-5932-4dc7-93b0-b03bbac786f8 req-41b9f5c7-51dd-49e3-ad41-26bda40a1d3b service nova] Acquiring lock "86ee3671-369b-4689-aad8-6d6dae45e786-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:07:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-514a6c5f-5932-4dc7-93b0-b03bbac786f8 req-41b9f5c7-51dd-49e3-ad41-26bda40a1d3b service nova] Lock "86ee3671-369b-4689-aad8-6d6dae45e786-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:07:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-514a6c5f-5932-4dc7-93b0-b03bbac786f8 req-41b9f5c7-51dd-49e3-ad41-26bda40a1d3b service nova] Lock "86ee3671-369b-4689-aad8-6d6dae45e786-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:07:37 user nova-compute[75571]: DEBUG nova.compute.manager [req-514a6c5f-5932-4dc7-93b0-b03bbac786f8 req-41b9f5c7-51dd-49e3-ad41-26bda40a1d3b service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] No waiting events found dispatching network-vif-plugged-38a62a74-cd61-47f8-9fae-c2e1a372cebe {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:07:37 user nova-compute[75571]: WARNING nova.compute.manager [req-514a6c5f-5932-4dc7-93b0-b03bbac786f8 req-41b9f5c7-51dd-49e3-ad41-26bda40a1d3b service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Received unexpected event network-vif-plugged-38a62a74-cd61-47f8-9fae-c2e1a372cebe for instance with vm_state active and task_state None.
Nov 28 21:07:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:42 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:07:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:07:44 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:07:44 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:07:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-86ee3671-369b-4689-aad8-6d6dae45e786" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:07:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-86ee3671-369b-4689-aad8-6d6dae45e786" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:07:44 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:07:44 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 86ee3671-369b-4689-aad8-6d6dae45e786 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:07:44 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Updating instance_info_cache with network_info: [{"id": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "address": "fa:16:3e:4c:9f:b0", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62a74-cd", "ovs_interfaceid": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:07:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-86ee3671-369b-4689-aad8-6d6dae45e786" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:07:44 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:07:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:07:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:07:45 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:07:45 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:07:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 21:07:51 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:07:51 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:07:51 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=25.006675720214844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 86ee3671-369b-4689-aad8-6d6dae45e786 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing inventories for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating ProviderTree inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing aggregate associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, aggregates: None {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing trait associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:07:51 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:07:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:07:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:07:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:07:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:07:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:07:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:03 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:08:03 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75571) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 21:08:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:08:10 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:08:10 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 21:08:10 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] There are 0 instances to clean {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 21:08:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:08:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:08:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:08:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:08:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:15 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:08:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:08:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:08:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:08:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:08:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:22 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:08:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:08:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:08:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:08:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:08:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:08:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:08:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:08:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:08:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:08:33 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:08:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:08:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:08:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:08:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:08:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:08:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:42 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:08:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:08:44 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:08:44 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:08:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-86ee3671-369b-4689-aad8-6d6dae45e786" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:08:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-86ee3671-369b-4689-aad8-6d6dae45e786" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:08:44 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:08:44 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid 86ee3671-369b-4689-aad8-6d6dae45e786 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:08:44 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Updating instance_info_cache with network_info: [{"id": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "address": "fa:16:3e:4c:9f:b0", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62a74-cd", "ovs_interfaceid": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:08:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-86ee3671-369b-4689-aad8-6d6dae45e786" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:08:44 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:08:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:08:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:08:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:08:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:08:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:08:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 21:08:52 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:08:52 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:08:52 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9032MB free_disk=25.00606918334961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 86ee3671-369b-4689-aad8-6d6dae45e786 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:08:52 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:08:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:08:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:08:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:08:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:08:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:08:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:08:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:08:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:08:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:08:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:08:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:09:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:09:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:09:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:09:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:09:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:09:09 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid 86ee3671-369b-4689-aad8-6d6dae45e786 {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 21:09:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "86ee3671-369b-4689-aad8-6d6dae45e786" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:09:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "86ee3671-369b-4689-aad8-6d6dae45e786" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:09:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "86ee3671-369b-4689-aad8-6d6dae45e786" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:09:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:09:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:09:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:09:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:09:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:09:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:09:16 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-e8d32861-c6eb-4874-8447-cb33983c26a3 req-3556313a-4ef9-497f-8ea8-123c0fdaa0bb service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Received event network-changed-38a62a74-cd61-47f8-9fae-c2e1a372cebe {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:09:16 user nova-compute[75571]: DEBUG nova.compute.manager [req-e8d32861-c6eb-4874-8447-cb33983c26a3 req-3556313a-4ef9-497f-8ea8-123c0fdaa0bb service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Refreshing instance network info cache due to event network-changed-38a62a74-cd61-47f8-9fae-c2e1a372cebe. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 21:09:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e8d32861-c6eb-4874-8447-cb33983c26a3 req-3556313a-4ef9-497f-8ea8-123c0fdaa0bb service nova] Acquiring lock "refresh_cache-86ee3671-369b-4689-aad8-6d6dae45e786" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:09:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e8d32861-c6eb-4874-8447-cb33983c26a3 req-3556313a-4ef9-497f-8ea8-123c0fdaa0bb service nova] Acquired lock "refresh_cache-86ee3671-369b-4689-aad8-6d6dae45e786" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:09:16 user nova-compute[75571]: DEBUG nova.network.neutron [req-e8d32861-c6eb-4874-8447-cb33983c26a3 req-3556313a-4ef9-497f-8ea8-123c0fdaa0bb service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Refreshing network info cache for port 38a62a74-cd61-47f8-9fae-c2e1a372cebe {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "86ee3671-369b-4689-aad8-6d6dae45e786" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "86ee3671-369b-4689-aad8-6d6dae45e786" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "86ee3671-369b-4689-aad8-6d6dae45e786-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "86ee3671-369b-4689-aad8-6d6dae45e786-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "86ee3671-369b-4689-aad8-6d6dae45e786-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:09:17 user nova-compute[75571]: INFO nova.compute.manager [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Terminating instance
Nov 28 21:09:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG nova.network.neutron [req-e8d32861-c6eb-4874-8447-cb33983c26a3 req-3556313a-4ef9-497f-8ea8-123c0fdaa0bb service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Updated VIF entry in instance network info cache for port 38a62a74-cd61-47f8-9fae-c2e1a372cebe. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG nova.network.neutron [req-e8d32861-c6eb-4874-8447-cb33983c26a3 req-3556313a-4ef9-497f-8ea8-123c0fdaa0bb service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Updating instance_info_cache with network_info: [{"id": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "address": "fa:16:3e:4c:9f:b0", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62a74-cd", "ovs_interfaceid": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-e8d32861-c6eb-4874-8447-cb33983c26a3 req-3556313a-4ef9-497f-8ea8-123c0fdaa0bb service nova] Releasing lock "refresh_cache-86ee3671-369b-4689-aad8-6d6dae45e786" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-c8e69497-56c9-425a-9a31-5d6c03008a8d req-1b7fdb73-4115-4c83-9fcf-4f52e2d7774b service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Received event network-vif-unplugged-38a62a74-cd61-47f8-9fae-c2e1a372cebe {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c8e69497-56c9-425a-9a31-5d6c03008a8d req-1b7fdb73-4115-4c83-9fcf-4f52e2d7774b service nova] Acquiring lock "86ee3671-369b-4689-aad8-6d6dae45e786-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c8e69497-56c9-425a-9a31-5d6c03008a8d req-1b7fdb73-4115-4c83-9fcf-4f52e2d7774b service nova] Lock "86ee3671-369b-4689-aad8-6d6dae45e786-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c8e69497-56c9-425a-9a31-5d6c03008a8d req-1b7fdb73-4115-4c83-9fcf-4f52e2d7774b service nova] Lock "86ee3671-369b-4689-aad8-6d6dae45e786-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-c8e69497-56c9-425a-9a31-5d6c03008a8d req-1b7fdb73-4115-4c83-9fcf-4f52e2d7774b service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] No waiting events found dispatching network-vif-unplugged-38a62a74-cd61-47f8-9fae-c2e1a372cebe {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:09:17 user nova-compute[75571]: DEBUG nova.compute.manager [req-c8e69497-56c9-425a-9a31-5d6c03008a8d req-1b7fdb73-4115-4c83-9fcf-4f52e2d7774b service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Received event network-vif-unplugged-38a62a74-cd61-47f8-9fae-c2e1a372cebe for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 21:09:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Instance destroyed successfully.
Nov 28 21:09:18 user nova-compute[75571]: DEBUG nova.objects.instance [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lazy-loading 'resources' on Instance uuid 86ee3671-369b-4689-aad8-6d6dae45e786 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1869233185',display_name='tempest-TestVolumeBootPattern-server-1869233185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1869233185',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGBrnh5f2cItdPfJzsexfZNk2hdyXzj152ZtqQ9Dor6rVz8HgZT9NNlrjLjwllNv6HIex4SrodZhI/wURy2F3kX7ieRaGyNBcRFhM7hNUlDgud3W2BORHw9s0Uz7PxaoQ==',key_name='tempest-TestVolumeBootPattern-71941204',keypairs=<?>,launch_index=0,launched_at=2023-11-28T21:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-egw1g647',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T21:07:37Z,user_data=None,user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=86ee3671-369b-4689-aad8-6d6dae45e786,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "address": "fa:16:3e:4c:9f:b0", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62a74-cd", "ovs_interfaceid": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "address": "fa:16:3e:4c:9f:b0", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62a74-cd", "ovs_interfaceid": "38a62a74-cd61-47f8-9fae-c2e1a372cebe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:9f:b0,bridge_name='br-int',has_traffic_filtering=True,id=38a62a74-cd61-47f8-9fae-c2e1a372cebe,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a62a74-cd') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_vif [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:9f:b0,bridge_name='br-int',has_traffic_filtering=True,id=38a62a74-cd61-47f8-9fae-c2e1a372cebe,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a62a74-cd') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38a62a74-cd, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b59b6de2-4f50-4292-bef1-456633b9a0da) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:09:18 user nova-compute[75571]: INFO os_vif [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:9f:b0,bridge_name='br-int',has_traffic_filtering=True,id=38a62a74-cd61-47f8-9fae-c2e1a372cebe,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a62a74-cd')
Nov 28 21:09:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCGhbmQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:09:18 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0133dd2f-ae76-4047-89ab-92384a68f0c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 21:09:18 user nova-compute[75571]: No targets found.
Nov 28 21:09:18 user nova-compute[75571]: iSNS:
Nov 28 21:09:18 user nova-compute[75571]: No targets found.
Nov 28 21:09:18 user nova-compute[75571]: STATIC:
Nov 28 21:09:18 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5
Nov 28 21:09:18 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 21:09:18 user nova-compute[75571]:                 Iface Name: default
Nov 28 21:09:18 user nova-compute[75571]: FIRMWARE:
Nov 28 21:09:18 user nova-compute[75571]: No targets found.
Nov 28 21:09:18 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 21:09:18 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 21:09:18 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e93eb6-ed33-4454-b890-3944baa693ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb72e99f-fe2f-4be7-a77c-5a383fae81b0]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)
Nov 28 21:09:18 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)
Nov 28 21:09:18 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768155510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bdb105-80fd-45b0-81f0-860c4982f78a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce6ecac-301a-4b65-b069-93ebf6626a80]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a416e3b-b184-4b9b-bf2c-de9bffd9feca]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.094s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[34194d62-8cd8-4ab6-a016-39684802c0fc]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOcffec7d3-b17e1a095f19ba3a', '/dev/disk/by-id/scsi-26231376531613039', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cffec7d3') {{(pid=86013) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d22d795-c531-45f1-a1e2-ed845bd777df]: (4, None) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe4f8d4-52ba-4e1c-8c75-9ebfda07a2d7]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b264176b-a337-4487-93c8-59bd9629ebd1]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260]
Nov 28 21:09:18 user nova-compute[75571]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260] successful.
Nov 28 21:09:18 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e20582-ae78-4934-876e-345f8404a7bf]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== disconnect_volume: return (339ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 21:09:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Deleting instance files /opt/stack/data/nova/instances/86ee3671-369b-4689-aad8-6d6dae45e786_del
Nov 28 21:09:18 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Deletion of /opt/stack/data/nova/instances/86ee3671-369b-4689-aad8-6d6dae45e786_del complete
Nov 28 21:09:18 user nova-compute[75571]: INFO nova.compute.manager [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 28 21:09:18 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 21:09:18 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 21:09:19 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:09:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-64fe23f3-8b12-45df-886a-282417a75706 req-37c9c1f9-4ff9-426a-b1a7-8cbb989ade8b service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Received event network-vif-deleted-38a62a74-cd61-47f8-9fae-c2e1a372cebe {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:09:19 user nova-compute[75571]: INFO nova.compute.manager [req-64fe23f3-8b12-45df-886a-282417a75706 req-37c9c1f9-4ff9-426a-b1a7-8cbb989ade8b service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Neutron deleted interface 38a62a74-cd61-47f8-9fae-c2e1a372cebe; detaching it from the instance and deleting it from the info cache
Nov 28 21:09:19 user nova-compute[75571]: DEBUG nova.network.neutron [req-64fe23f3-8b12-45df-886a-282417a75706 req-37c9c1f9-4ff9-426a-b1a7-8cbb989ade8b service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:09:19 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Took 0.70 seconds to deallocate network for instance.
Nov 28 21:09:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-64fe23f3-8b12-45df-886a-282417a75706 req-37c9c1f9-4ff9-426a-b1a7-8cbb989ade8b service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Detach interface failed, port_id=38a62a74-cd61-47f8-9fae-c2e1a372cebe, reason: Instance 86ee3671-369b-4689-aad8-6d6dae45e786 could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 21:09:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-b668907b-6774-42c5-8a05-f8cb25028638 req-72e8895b-8b6f-4c75-9992-78727a24b0a0 service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Received event network-vif-plugged-38a62a74-cd61-47f8-9fae-c2e1a372cebe {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:09:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b668907b-6774-42c5-8a05-f8cb25028638 req-72e8895b-8b6f-4c75-9992-78727a24b0a0 service nova] Acquiring lock "86ee3671-369b-4689-aad8-6d6dae45e786-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:09:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b668907b-6774-42c5-8a05-f8cb25028638 req-72e8895b-8b6f-4c75-9992-78727a24b0a0 service nova] Lock "86ee3671-369b-4689-aad8-6d6dae45e786-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:09:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b668907b-6774-42c5-8a05-f8cb25028638 req-72e8895b-8b6f-4c75-9992-78727a24b0a0 service nova] Lock "86ee3671-369b-4689-aad8-6d6dae45e786-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:09:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-b668907b-6774-42c5-8a05-f8cb25028638 req-72e8895b-8b6f-4c75-9992-78727a24b0a0 service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] No waiting events found dispatching network-vif-plugged-38a62a74-cd61-47f8-9fae-c2e1a372cebe {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:09:19 user nova-compute[75571]: WARNING nova.compute.manager [req-b668907b-6774-42c5-8a05-f8cb25028638 req-72e8895b-8b6f-4c75-9992-78727a24b0a0 service nova] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Received unexpected event network-vif-plugged-38a62a74-cd61-47f8-9fae-c2e1a372cebe for instance with vm_state active and task_state deleting.
Nov 28 21:09:20 user nova-compute[75571]: INFO nova.compute.manager [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Took 0.77 seconds to detach 1 volumes for instance.
Nov 28 21:09:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:09:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:09:20 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:09:20 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:09:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:09:20 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Deleted allocations for instance 86ee3671-369b-4689-aad8-6d6dae45e786
Nov 28 21:09:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "86ee3671-369b-4689-aad8-6d6dae45e786" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.987s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:09:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:09:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:42 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:09:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:09:46 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:09:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:09:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:09:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 21:09:46 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:09:46 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:09:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:09:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:09:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:09:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:09:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:09:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:09:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:09:52 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:09:53 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:09:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:09:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:09:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:09:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:09:53 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:09:53 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:09:53 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:09:53 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9164MB free_disk=24.997390747070312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:09:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:09:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:09:53 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:09:53 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:09:53 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:09:53 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:09:53 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:09:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:09:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:10:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "e9c958cd-014c-405d-bf1c-1a44b70a8692" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "e9c958cd-014c-405d-bf1c-1a44b70a8692" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 21:10:10 user nova-compute[75571]: INFO nova.compute.claims [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Claim successful on node user
Nov 28 21:10:10 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 21:10:10 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 21:10:10 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG nova.policy [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 21:10:10 user nova-compute[75571]: INFO nova.virt.block_device [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Booting with volume dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 at /dev/vda
Nov 28 21:10:10 user nova-compute[75571]: DEBUG os_brick.utils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[362369ec-5da3-47c8-af4f-01901cc0e17d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef4269e-5bd3-4b65-a051-dbda296d3c5b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f3730c-28b6-43e4-9796-2d93139c5c32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbe43ee-e06b-4617-9f19-b085f9c0c71e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:10:10 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 21:10:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[28838880-6d53-48a7-8485-580ffbabb93d]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG os_brick.utils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:10:10 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updating existing volume attachment record: cffd1d2f-7ca2-43a3-b3a6-cf1f04b05a9d {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 21:10:11 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Successfully created port: 16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Successfully updated port: 16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquired lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-75eff6b5-5d2b-4afd-8387-6a9c94817f5b req-6e9489c7-d58b-4c64-8675-e8c663347d7d service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Received event network-changed-16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG nova.compute.manager [req-75eff6b5-5d2b-4afd-8387-6a9c94817f5b req-6e9489c7-d58b-4c64-8675-e8c663347d7d service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Refreshing instance network info cache due to event network-changed-16a8d2a2-3dec-4422-b70b-57c5cb01542f. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-75eff6b5-5d2b-4afd-8387-6a9c94817f5b req-6e9489c7-d58b-4c64-8675-e8c663347d7d service nova] Acquiring lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG nova.network.neutron [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updating instance_info_cache with network_info: [{"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Releasing lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Instance network_info: |[{"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-75eff6b5-5d2b-4afd-8387-6a9c94817f5b req-6e9489c7-d58b-4c64-8675-e8c663347d7d service nova] Acquired lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG nova.network.neutron [req-75eff6b5-5d2b-4afd-8387-6a9c94817f5b req-6e9489c7-d58b-4c64-8675-e8c663347d7d service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Refreshing network info cache for port 16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG nova.network.neutron [req-75eff6b5-5d2b-4afd-8387-6a9c94817f5b req-6e9489c7-d58b-4c64-8675-e8c663347d7d service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updated VIF entry in instance network info cache for port 16a8d2a2-3dec-4422-b70b-57c5cb01542f. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG nova.network.neutron [req-75eff6b5-5d2b-4afd-8387-6a9c94817f5b req-6e9489c7-d58b-4c64-8675-e8c663347d7d service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updating instance_info_cache with network_info: [{"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:10:12 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-75eff6b5-5d2b-4afd-8387-6a9c94817f5b req-6e9489c7-d58b-4c64-8675-e8c663347d7d service nova] Releasing lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:10:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:10:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:10:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:10:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:10:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:16 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 21:10:17 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Creating image(s)
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Ensure instance console log exists: /opt/stack/data/nova/instances/e9c958cd-014c-405d-bf1c-1a44b70a8692/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Start _get_guest_xml network_info=[{"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCGhbmQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e9c958cd-014c-405d-bf1c-1a44b70a8692', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5', 'serial': 'dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'cffd1d2f-7ca2-43a3-b3a6-cf1f04b05a9d', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 21:10:17 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:10:17 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCGhbmQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:10:17 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:10:17 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:10:17 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6babb5-6e02-4e17-a0f8-75b76fbba5e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 21:10:17 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[039b0780-c718-4e7d-ad25-f00fc5318029]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5] added
Nov 28 21:10:17 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[41668937-e580-40ff-8209-1e72f1690e5a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ef4fef-534c-4841-ae68-76a9ae93982c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oCGhbmQt {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oCGhbmQt" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b7b15e-3365-4860-aac1-a81b597997e8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oCGhbmQt'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fadb615-1bfe-4884-b973-608e52b0e8e2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[21756b76-3d17-4adb-bc66-97cbc83ee4f2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 21:10:17 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 21:10:17 user nova-compute[75571]:  {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:10:17 user nova-compute[75571]: WARNING os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 21:10:17 user nova-compute[75571]: 
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c73f4e5-9ba6-43e2-a743-df63183fd82b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260]
Nov 28 21:10:17 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260] successful.
Nov 28 21:10:17 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d493889a-cd15-45fc-bf73-73e5e43aa914]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70168fc-13c8-43ed-9395-e5742e9fffec]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)
Nov 28 21:10:17 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)
Nov 28 21:10:17 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2ec306-f279-42ee-8bf2-a273321e3067]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:10:17 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCGhbmQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26231376531613039', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231376531613039', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-30267068',display_name='tempest-TestVolumeBootPattern-server-30267068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-30267068',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGBrnh5f2cItdPfJzsexfZNk2hdyXzj152ZtqQ9Dor6rVz8HgZT9NNlrjLjwllNv6HIex4SrodZhI/wURy2F3kX7ieRaGyNBcRFhM7hNUlDgud3W2BORHw9s0Uz7PxaoQ==',key_name='tempest-TestVolumeBootPattern-71941204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-xwsbxs4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T21:10:11Z,user_data=None,user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=e9c958cd-014c-405d-bf1c-1a44b70a8692,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a8:33,bridge_name='br-int',has_traffic_filtering=True,id=16a8d2a2-3dec-4422-b70b-57c5cb01542f,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a8d2a2-3d') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG nova.objects.instance [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lazy-loading 'pci_devices' on Instance uuid e9c958cd-014c-405d-bf1c-1a44b70a8692 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] End _get_guest_xml xml=<domain type="kvm">
Nov 28 21:10:18 user nova-compute[75571]:   <uuid>e9c958cd-014c-405d-bf1c-1a44b70a8692</uuid>
Nov 28 21:10:18 user nova-compute[75571]:   <name>instance-00000033</name>
Nov 28 21:10:18 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 21:10:18 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 21:10:18 user nova-compute[75571]:   <metadata>
Nov 28 21:10:18 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 21:10:18 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 21:10:18 user nova-compute[75571]:       <nova:name>tempest-TestVolumeBootPattern-server-30267068</nova:name>
Nov 28 21:10:18 user nova-compute[75571]:       <nova:creationTime>2023-11-28 21:10:17</nova:creationTime>
Nov 28 21:10:18 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 21:10:18 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 21:10:18 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 21:10:18 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 21:10:18 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 21:10:18 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 21:10:18 user nova-compute[75571]:       </nova:flavor>
Nov 28 21:10:18 user nova-compute[75571]:       <nova:owner>
Nov 28 21:10:18 user nova-compute[75571]:         <nova:user uuid="fc8d37446f714002b8c5c4395ab82d58">tempest-TestVolumeBootPattern-845056434-project-member</nova:user>
Nov 28 21:10:18 user nova-compute[75571]:         <nova:project uuid="f852e1ca6d934711942031022097eb36">tempest-TestVolumeBootPattern-845056434</nova:project>
Nov 28 21:10:18 user nova-compute[75571]:       </nova:owner>
Nov 28 21:10:18 user nova-compute[75571]:       <nova:ports>
Nov 28 21:10:18 user nova-compute[75571]:         <nova:port uuid="16a8d2a2-3dec-4422-b70b-57c5cb01542f">
Nov 28 21:10:18 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 21:10:18 user nova-compute[75571]:         </nova:port>
Nov 28 21:10:18 user nova-compute[75571]:       </nova:ports>
Nov 28 21:10:18 user nova-compute[75571]:     </nova:instance>
Nov 28 21:10:18 user nova-compute[75571]:   </metadata>
Nov 28 21:10:18 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 21:10:18 user nova-compute[75571]:     <system>
Nov 28 21:10:18 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 21:10:18 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 21:10:18 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 21:10:18 user nova-compute[75571]:       <entry name="serial">e9c958cd-014c-405d-bf1c-1a44b70a8692</entry>
Nov 28 21:10:18 user nova-compute[75571]:       <entry name="uuid">e9c958cd-014c-405d-bf1c-1a44b70a8692</entry>
Nov 28 21:10:18 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 21:10:18 user nova-compute[75571]:     </system>
Nov 28 21:10:18 user nova-compute[75571]:   </sysinfo>
Nov 28 21:10:18 user nova-compute[75571]:   <os>
Nov 28 21:10:18 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 21:10:18 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 21:10:18 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 21:10:18 user nova-compute[75571]:   </os>
Nov 28 21:10:18 user nova-compute[75571]:   <features>
Nov 28 21:10:18 user nova-compute[75571]:     <acpi/>
Nov 28 21:10:18 user nova-compute[75571]:     <apic/>
Nov 28 21:10:18 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 21:10:18 user nova-compute[75571]:   </features>
Nov 28 21:10:18 user nova-compute[75571]:   <clock offset="utc">
Nov 28 21:10:18 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 21:10:18 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 21:10:18 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 21:10:18 user nova-compute[75571]:   </clock>
Nov 28 21:10:18 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 21:10:18 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 21:10:18 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 21:10:18 user nova-compute[75571]:   </cpu>
Nov 28 21:10:18 user nova-compute[75571]:   <devices>
Nov 28 21:10:18 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 21:10:18 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:10:18 user nova-compute[75571]:       <source dev="/dev/sdb"/>
Nov 28 21:10:18 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 21:10:18 user nova-compute[75571]:       <serial>dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5</serial>
Nov 28 21:10:18 user nova-compute[75571]:     </disk>
Nov 28 21:10:18 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 21:10:18 user nova-compute[75571]:       <mac address="fa:16:3e:4d:a8:33"/>
Nov 28 21:10:18 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 21:10:18 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 21:10:18 user nova-compute[75571]:       <target dev="tap16a8d2a2-3d"/>
Nov 28 21:10:18 user nova-compute[75571]:     </interface>
Nov 28 21:10:18 user nova-compute[75571]:     <serial type="pty">
Nov 28 21:10:18 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/e9c958cd-014c-405d-bf1c-1a44b70a8692/console.log" append="off"/>
Nov 28 21:10:18 user nova-compute[75571]:     </serial>
Nov 28 21:10:18 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 21:10:18 user nova-compute[75571]:     <video>
Nov 28 21:10:18 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 21:10:18 user nova-compute[75571]:     </video>
Nov 28 21:10:18 user nova-compute[75571]:     <rng model="virtio">
Nov 28 21:10:18 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 21:10:18 user nova-compute[75571]:     </rng>
Nov 28 21:10:18 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 21:10:18 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 21:10:18 user nova-compute[75571]:       <stats period="10"/>
Nov 28 21:10:18 user nova-compute[75571]:     </memballoon>
Nov 28 21:10:18 user nova-compute[75571]:   </devices>
Nov 28 21:10:18 user nova-compute[75571]: </domain>
Nov 28 21:10:18 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-30267068',display_name='tempest-TestVolumeBootPattern-server-30267068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-30267068',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGBrnh5f2cItdPfJzsexfZNk2hdyXzj152ZtqQ9Dor6rVz8HgZT9NNlrjLjwllNv6HIex4SrodZhI/wURy2F3kX7ieRaGyNBcRFhM7hNUlDgud3W2BORHw9s0Uz7PxaoQ==',key_name='tempest-TestVolumeBootPattern-71941204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-xwsbxs4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T21:10:11Z,user_data=None,user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=e9c958cd-014c-405d-bf1c-1a44b70a8692,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a8:33,bridge_name='br-int',has_traffic_filtering=True,id=16a8d2a2-3dec-4422-b70b-57c5cb01542f,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a8d2a2-3d') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG os_vif [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a8:33,bridge_name='br-int',has_traffic_filtering=True,id=16a8d2a2-3dec-4422-b70b-57c5cb01542f,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a8d2a2-3d') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc2cd96f-9c94-597f-acb6-869e0ef10eca', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16a8d2a2-3d, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16a8d2a2-3d, col_values=(('qos', UUID('5aa5d8cc-393d-4236-a6d5-77a305756b0d')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16a8d2a2-3d, col_values=(('external_ids', {'iface-id': '16a8d2a2-3dec-4422-b70b-57c5cb01542f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:a8:33', 'vm-uuid': 'e9c958cd-014c-405d-bf1c-1a44b70a8692'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:18 user nova-compute[75571]: INFO os_vif [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a8:33,bridge_name='br-int',has_traffic_filtering=True,id=16a8d2a2-3dec-4422-b70b-57c5cb01542f,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a8d2a2-3d')
Nov 28 21:10:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 21:10:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] No VIF found with MAC fa:16:3e:4d:a8:33, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 21:10:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-27c32c30-c28a-457e-936e-7f7ba2fe9c67 req-0ed03ad7-927e-4dc0-9dd2-ff18bc17e034 service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Received event network-vif-plugged-16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:10:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-27c32c30-c28a-457e-936e-7f7ba2fe9c67 req-0ed03ad7-927e-4dc0-9dd2-ff18bc17e034 service nova] Acquiring lock "e9c958cd-014c-405d-bf1c-1a44b70a8692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:10:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-27c32c30-c28a-457e-936e-7f7ba2fe9c67 req-0ed03ad7-927e-4dc0-9dd2-ff18bc17e034 service nova] Lock "e9c958cd-014c-405d-bf1c-1a44b70a8692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:10:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-27c32c30-c28a-457e-936e-7f7ba2fe9c67 req-0ed03ad7-927e-4dc0-9dd2-ff18bc17e034 service nova] Lock "e9c958cd-014c-405d-bf1c-1a44b70a8692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:10:20 user nova-compute[75571]: DEBUG nova.compute.manager [req-27c32c30-c28a-457e-936e-7f7ba2fe9c67 req-0ed03ad7-927e-4dc0-9dd2-ff18bc17e034 service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] No waiting events found dispatching network-vif-plugged-16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:10:20 user nova-compute[75571]: WARNING nova.compute.manager [req-27c32c30-c28a-457e-936e-7f7ba2fe9c67 req-0ed03ad7-927e-4dc0-9dd2-ff18bc17e034 service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Received unexpected event network-vif-plugged-16a8d2a2-3dec-4422-b70b-57c5cb01542f for instance with vm_state building and task_state spawning.
Nov 28 21:10:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:22 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 21:10:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 21:10:22 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Instance spawned successfully.
Nov 28 21:10:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 21:10:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:10:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:10:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:10:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:10:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:10:22 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:10:22 user nova-compute[75571]: INFO nova.compute.manager [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Took 4.88 seconds to spawn the instance on the hypervisor.
Nov 28 21:10:22 user nova-compute[75571]: DEBUG nova.compute.manager [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 21:10:22 user nova-compute[75571]: INFO nova.compute.manager [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Took 12.25 seconds to build instance.
Nov 28 21:10:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "e9c958cd-014c-405d-bf1c-1a44b70a8692" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.357s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:10:22 user nova-compute[75571]: DEBUG nova.compute.manager [req-283eee22-2fef-41ea-baaa-d7f1389a057f req-dbcf44a9-0071-4300-9968-0ccf61c40d63 service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Received event network-vif-plugged-16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:10:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-283eee22-2fef-41ea-baaa-d7f1389a057f req-dbcf44a9-0071-4300-9968-0ccf61c40d63 service nova] Acquiring lock "e9c958cd-014c-405d-bf1c-1a44b70a8692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:10:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-283eee22-2fef-41ea-baaa-d7f1389a057f req-dbcf44a9-0071-4300-9968-0ccf61c40d63 service nova] Lock "e9c958cd-014c-405d-bf1c-1a44b70a8692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:10:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-283eee22-2fef-41ea-baaa-d7f1389a057f req-dbcf44a9-0071-4300-9968-0ccf61c40d63 service nova] Lock "e9c958cd-014c-405d-bf1c-1a44b70a8692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:10:22 user nova-compute[75571]: DEBUG nova.compute.manager [req-283eee22-2fef-41ea-baaa-d7f1389a057f req-dbcf44a9-0071-4300-9968-0ccf61c40d63 service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] No waiting events found dispatching network-vif-plugged-16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:10:22 user nova-compute[75571]: WARNING nova.compute.manager [req-283eee22-2fef-41ea-baaa-d7f1389a057f req-dbcf44a9-0071-4300-9968-0ccf61c40d63 service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Received unexpected event network-vif-plugged-16a8d2a2-3dec-4422-b70b-57c5cb01542f for instance with vm_state active and task_state None.
Nov 28 21:10:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:10:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:10:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:10:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:46 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:10:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:10:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:10:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:10:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:10:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:10:46 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid e9c958cd-014c-405d-bf1c-1a44b70a8692 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:10:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updating instance_info_cache with network_info: [{"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:10:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:10:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:10:48 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:10:48 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:10:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:10:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:10:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:52 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:10:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:10:54 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:10:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:10:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:10:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:10:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:10:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:10:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 21:10:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:10:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:10:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9063MB free_disk=24.995655059814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:10:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:10:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:10:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e9c958cd-014c-405d-bf1c-1a44b70a8692 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:10:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:10:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:10:55 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:10:55 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:10:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:10:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:10:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:11:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:11:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:11:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:11:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:11:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:11:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:11:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:11:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:11:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:11:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:11:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:11:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:11:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:11:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:11:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:11:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:11:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:11:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:11:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:11:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:11:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:11:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:11:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:11:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:11:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:11:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:11:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:11:35 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:11:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:11:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:11:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:11:46 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:11:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:11:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:11:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:11:46 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid e9c958cd-014c-405d-bf1c-1a44b70a8692 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:11:46 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updating instance_info_cache with network_info: [{"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:11:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:11:46 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:11:48 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:11:48 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:11:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:11:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:11:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:11:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:11:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:11:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:11:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:11:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:11:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:11:54 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:11:54 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:11:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:11:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:11:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 21:11:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:11:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:11:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9067MB free_disk=24.995075225830078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:11:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e9c958cd-014c-405d-bf1c-1a44b70a8692 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:11:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:11:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:11:55 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:11:55 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:11:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:11:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:11:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:12:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:01 user nova-compute[75571]: DEBUG nova.compute.manager [req-72dc2f69-770f-4f76-a12d-bc9bbeb11e5a req-657fa74d-88b6-4bf1-a9dd-bc175511f43b service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Received event network-changed-16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:12:01 user nova-compute[75571]: DEBUG nova.compute.manager [req-72dc2f69-770f-4f76-a12d-bc9bbeb11e5a req-657fa74d-88b6-4bf1-a9dd-bc175511f43b service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Refreshing instance network info cache due to event network-changed-16a8d2a2-3dec-4422-b70b-57c5cb01542f. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 21:12:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-72dc2f69-770f-4f76-a12d-bc9bbeb11e5a req-657fa74d-88b6-4bf1-a9dd-bc175511f43b service nova] Acquiring lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:12:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-72dc2f69-770f-4f76-a12d-bc9bbeb11e5a req-657fa74d-88b6-4bf1-a9dd-bc175511f43b service nova] Acquired lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:12:01 user nova-compute[75571]: DEBUG nova.network.neutron [req-72dc2f69-770f-4f76-a12d-bc9bbeb11e5a req-657fa74d-88b6-4bf1-a9dd-bc175511f43b service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Refreshing network info cache for port 16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 21:12:02 user nova-compute[75571]: DEBUG nova.network.neutron [req-72dc2f69-770f-4f76-a12d-bc9bbeb11e5a req-657fa74d-88b6-4bf1-a9dd-bc175511f43b service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updated VIF entry in instance network info cache for port 16a8d2a2-3dec-4422-b70b-57c5cb01542f. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 21:12:02 user nova-compute[75571]: DEBUG nova.network.neutron [req-72dc2f69-770f-4f76-a12d-bc9bbeb11e5a req-657fa74d-88b6-4bf1-a9dd-bc175511f43b service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updating instance_info_cache with network_info: [{"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:12:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-72dc2f69-770f-4f76-a12d-bc9bbeb11e5a req-657fa74d-88b6-4bf1-a9dd-bc175511f43b service nova] Releasing lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:12:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 21:12:09 user nova-compute[75571]: INFO nova.compute.claims [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Claim successful on node user
Nov 28 21:12:09 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 21:12:09 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 21:12:09 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG nova.policy [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 21:12:09 user nova-compute[75571]: INFO nova.virt.block_device [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Booting with volume a7f5b340-dde9-4f11-8bcb-6acd0411e24d at /dev/vda
Nov 28 21:12:09 user nova-compute[75571]: DEBUG os_brick.utils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede9bbce-9cb7-47ee-9a3f-443c95139ebd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b084f575-d86c-48e1-91b2-fc4b16ccecd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d660e6-3460-4172-b538-a7d5aefd6882]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ab9339-c5a4-4b3b-a301-d11fff938c5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:12:09 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 21:12:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9d2189-748a-4965-81c2-a6fb7adc5679]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG os_brick.utils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:12:09 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Updating existing volume attachment record: 3f22131c-3daa-4799-82f5-cfd9e37e1a46 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 21:12:10 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Successfully created port: ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 21:12:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:10 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Successfully updated port: ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 21:12:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "refresh_cache-9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:12:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquired lock "refresh_cache-9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:12:10 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 21:12:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-024251c1-934f-4a29-afb9-bdc5988e1259 req-04d082d2-9d19-4d37-a019-ce6bac945f63 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Received event network-changed-ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:12:10 user nova-compute[75571]: DEBUG nova.compute.manager [req-024251c1-934f-4a29-afb9-bdc5988e1259 req-04d082d2-9d19-4d37-a019-ce6bac945f63 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Refreshing instance network info cache due to event network-changed-ea6d8ee8-7012-4a6f-a443-491accd499f5. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 21:12:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-024251c1-934f-4a29-afb9-bdc5988e1259 req-04d082d2-9d19-4d37-a019-ce6bac945f63 service nova] Acquiring lock "refresh_cache-9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:12:11 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 21:12:11 user nova-compute[75571]: DEBUG nova.network.neutron [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Updating instance_info_cache with network_info: [{"id": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "address": "fa:16:3e:89:4c:7a", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6d8ee8-70", "ovs_interfaceid": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:12:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Releasing lock "refresh_cache-9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:12:11 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Instance network_info: |[{"id": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "address": "fa:16:3e:89:4c:7a", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6d8ee8-70", "ovs_interfaceid": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 21:12:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-024251c1-934f-4a29-afb9-bdc5988e1259 req-04d082d2-9d19-4d37-a019-ce6bac945f63 service nova] Acquired lock "refresh_cache-9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:12:11 user nova-compute[75571]: DEBUG nova.network.neutron [req-024251c1-934f-4a29-afb9-bdc5988e1259 req-04d082d2-9d19-4d37-a019-ce6bac945f63 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Refreshing network info cache for port ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 21:12:11 user nova-compute[75571]: DEBUG nova.network.neutron [req-024251c1-934f-4a29-afb9-bdc5988e1259 req-04d082d2-9d19-4d37-a019-ce6bac945f63 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Updated VIF entry in instance network info cache for port ea6d8ee8-7012-4a6f-a443-491accd499f5. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 21:12:11 user nova-compute[75571]: DEBUG nova.network.neutron [req-024251c1-934f-4a29-afb9-bdc5988e1259 req-04d082d2-9d19-4d37-a019-ce6bac945f63 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Updating instance_info_cache with network_info: [{"id": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "address": "fa:16:3e:89:4c:7a", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6d8ee8-70", "ovs_interfaceid": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:12:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-024251c1-934f-4a29-afb9-bdc5988e1259 req-04d082d2-9d19-4d37-a019-ce6bac945f63 service nova] Releasing lock "refresh_cache-9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:12:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 21:12:16 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Creating image(s)
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Did not create local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Ensure instance console log exists: /opt/stack/data/nova/instances/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Start _get_guest_xml network_info=[{"id": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "address": "fa:16:3e:89:4c:7a", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6d8ee8-70", "ovs_interfaceid": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'juZoTKqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7f5b340-dde9-4f11-8bcb-6acd0411e24d', 'serial': 'a7f5b340-dde9-4f11-8bcb-6acd0411e24d'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '3f22131c-3daa-4799-82f5-cfd9e37e1a46', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 21:12:16 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:12:16 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 21:12:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'juZoTKqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:12:17 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:12:17 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:12:17 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba0f319-ecad-4e70-a937-515f126dd846]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 21:12:17 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d009524f-bb90-4c45-9c33-f29c82a80e48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d] added
Nov 28 21:12:17 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[74117912-b25d-488d-b15e-2467f31c04bc]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d10a84-73aa-491a-995b-567c04104431]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v juZoTKqf {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v juZoTKqf" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c4a72b-5f72-44b0-b2f5-ce5c75135354]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'juZoTKqf'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8700999-8c06-4d83-af50-e4ee0203e12d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d97234-a6d2-428b-92ce-9c76d1f7e45e]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)
Nov 28 21:12:17 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)
Nov 28 21:12:17 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[969899e8-3773-470b-9b00-8e8d98b4e060]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d, portal: 172.16.0.220,3260]
Nov 28 21:12:17 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d, portal: 172.16.0.220,3260] successful.
Nov 28 21:12:17 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9d1d17-7cdf-480d-893e-04d1cd8862ed]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[30898346-ec12-414b-8e13-7556569d38d6]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)
Nov 28 21:12:17 user nova-compute[75571]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d (non-flash)
Nov 28 21:12:17 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)
Nov 28 21:12:17 user nova-compute[75571]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d (non-flash)
Nov 28 21:12:17 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd89f23-1a39-49e1-b237-5a7978e1d7a0]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:12:17 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'juZoTKqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26261383532383132', 'path': '/dev/sdc'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261383532383132', 'path': '/dev/sdc'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1387928385',display_name='tempest-TestVolumeBootPattern-server-1387928385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1387928385',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGBrnh5f2cItdPfJzsexfZNk2hdyXzj152ZtqQ9Dor6rVz8HgZT9NNlrjLjwllNv6HIex4SrodZhI/wURy2F3kX7ieRaGyNBcRFhM7hNUlDgud3W2BORHw9s0Uz7PxaoQ==',key_name='tempest-TestVolumeBootPattern-71941204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-7bntyqut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T21:12:10Z,user_data=None,user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "address": "fa:16:3e:89:4c:7a", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6d8ee8-70", "ovs_interfaceid": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "address": "fa:16:3e:89:4c:7a", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6d8ee8-70", "ovs_interfaceid": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:4c:7a,bridge_name='br-int',has_traffic_filtering=True,id=ea6d8ee8-7012-4a6f-a443-491accd499f5,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea6d8ee8-70') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 21:12:18 user nova-compute[75571]:   <uuid>9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a</uuid>
Nov 28 21:12:18 user nova-compute[75571]:   <name>instance-00000034</name>
Nov 28 21:12:18 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 21:12:18 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 21:12:18 user nova-compute[75571]:   <metadata>
Nov 28 21:12:18 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 21:12:18 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 21:12:18 user nova-compute[75571]:       <nova:name>tempest-TestVolumeBootPattern-server-1387928385</nova:name>
Nov 28 21:12:18 user nova-compute[75571]:       <nova:creationTime>2023-11-28 21:12:16</nova:creationTime>
Nov 28 21:12:18 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 21:12:18 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 21:12:18 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 21:12:18 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 21:12:18 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 21:12:18 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 21:12:18 user nova-compute[75571]:       </nova:flavor>
Nov 28 21:12:18 user nova-compute[75571]:       <nova:owner>
Nov 28 21:12:18 user nova-compute[75571]:         <nova:user uuid="fc8d37446f714002b8c5c4395ab82d58">tempest-TestVolumeBootPattern-845056434-project-member</nova:user>
Nov 28 21:12:18 user nova-compute[75571]:         <nova:project uuid="f852e1ca6d934711942031022097eb36">tempest-TestVolumeBootPattern-845056434</nova:project>
Nov 28 21:12:18 user nova-compute[75571]:       </nova:owner>
Nov 28 21:12:18 user nova-compute[75571]:       <nova:ports>
Nov 28 21:12:18 user nova-compute[75571]:         <nova:port uuid="ea6d8ee8-7012-4a6f-a443-491accd499f5">
Nov 28 21:12:18 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 21:12:18 user nova-compute[75571]:         </nova:port>
Nov 28 21:12:18 user nova-compute[75571]:       </nova:ports>
Nov 28 21:12:18 user nova-compute[75571]:     </nova:instance>
Nov 28 21:12:18 user nova-compute[75571]:   </metadata>
Nov 28 21:12:18 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 21:12:18 user nova-compute[75571]:     <system>
Nov 28 21:12:18 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 21:12:18 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 21:12:18 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 21:12:18 user nova-compute[75571]:       <entry name="serial">9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a</entry>
Nov 28 21:12:18 user nova-compute[75571]:       <entry name="uuid">9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a</entry>
Nov 28 21:12:18 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 21:12:18 user nova-compute[75571]:     </system>
Nov 28 21:12:18 user nova-compute[75571]:   </sysinfo>
Nov 28 21:12:18 user nova-compute[75571]:   <os>
Nov 28 21:12:18 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 21:12:18 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 21:12:18 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 21:12:18 user nova-compute[75571]:   </os>
Nov 28 21:12:18 user nova-compute[75571]:   <features>
Nov 28 21:12:18 user nova-compute[75571]:     <acpi/>
Nov 28 21:12:18 user nova-compute[75571]:     <apic/>
Nov 28 21:12:18 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 21:12:18 user nova-compute[75571]:   </features>
Nov 28 21:12:18 user nova-compute[75571]:   <clock offset="utc">
Nov 28 21:12:18 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 21:12:18 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 21:12:18 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 21:12:18 user nova-compute[75571]:   </clock>
Nov 28 21:12:18 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 21:12:18 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 21:12:18 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 21:12:18 user nova-compute[75571]:   </cpu>
Nov 28 21:12:18 user nova-compute[75571]:   <devices>
Nov 28 21:12:18 user nova-compute[75571]:     <disk type="block" device="disk">
Nov 28 21:12:18 user nova-compute[75571]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:12:18 user nova-compute[75571]:       <source dev="/dev/sdc"/>
Nov 28 21:12:18 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 21:12:18 user nova-compute[75571]:       <serial>a7f5b340-dde9-4f11-8bcb-6acd0411e24d</serial>
Nov 28 21:12:18 user nova-compute[75571]:     </disk>
Nov 28 21:12:18 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 21:12:18 user nova-compute[75571]:       <mac address="fa:16:3e:89:4c:7a"/>
Nov 28 21:12:18 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 21:12:18 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 21:12:18 user nova-compute[75571]:       <target dev="tapea6d8ee8-70"/>
Nov 28 21:12:18 user nova-compute[75571]:     </interface>
Nov 28 21:12:18 user nova-compute[75571]:     <serial type="pty">
Nov 28 21:12:18 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a/console.log" append="off"/>
Nov 28 21:12:18 user nova-compute[75571]:     </serial>
Nov 28 21:12:18 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 21:12:18 user nova-compute[75571]:     <video>
Nov 28 21:12:18 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 21:12:18 user nova-compute[75571]:     </video>
Nov 28 21:12:18 user nova-compute[75571]:     <rng model="virtio">
Nov 28 21:12:18 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 21:12:18 user nova-compute[75571]:     </rng>
Nov 28 21:12:18 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 21:12:18 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 21:12:18 user nova-compute[75571]:       <stats period="10"/>
Nov 28 21:12:18 user nova-compute[75571]:     </memballoon>
Nov 28 21:12:18 user nova-compute[75571]:   </devices>
Nov 28 21:12:18 user nova-compute[75571]: </domain>
Nov 28 21:12:18 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1387928385',display_name='tempest-TestVolumeBootPattern-server-1387928385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1387928385',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGBrnh5f2cItdPfJzsexfZNk2hdyXzj152ZtqQ9Dor6rVz8HgZT9NNlrjLjwllNv6HIex4SrodZhI/wURy2F3kX7ieRaGyNBcRFhM7hNUlDgud3W2BORHw9s0Uz7PxaoQ==',key_name='tempest-TestVolumeBootPattern-71941204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-7bntyqut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T21:12:10Z,user_data=None,user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "address": "fa:16:3e:89:4c:7a", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6d8ee8-70", "ovs_interfaceid": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "address": "fa:16:3e:89:4c:7a", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6d8ee8-70", "ovs_interfaceid": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:4c:7a,bridge_name='br-int',has_traffic_filtering=True,id=ea6d8ee8-7012-4a6f-a443-491accd499f5,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea6d8ee8-70') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG os_vif [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:4c:7a,bridge_name='br-int',has_traffic_filtering=True,id=ea6d8ee8-7012-4a6f-a443-491accd499f5,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea6d8ee8-70') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb0723b1-d2ac-5261-bd6a-48148ce62a56', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea6d8ee8-70, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea6d8ee8-70, col_values=(('qos', UUID('0d89bf83-ae94-4e6b-ae57-a7024dbaf6c4')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea6d8ee8-70, col_values=(('external_ids', {'iface-id': 'ea6d8ee8-7012-4a6f-a443-491accd499f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:4c:7a', 'vm-uuid': '9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:18 user nova-compute[75571]: INFO os_vif [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:4c:7a,bridge_name='br-int',has_traffic_filtering=True,id=ea6d8ee8-7012-4a6f-a443-491accd499f5,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea6d8ee8-70')
Nov 28 21:12:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 21:12:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] No VIF found with MAC fa:16:3e:89:4c:7a, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 21:12:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-b70b1a32-b744-4fe2-97bb-6e1aac650c76 req-33ec5742-8405-4843-ac67-64eaef2b0318 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Received event network-vif-plugged-ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:12:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b70b1a32-b744-4fe2-97bb-6e1aac650c76 req-33ec5742-8405-4843-ac67-64eaef2b0318 service nova] Acquiring lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:12:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b70b1a32-b744-4fe2-97bb-6e1aac650c76 req-33ec5742-8405-4843-ac67-64eaef2b0318 service nova] Lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:12:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-b70b1a32-b744-4fe2-97bb-6e1aac650c76 req-33ec5742-8405-4843-ac67-64eaef2b0318 service nova] Lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:12:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-b70b1a32-b744-4fe2-97bb-6e1aac650c76 req-33ec5742-8405-4843-ac67-64eaef2b0318 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] No waiting events found dispatching network-vif-plugged-ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:12:19 user nova-compute[75571]: WARNING nova.compute.manager [req-b70b1a32-b744-4fe2-97bb-6e1aac650c76 req-33ec5742-8405-4843-ac67-64eaef2b0318 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Received unexpected event network-vif-plugged-ea6d8ee8-7012-4a6f-a443-491accd499f5 for instance with vm_state building and task_state spawning.
Nov 28 21:12:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:21 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 21:12:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 21:12:21 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Instance spawned successfully.
Nov 28 21:12:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 21:12:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:12:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:12:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:12:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:12:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:12:21 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:12:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-24a4b2cd-1b1d-488e-b37d-b04d7f24a9fc req-760dd650-6bac-413f-9287-325f0930db61 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Received event network-vif-plugged-ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:12:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-24a4b2cd-1b1d-488e-b37d-b04d7f24a9fc req-760dd650-6bac-413f-9287-325f0930db61 service nova] Acquiring lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:12:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-24a4b2cd-1b1d-488e-b37d-b04d7f24a9fc req-760dd650-6bac-413f-9287-325f0930db61 service nova] Lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:12:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-24a4b2cd-1b1d-488e-b37d-b04d7f24a9fc req-760dd650-6bac-413f-9287-325f0930db61 service nova] Lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:12:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-24a4b2cd-1b1d-488e-b37d-b04d7f24a9fc req-760dd650-6bac-413f-9287-325f0930db61 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] No waiting events found dispatching network-vif-plugged-ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:12:21 user nova-compute[75571]: WARNING nova.compute.manager [req-24a4b2cd-1b1d-488e-b37d-b04d7f24a9fc req-760dd650-6bac-413f-9287-325f0930db61 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Received unexpected event network-vif-plugged-ea6d8ee8-7012-4a6f-a443-491accd499f5 for instance with vm_state building and task_state spawning.
Nov 28 21:12:22 user nova-compute[75571]: INFO nova.compute.manager [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 28 21:12:22 user nova-compute[75571]: DEBUG nova.compute.manager [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 21:12:22 user nova-compute[75571]: INFO nova.compute.manager [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Took 12.79 seconds to build instance.
Nov 28 21:12:22 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.898s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:12:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:12:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:12:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:36 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:12:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:12:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:12:47 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:12:47 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid e9c958cd-014c-405d-bf1c-1a44b70a8692 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:12:47 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updating instance_info_cache with network_info: [{"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:12:47 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:12:47 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:12:48 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:12:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:12:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:12:50 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:12:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 21:12:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:12:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:12:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8875MB free_disk=24.99323272705078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e9c958cd-014c-405d-bf1c-1a44b70a8692 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing inventories for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating ProviderTree inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing aggregate associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, aggregates: None {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing trait associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:12:55 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:12:56 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:12:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:12:57 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:12:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:12:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:12:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:12:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:12:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:12:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:13:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:13:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:13:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:13:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:08 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:13:08 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75571) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 21:13:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:13:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:13:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:13:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:13:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:13:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:13:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:13:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:13:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:13:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:13:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:13:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:21 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:13:21 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 21:13:21 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] There are 0 instances to clean {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 21:13:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:13:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:13:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:13:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:13:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:38 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:13:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:13:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:13:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:13:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:13:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:46 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:13:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:13:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:13:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:13:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:13:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:13:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:13:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:13:49 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:13:49 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Updating instance_info_cache with network_info: [{"id": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "address": "fa:16:3e:89:4c:7a", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6d8ee8-70", "ovs_interfaceid": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:13:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:13:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:13:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:13:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:13:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:13:50 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:13:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 21:13:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:13:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:13:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8955MB free_disk=24.99267578125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e9c958cd-014c-405d-bf1c-1a44b70a8692 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:13:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:13:57 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:13:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:13:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:13:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:13:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:13:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:13:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:13:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-95c225b5-a5c1-47e3-9267-e3e2b383d18f req-d0ef6602-fb86-4091-ba64-46ad0272eff1 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Received event network-changed-ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:14:00 user nova-compute[75571]: DEBUG nova.compute.manager [req-95c225b5-a5c1-47e3-9267-e3e2b383d18f req-d0ef6602-fb86-4091-ba64-46ad0272eff1 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Refreshing instance network info cache due to event network-changed-ea6d8ee8-7012-4a6f-a443-491accd499f5. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 21:14:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-95c225b5-a5c1-47e3-9267-e3e2b383d18f req-d0ef6602-fb86-4091-ba64-46ad0272eff1 service nova] Acquiring lock "refresh_cache-9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:14:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-95c225b5-a5c1-47e3-9267-e3e2b383d18f req-d0ef6602-fb86-4091-ba64-46ad0272eff1 service nova] Acquired lock "refresh_cache-9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:14:00 user nova-compute[75571]: DEBUG nova.network.neutron [req-95c225b5-a5c1-47e3-9267-e3e2b383d18f req-d0ef6602-fb86-4091-ba64-46ad0272eff1 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Refreshing network info cache for port ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 21:14:01 user nova-compute[75571]: DEBUG nova.network.neutron [req-95c225b5-a5c1-47e3-9267-e3e2b383d18f req-d0ef6602-fb86-4091-ba64-46ad0272eff1 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Updated VIF entry in instance network info cache for port ea6d8ee8-7012-4a6f-a443-491accd499f5. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 21:14:01 user nova-compute[75571]: DEBUG nova.network.neutron [req-95c225b5-a5c1-47e3-9267-e3e2b383d18f req-d0ef6602-fb86-4091-ba64-46ad0272eff1 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Updating instance_info_cache with network_info: [{"id": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "address": "fa:16:3e:89:4c:7a", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6d8ee8-70", "ovs_interfaceid": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:14:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-95c225b5-a5c1-47e3-9267-e3e2b383d18f req-d0ef6602-fb86-4091-ba64-46ad0272eff1 service nova] Releasing lock "refresh_cache-9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:14:02 user nova-compute[75571]: INFO nova.compute.manager [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Terminating instance
Nov 28 21:14:02 user nova-compute[75571]: DEBUG nova.compute.manager [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 21:14:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-f857c217-07b2-40bc-9472-98615a410063 req-aa4328a6-e3b7-4c7d-a598-9229bc759f2c service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Received event network-changed-ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:14:02 user nova-compute[75571]: DEBUG nova.compute.manager [req-f857c217-07b2-40bc-9472-98615a410063 req-aa4328a6-e3b7-4c7d-a598-9229bc759f2c service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Refreshing instance network info cache due to event network-changed-ea6d8ee8-7012-4a6f-a443-491accd499f5. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 21:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f857c217-07b2-40bc-9472-98615a410063 req-aa4328a6-e3b7-4c7d-a598-9229bc759f2c service nova] Acquiring lock "refresh_cache-9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:14:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f857c217-07b2-40bc-9472-98615a410063 req-aa4328a6-e3b7-4c7d-a598-9229bc759f2c service nova] Acquired lock "refresh_cache-9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:14:02 user nova-compute[75571]: DEBUG nova.network.neutron [req-f857c217-07b2-40bc-9472-98615a410063 req-aa4328a6-e3b7-4c7d-a598-9229bc759f2c service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Refreshing network info cache for port ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 21:14:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG nova.network.neutron [req-f857c217-07b2-40bc-9472-98615a410063 req-aa4328a6-e3b7-4c7d-a598-9229bc759f2c service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Updated VIF entry in instance network info cache for port ea6d8ee8-7012-4a6f-a443-491accd499f5. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG nova.network.neutron [req-f857c217-07b2-40bc-9472-98615a410063 req-aa4328a6-e3b7-4c7d-a598-9229bc759f2c service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Updating instance_info_cache with network_info: [{"id": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "address": "fa:16:3e:89:4c:7a", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6d8ee8-70", "ovs_interfaceid": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-f857c217-07b2-40bc-9472-98615a410063 req-aa4328a6-e3b7-4c7d-a598-9229bc759f2c service nova] Releasing lock "refresh_cache-9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:14:03 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Instance destroyed successfully.
Nov 28 21:14:03 user nova-compute[75571]: DEBUG nova.objects.instance [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lazy-loading 'resources' on Instance uuid 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1387928385',display_name='tempest-TestVolumeBootPattern-server-1387928385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1387928385',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGBrnh5f2cItdPfJzsexfZNk2hdyXzj152ZtqQ9Dor6rVz8HgZT9NNlrjLjwllNv6HIex4SrodZhI/wURy2F3kX7ieRaGyNBcRFhM7hNUlDgud3W2BORHw9s0Uz7PxaoQ==',key_name='tempest-TestVolumeBootPattern-71941204',keypairs=<?>,launch_index=0,launched_at=2023-11-28T21:12:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-7bntyqut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T21:12:22Z,user_data=None,user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "address": "fa:16:3e:89:4c:7a", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6d8ee8-70", "ovs_interfaceid": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "address": "fa:16:3e:89:4c:7a", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6d8ee8-70", "ovs_interfaceid": "ea6d8ee8-7012-4a6f-a443-491accd499f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:4c:7a,bridge_name='br-int',has_traffic_filtering=True,id=ea6d8ee8-7012-4a6f-a443-491accd499f5,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea6d8ee8-70') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_vif [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:4c:7a,bridge_name='br-int',has_traffic_filtering=True,id=ea6d8ee8-7012-4a6f-a443-491accd499f5,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea6d8ee8-70') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea6d8ee8-70, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d89bf83-ae94-4e6b-ae57-a7024dbaf6c4) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:14:03 user nova-compute[75571]: INFO os_vif [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:4c:7a,bridge_name='br-int',has_traffic_filtering=True,id=ea6d8ee8-7012-4a6f-a443-491accd499f5,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea6d8ee8-70')
Nov 28 21:14:03 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'juZoTKqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:14:03 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4db0eab-ae4d-447e-a15f-50982262a896]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 21:14:03 user nova-compute[75571]: No targets found.
Nov 28 21:14:03 user nova-compute[75571]: iSNS:
Nov 28 21:14:03 user nova-compute[75571]: No targets found.
Nov 28 21:14:03 user nova-compute[75571]: STATIC:
Nov 28 21:14:03 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d
Nov 28 21:14:03 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 21:14:03 user nova-compute[75571]:                 Iface Name: default
Nov 28 21:14:03 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5
Nov 28 21:14:03 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 21:14:03 user nova-compute[75571]:                 Iface Name: default
Nov 28 21:14:03 user nova-compute[75571]: FIRMWARE:
Nov 28 21:14:03 user nova-compute[75571]: No targets found.
Nov 28 21:14:03 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 21:14:03 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 21:14:03 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7912790f-4dad-4e7e-8eaa-c2ce808b4af4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd77c08-5912-492d-8897-59b5b6f25cc3]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)
Nov 28 21:14:03 user nova-compute[75571]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d (non-flash)
Nov 28 21:14:03 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)
Nov 28 21:14:03 user nova-compute[75571]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d (non-flash)
Nov 28 21:14:03 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768752f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d'): ({'sdc'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Removing single pathed devices sdc {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[925a980f-a586-44f4-831f-1ca6657c9ca3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[256805c6-3fb5-426c-976f-cb57190906cf]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flushing IO for device /dev/sdc {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[945b5752-a7c2-4f72-9d27-e5795cbec473]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d534b8f4-4868-40c0-abdb-3cb669148d9c]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] SCSI volumes sdc have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26261383532383132', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_40b45ece', '/dev/disk/by-id/scsi-1SCST_BIO40b45ece-ba8528127072c4aa') {{(pid=86013) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f926d7-85b9-42ad-ac54-67c74669747b]: (4, None) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10558c5-1a12-4f57-a6af-6fa0c52b65b3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4797b6fe-a15d-4f0f-9e17-7c751c9eb22e]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d, portal: 172.16.0.220,3260]
Nov 28 21:14:03 user nova-compute[75571]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d, portal: 172.16.0.220,3260] successful.
Nov 28 21:14:03 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:14:03 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f5b340-dde9-4f11-8bcb-6acd0411e24d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17c31d1-682e-430b-b913-f7b5aa1d507c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== disconnect_volume: return (312ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 21:14:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Deleting instance files /opt/stack/data/nova/instances/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a_del
Nov 28 21:14:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Deletion of /opt/stack/data/nova/instances/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a_del complete
Nov 28 21:14:04 user nova-compute[75571]: INFO nova.compute.manager [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 28 21:14:04 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:14:04 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Took 0.37 seconds to deallocate network for instance.
Nov 28 21:14:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Received event network-vif-unplugged-ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] Acquiring lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] Lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] Lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] No waiting events found dispatching network-vif-unplugged-ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Received event network-vif-unplugged-ea6d8ee8-7012-4a6f-a443-491accd499f5 for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Received event network-vif-plugged-ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:14:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] Acquiring lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] Lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] Lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:14:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] No waiting events found dispatching network-vif-plugged-ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:14:05 user nova-compute[75571]: WARNING nova.compute.manager [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Received unexpected event network-vif-plugged-ea6d8ee8-7012-4a6f-a443-491accd499f5 for instance with vm_state active and task_state deleting.
Nov 28 21:14:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Received event network-vif-deleted-ea6d8ee8-7012-4a6f-a443-491accd499f5 {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:14:05 user nova-compute[75571]: INFO nova.compute.manager [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Took 0.75 seconds to detach 1 volumes for instance.
Nov 28 21:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:14:05 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:14:05 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:14:05 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Deleted allocations for instance 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a
Nov 28 21:14:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.590s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:14:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:08 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:13 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:18 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:14:21 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:14:23 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:14:28 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:14:33 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:38 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:40 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:14:43 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:14:47 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:14:48 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:14:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:14:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:14:49 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:14:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:14:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:14:49 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:14:49 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid e9c958cd-014c-405d-bf1c-1a44b70a8692 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:14:50 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updating instance_info_cache with network_info: [{"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:14:50 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:14:50 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:14:50 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:14:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:14:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:14:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:14:53 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:14:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:14:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:14:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:14:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:14:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:14:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75571) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 21:14:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:14:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:14:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9011MB free_disk=24.99178695678711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:14:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:14:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:14:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance e9c958cd-014c-405d-bf1c-1a44b70a8692 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:14:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:14:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:14:55 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:14:55 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:14:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:14:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:14:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:14:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:14:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-fe6323cc-490a-4e47-893b-38552097e125 req-c3ecfa2a-d81a-4d6e-8d45-9b698f468efc service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Received event network-changed-16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG nova.compute.manager [req-fe6323cc-490a-4e47-893b-38552097e125 req-c3ecfa2a-d81a-4d6e-8d45-9b698f468efc service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Refreshing instance network info cache due to event network-changed-16a8d2a2-3dec-4422-b70b-57c5cb01542f. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fe6323cc-490a-4e47-893b-38552097e125 req-c3ecfa2a-d81a-4d6e-8d45-9b698f468efc service nova] Acquiring lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fe6323cc-490a-4e47-893b-38552097e125 req-c3ecfa2a-d81a-4d6e-8d45-9b698f468efc service nova] Acquired lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG nova.network.neutron [req-fe6323cc-490a-4e47-893b-38552097e125 req-c3ecfa2a-d81a-4d6e-8d45-9b698f468efc service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Refreshing network info cache for port 16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "e9c958cd-014c-405d-bf1c-1a44b70a8692" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "e9c958cd-014c-405d-bf1c-1a44b70a8692" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "e9c958cd-014c-405d-bf1c-1a44b70a8692-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "e9c958cd-014c-405d-bf1c-1a44b70a8692-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "e9c958cd-014c-405d-bf1c-1a44b70a8692-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:15:03 user nova-compute[75571]: INFO nova.compute.manager [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Terminating instance
Nov 28 21:15:03 user nova-compute[75571]: DEBUG nova.compute.manager [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-c7caaa0b-ab1f-44b7-bbcb-db1c72291438 req-dafb07c6-f9a6-43d7-aee4-74c2849a6bcc service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Received event network-vif-unplugged-16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c7caaa0b-ab1f-44b7-bbcb-db1c72291438 req-dafb07c6-f9a6-43d7-aee4-74c2849a6bcc service nova] Acquiring lock "e9c958cd-014c-405d-bf1c-1a44b70a8692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c7caaa0b-ab1f-44b7-bbcb-db1c72291438 req-dafb07c6-f9a6-43d7-aee4-74c2849a6bcc service nova] Lock "e9c958cd-014c-405d-bf1c-1a44b70a8692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-c7caaa0b-ab1f-44b7-bbcb-db1c72291438 req-dafb07c6-f9a6-43d7-aee4-74c2849a6bcc service nova] Lock "e9c958cd-014c-405d-bf1c-1a44b70a8692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-c7caaa0b-ab1f-44b7-bbcb-db1c72291438 req-dafb07c6-f9a6-43d7-aee4-74c2849a6bcc service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] No waiting events found dispatching network-vif-unplugged-16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-c7caaa0b-ab1f-44b7-bbcb-db1c72291438 req-dafb07c6-f9a6-43d7-aee4-74c2849a6bcc service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Received event network-vif-unplugged-16a8d2a2-3dec-4422-b70b-57c5cb01542f for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG nova.network.neutron [req-fe6323cc-490a-4e47-893b-38552097e125 req-c3ecfa2a-d81a-4d6e-8d45-9b698f468efc service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updated VIF entry in instance network info cache for port 16a8d2a2-3dec-4422-b70b-57c5cb01542f. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG nova.network.neutron [req-fe6323cc-490a-4e47-893b-38552097e125 req-c3ecfa2a-d81a-4d6e-8d45-9b698f468efc service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updating instance_info_cache with network_info: [{"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-fe6323cc-490a-4e47-893b-38552097e125 req-c3ecfa2a-d81a-4d6e-8d45-9b698f468efc service nova] Releasing lock "refresh_cache-e9c958cd-014c-405d-bf1c-1a44b70a8692" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Instance destroyed successfully.
Nov 28 21:15:04 user nova-compute[75571]: DEBUG nova.objects.instance [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lazy-loading 'resources' on Instance uuid e9c958cd-014c-405d-bf1c-1a44b70a8692 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-30267068',display_name='tempest-TestVolumeBootPattern-server-30267068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-30267068',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGBrnh5f2cItdPfJzsexfZNk2hdyXzj152ZtqQ9Dor6rVz8HgZT9NNlrjLjwllNv6HIex4SrodZhI/wURy2F3kX7ieRaGyNBcRFhM7hNUlDgud3W2BORHw9s0Uz7PxaoQ==',key_name='tempest-TestVolumeBootPattern-71941204',keypairs=<?>,launch_index=0,launched_at=2023-11-28T21:10:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f852e1ca6d934711942031022097eb36',ramdisk_id='',reservation_id='r-xwsbxs4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-845056434',owner_user_name='tempest-TestVolumeBootPattern-845056434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T21:10:22Z,user_data=None,user_id='fc8d37446f714002b8c5c4395ab82d58',uuid=e9c958cd-014c-405d-bf1c-1a44b70a8692,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converting VIF {"id": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "address": "fa:16:3e:4d:a8:33", "network": {"id": "6aea05c0-0b8e-4107-98d9-b57f711770c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324564893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f852e1ca6d934711942031022097eb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a8d2a2-3d", "ovs_interfaceid": "16a8d2a2-3dec-4422-b70b-57c5cb01542f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:a8:33,bridge_name='br-int',has_traffic_filtering=True,id=16a8d2a2-3dec-4422-b70b-57c5cb01542f,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a8d2a2-3d') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_vif [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:a8:33,bridge_name='br-int',has_traffic_filtering=True,id=16a8d2a2-3dec-4422-b70b-57c5cb01542f,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a8d2a2-3d') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16a8d2a2-3d, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5aa5d8cc-393d-4236-a6d5-77a305756b0d) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:15:04 user nova-compute[75571]: INFO os_vif [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:a8:33,bridge_name='br-int',has_traffic_filtering=True,id=16a8d2a2-3dec-4422-b70b-57c5cb01542f,network=Network(6aea05c0-0b8e-4107-98d9-b57f711770c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a8d2a2-3d')
Nov 28 21:15:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCGhbmQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:15:04 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[05608d95-e6ca-4f3c-aa49-f6f035e3572f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 21:15:04 user nova-compute[75571]: No targets found.
Nov 28 21:15:04 user nova-compute[75571]: iSNS:
Nov 28 21:15:04 user nova-compute[75571]: No targets found.
Nov 28 21:15:04 user nova-compute[75571]: STATIC:
Nov 28 21:15:04 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5
Nov 28 21:15:04 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 21:15:04 user nova-compute[75571]:                 Iface Name: default
Nov 28 21:15:04 user nova-compute[75571]: FIRMWARE:
Nov 28 21:15:04 user nova-compute[75571]: No targets found.
Nov 28 21:15:04 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 21:15:04 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 21:15:04 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d29a71a-cb8a-4dc3-b28a-592fa7dbb8df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5eff87-7b67-4ad4-a649-e6afaa8f9ba9]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)
Nov 28 21:15:04 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 (non-flash)
Nov 28 21:15:04 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7748681750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[891f9db8-247e-4cce-a17c-7cf90c662536]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd06a05-c536-46d2-a470-8c62d5b89e6f]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c27142-387d-4ba5-922e-3fe913a168ff]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc66891-d0f4-4a0b-99cf-dcf1e5b01b36]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOcffec7d3-b17e1a095f19ba3a', '/dev/disk/by-id/scsi-26231376531613039') {{(pid=86013) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 21:15:04 user nova-compute[75571]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOcffec7d3-b17e1a095f19ba3a
Nov 28 21:15:04 user nova-compute[75571]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26231376531613039
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae86a5e-2153-42d1-8aaa-e4956a77485a]: (4, None) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e1f47d-2ccd-417e-8b36-80d90e854839]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc265f7-a077-4d6b-bcc2-f705a0b7c996]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260]
Nov 28 21:15:04 user nova-compute[75571]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5, portal: 172.16.0.220,3260] successful.
Nov 28 21:15:04 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4f5dc5-5562-460c-8eb3-3189116a21d8]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] <== disconnect_volume: return (305ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:15:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 21:15:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Deleting instance files /opt/stack/data/nova/instances/e9c958cd-014c-405d-bf1c-1a44b70a8692_del
Nov 28 21:15:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Deletion of /opt/stack/data/nova/instances/e9c958cd-014c-405d-bf1c-1a44b70a8692_del complete
Nov 28 21:15:05 user nova-compute[75571]: INFO nova.compute.manager [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 28 21:15:05 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 21:15:05 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 21:15:05 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 21:15:05 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:15:05 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Took 0.66 seconds to deallocate network for instance.
Nov 28 21:15:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-af986c04-6fcd-4aaf-ac61-b9b5ab5cb263 req-b3fc9aa3-5527-4032-8d85-4fbac0a562db service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Received event network-vif-deleted-16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:15:05 user nova-compute[75571]: INFO nova.compute.manager [req-af986c04-6fcd-4aaf-ac61-b9b5ab5cb263 req-b3fc9aa3-5527-4032-8d85-4fbac0a562db service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Neutron deleted interface 16a8d2a2-3dec-4422-b70b-57c5cb01542f; detaching it from the instance and deleting it from the info cache
Nov 28 21:15:05 user nova-compute[75571]: DEBUG nova.network.neutron [req-af986c04-6fcd-4aaf-ac61-b9b5ab5cb263 req-b3fc9aa3-5527-4032-8d85-4fbac0a562db service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:15:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-af986c04-6fcd-4aaf-ac61-b9b5ab5cb263 req-b3fc9aa3-5527-4032-8d85-4fbac0a562db service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Detach interface failed, port_id=16a8d2a2-3dec-4422-b70b-57c5cb01542f, reason: Instance e9c958cd-014c-405d-bf1c-1a44b70a8692 could not be found. {{(pid=75571) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 21:15:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-354c8641-6951-47c8-ac08-44ab360836b8 req-67ab482c-cad3-436f-8632-7daaad9f103c service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Received event network-vif-plugged-16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-354c8641-6951-47c8-ac08-44ab360836b8 req-67ab482c-cad3-436f-8632-7daaad9f103c service nova] Acquiring lock "e9c958cd-014c-405d-bf1c-1a44b70a8692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-354c8641-6951-47c8-ac08-44ab360836b8 req-67ab482c-cad3-436f-8632-7daaad9f103c service nova] Lock "e9c958cd-014c-405d-bf1c-1a44b70a8692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-354c8641-6951-47c8-ac08-44ab360836b8 req-67ab482c-cad3-436f-8632-7daaad9f103c service nova] Lock "e9c958cd-014c-405d-bf1c-1a44b70a8692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:15:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-354c8641-6951-47c8-ac08-44ab360836b8 req-67ab482c-cad3-436f-8632-7daaad9f103c service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] No waiting events found dispatching network-vif-plugged-16a8d2a2-3dec-4422-b70b-57c5cb01542f {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:15:06 user nova-compute[75571]: WARNING nova.compute.manager [req-354c8641-6951-47c8-ac08-44ab360836b8 req-67ab482c-cad3-436f-8632-7daaad9f103c service nova] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Received unexpected event network-vif-plugged-16a8d2a2-3dec-4422-b70b-57c5cb01542f for instance with vm_state active and task_state deleting.
Nov 28 21:15:06 user nova-compute[75571]: INFO nova.compute.manager [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Took 0.72 seconds to detach 1 volumes for instance.
Nov 28 21:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:15:06 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:15:06 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:15:06 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Deleted allocations for instance e9c958cd-014c-405d-bf1c-1a44b70a8692
Nov 28 21:15:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "e9c958cd-014c-405d-bf1c-1a44b70a8692" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.858s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:15:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:15:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:15:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:15:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:15:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:15:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:15:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:15:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:15:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:15:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:15:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:15:40 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:15:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:15:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:15:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:15:50 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:15:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:15:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:15:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:15:51 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 21:15:52 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:15:53 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:15:53 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:15:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:15:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:15:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:15:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:15:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:15:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:15:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:15:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:15:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9177MB free_disk=24.990882873535156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:15:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:15:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:15:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:15:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:15:55 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:15:55 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:15:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:15:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:15:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:16:00 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:16:00 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:16:01 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:16:03 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:16:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:16:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:16:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:16:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:16:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:16:24 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:16:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:16:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:16:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:16:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:16:40 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:16:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:16:49 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:16:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:16:52 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:16:52 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:16:53 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:16:53 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:16:53 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:16:53 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 21:16:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:16:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:16:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:16:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:16:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:16:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:16:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:16:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:16:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:16:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:16:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=24.987506866455078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:16:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:16:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:16:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:16:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:16:55 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:16:55 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:16:55 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:16:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:16:58 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:16:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:17:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:17:02 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:07 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:17:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:17:16 user nova-compute[75571]: DEBUG nova.compute.manager [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Starting instance... {{(pid=75571) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 21:17:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:17:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:17:16 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75571) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 21:17:16 user nova-compute[75571]: INFO nova.compute.claims [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Claim successful on node user
Nov 28 21:17:17 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Start building networks asynchronously for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Allocating IP information in the background. {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG nova.network.neutron [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] allocate_for_instance() {{(pid=75571) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 21:17:17 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 21:17:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Start building block device mappings for instance. {{(pid=75571) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG nova.policy [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a163fe0b8a7448dcb8363c1e3007bcc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795b060e4d314d049bb9e866e46f6463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75571) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG nova.compute.manager [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Start spawning the instance on the hypervisor. {{(pid=75571) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Creating instance directory {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 21:17:17 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Creating image(s)
Nov 28 21:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "/opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "/opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.230s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.209s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:17:17 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk 1073741824 {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:17:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b,backing_fmt=raw /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk 1073741824" returned: 0 in 0.056s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:17:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "bec346222d5c9f56f90d540a5e4b53c2c475728b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:17:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:17:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec346222d5c9f56f90d540a5e4b53c2c475728b --force-share --output=json" returned: 0 in 0.209s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:17:18 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk. size=1073741824 {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 21:17:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:17:18 user nova-compute[75571]: DEBUG nova.network.neutron [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Successfully created port: cf1ee27c-ff8b-4fed-ad86-d44710b3276b {{(pid=75571) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 21:17:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:17:18 user nova-compute[75571]: DEBUG nova.virt.disk.api [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Cannot resize image /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk to a smaller size. {{(pid=75571) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 21:17:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Created local disks {{(pid=75571) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 21:17:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Ensure instance console log exists: /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/console.log {{(pid=75571) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 21:17:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:17:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:17:18 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.network.neutron [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Successfully updated port: cf1ee27c-ff8b-4fed-ad86-d44710b3276b {{(pid=75571) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquired lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.network.neutron [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Building network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.network.neutron [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Instance cache missing network info. {{(pid=75571) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-035f30c7-5ad5-4a74-acec-7871c01d2150 req-1dd6542d-ddb0-45e9-a04c-6ef600bdcd8c service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Received event network-changed-cf1ee27c-ff8b-4fed-ad86-d44710b3276b {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.compute.manager [req-035f30c7-5ad5-4a74-acec-7871c01d2150 req-1dd6542d-ddb0-45e9-a04c-6ef600bdcd8c service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Refreshing instance network info cache due to event network-changed-cf1ee27c-ff8b-4fed-ad86-d44710b3276b. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-035f30c7-5ad5-4a74-acec-7871c01d2150 req-1dd6542d-ddb0-45e9-a04c-6ef600bdcd8c service nova] Acquiring lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.network.neutron [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updating instance_info_cache with network_info: [{"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Releasing lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.compute.manager [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Instance network_info: |[{"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75571) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-035f30c7-5ad5-4a74-acec-7871c01d2150 req-1dd6542d-ddb0-45e9-a04c-6ef600bdcd8c service nova] Acquired lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.network.neutron [req-035f30c7-5ad5-4a74-acec-7871c01d2150 req-1dd6542d-ddb0-45e9-a04c-6ef600bdcd8c service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Refreshing network info cache for port cf1ee27c-ff8b-4fed-ad86-d44710b3276b {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Start _get_guest_xml network_info=[{"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '77b9e284-7155-4207-b748-934c25ce18d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 21:17:19 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:17:19 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] CPU controller missing on host. {{(pid=75571) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.host [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] CPU controller found on host. {{(pid=75571) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75571) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T20:07:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T20:07:16Z,direct_url=<?>,disk_format='qcow2',id=77b9e284-7155-4207-b748-934c25ce18d0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a3f68630a9a04ebebd5c4eab29a79ef0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T20:07:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Flavor limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Image limits 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Flavor pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Image pref 0:0:0 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Got 1 possible topologies {{(pid=75571) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75571) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1296229397',display_name='tempest-SnapshotDataIntegrityTests-server-1296229397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1296229397',id=53,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr3/3kAGY1yrJtzwxQ2Urupv8grxWxfpF/u1TFQl48WzhWIUqRWrpW/nMgs4CzaDQ6Au+Vx71XALuNpL3LjLE6HldOZAgZsDPEKI7G/Aa9olUjPEwHARJQi/b9eCJzdcw==',key_name='tempest-keypair-1913966301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='795b060e4d314d049bb9e866e46f6463',ramdisk_id='',reservation_id='r-kbm0wxti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1384736641',owner_user_name='tempest-SnapshotDataIntegrityTests-1384736641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T21:17:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a163fe0b8a7448dcb8363c1e3007bcc3',uuid=d3df0d93-3eb0-4397-b64f-2e6ba95313b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75571) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Converting VIF {"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=cf1ee27c-ff8b-4fed-ad86-d44710b3276b,network=Network(058ee94c-09e6-41aa-ae25-ae736bac9074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1ee27c-ff') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.objects.instance [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'pci_devices' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 21:17:19 user nova-compute[75571]:   <uuid>d3df0d93-3eb0-4397-b64f-2e6ba95313b4</uuid>
Nov 28 21:17:19 user nova-compute[75571]:   <name>instance-00000035</name>
Nov 28 21:17:19 user nova-compute[75571]:   <memory>524288</memory>
Nov 28 21:17:19 user nova-compute[75571]:   <vcpu>1</vcpu>
Nov 28 21:17:19 user nova-compute[75571]:   <metadata>
Nov 28 21:17:19 user nova-compute[75571]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 21:17:19 user nova-compute[75571]:       <nova:package version="0.0.0"/>
Nov 28 21:17:19 user nova-compute[75571]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1296229397</nova:name>
Nov 28 21:17:19 user nova-compute[75571]:       <nova:creationTime>2023-11-28 21:17:19</nova:creationTime>
Nov 28 21:17:19 user nova-compute[75571]:       <nova:flavor name="m1.tiny">
Nov 28 21:17:19 user nova-compute[75571]:         <nova:memory>512</nova:memory>
Nov 28 21:17:19 user nova-compute[75571]:         <nova:disk>1</nova:disk>
Nov 28 21:17:19 user nova-compute[75571]:         <nova:swap>0</nova:swap>
Nov 28 21:17:19 user nova-compute[75571]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 21:17:19 user nova-compute[75571]:         <nova:vcpus>1</nova:vcpus>
Nov 28 21:17:19 user nova-compute[75571]:       </nova:flavor>
Nov 28 21:17:19 user nova-compute[75571]:       <nova:owner>
Nov 28 21:17:19 user nova-compute[75571]:         <nova:user uuid="a163fe0b8a7448dcb8363c1e3007bcc3">tempest-SnapshotDataIntegrityTests-1384736641-project-member</nova:user>
Nov 28 21:17:19 user nova-compute[75571]:         <nova:project uuid="795b060e4d314d049bb9e866e46f6463">tempest-SnapshotDataIntegrityTests-1384736641</nova:project>
Nov 28 21:17:19 user nova-compute[75571]:       </nova:owner>
Nov 28 21:17:19 user nova-compute[75571]:       <nova:root type="image" uuid="77b9e284-7155-4207-b748-934c25ce18d0"/>
Nov 28 21:17:19 user nova-compute[75571]:       <nova:ports>
Nov 28 21:17:19 user nova-compute[75571]:         <nova:port uuid="cf1ee27c-ff8b-4fed-ad86-d44710b3276b">
Nov 28 21:17:19 user nova-compute[75571]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 21:17:19 user nova-compute[75571]:         </nova:port>
Nov 28 21:17:19 user nova-compute[75571]:       </nova:ports>
Nov 28 21:17:19 user nova-compute[75571]:     </nova:instance>
Nov 28 21:17:19 user nova-compute[75571]:   </metadata>
Nov 28 21:17:19 user nova-compute[75571]:   <sysinfo type="smbios">
Nov 28 21:17:19 user nova-compute[75571]:     <system>
Nov 28 21:17:19 user nova-compute[75571]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 21:17:19 user nova-compute[75571]:       <entry name="product">OpenStack Nova</entry>
Nov 28 21:17:19 user nova-compute[75571]:       <entry name="version">0.0.0</entry>
Nov 28 21:17:19 user nova-compute[75571]:       <entry name="serial">d3df0d93-3eb0-4397-b64f-2e6ba95313b4</entry>
Nov 28 21:17:19 user nova-compute[75571]:       <entry name="uuid">d3df0d93-3eb0-4397-b64f-2e6ba95313b4</entry>
Nov 28 21:17:19 user nova-compute[75571]:       <entry name="family">Virtual Machine</entry>
Nov 28 21:17:19 user nova-compute[75571]:     </system>
Nov 28 21:17:19 user nova-compute[75571]:   </sysinfo>
Nov 28 21:17:19 user nova-compute[75571]:   <os>
Nov 28 21:17:19 user nova-compute[75571]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 21:17:19 user nova-compute[75571]:     <boot dev="hd"/>
Nov 28 21:17:19 user nova-compute[75571]:     <smbios mode="sysinfo"/>
Nov 28 21:17:19 user nova-compute[75571]:   </os>
Nov 28 21:17:19 user nova-compute[75571]:   <features>
Nov 28 21:17:19 user nova-compute[75571]:     <acpi/>
Nov 28 21:17:19 user nova-compute[75571]:     <apic/>
Nov 28 21:17:19 user nova-compute[75571]:     <vmcoreinfo/>
Nov 28 21:17:19 user nova-compute[75571]:   </features>
Nov 28 21:17:19 user nova-compute[75571]:   <clock offset="utc">
Nov 28 21:17:19 user nova-compute[75571]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 21:17:19 user nova-compute[75571]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 21:17:19 user nova-compute[75571]:     <timer name="hpet" present="no"/>
Nov 28 21:17:19 user nova-compute[75571]:   </clock>
Nov 28 21:17:19 user nova-compute[75571]:   <cpu mode="custom" match="exact">
Nov 28 21:17:19 user nova-compute[75571]:     <model>Nehalem</model>
Nov 28 21:17:19 user nova-compute[75571]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 21:17:19 user nova-compute[75571]:   </cpu>
Nov 28 21:17:19 user nova-compute[75571]:   <devices>
Nov 28 21:17:19 user nova-compute[75571]:     <disk type="file" device="disk">
Nov 28 21:17:19 user nova-compute[75571]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 21:17:19 user nova-compute[75571]:       <source file="/opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk"/>
Nov 28 21:17:19 user nova-compute[75571]:       <target dev="vda" bus="virtio"/>
Nov 28 21:17:19 user nova-compute[75571]:     </disk>
Nov 28 21:17:19 user nova-compute[75571]:     <interface type="ethernet">
Nov 28 21:17:19 user nova-compute[75571]:       <mac address="fa:16:3e:ba:0f:94"/>
Nov 28 21:17:19 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 21:17:19 user nova-compute[75571]:       <mtu size="1442"/>
Nov 28 21:17:19 user nova-compute[75571]:       <target dev="tapcf1ee27c-ff"/>
Nov 28 21:17:19 user nova-compute[75571]:     </interface>
Nov 28 21:17:19 user nova-compute[75571]:     <serial type="pty">
Nov 28 21:17:19 user nova-compute[75571]:       <log file="/opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/console.log" append="off"/>
Nov 28 21:17:19 user nova-compute[75571]:     </serial>
Nov 28 21:17:19 user nova-compute[75571]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 21:17:19 user nova-compute[75571]:     <video>
Nov 28 21:17:19 user nova-compute[75571]:       <model type="virtio"/>
Nov 28 21:17:19 user nova-compute[75571]:     </video>
Nov 28 21:17:19 user nova-compute[75571]:     <rng model="virtio">
Nov 28 21:17:19 user nova-compute[75571]:       <backend model="random">/dev/urandom</backend>
Nov 28 21:17:19 user nova-compute[75571]:     </rng>
Nov 28 21:17:19 user nova-compute[75571]:     <controller type="usb" index="0" model="none"/>
Nov 28 21:17:19 user nova-compute[75571]:     <memballoon model="virtio">
Nov 28 21:17:19 user nova-compute[75571]:       <stats period="10"/>
Nov 28 21:17:19 user nova-compute[75571]:     </memballoon>
Nov 28 21:17:19 user nova-compute[75571]:   </devices>
Nov 28 21:17:19 user nova-compute[75571]: </domain>
Nov 28 21:17:19 user nova-compute[75571]:  {{(pid=75571) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1296229397',display_name='tempest-SnapshotDataIntegrityTests-server-1296229397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1296229397',id=53,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr3/3kAGY1yrJtzwxQ2Urupv8grxWxfpF/u1TFQl48WzhWIUqRWrpW/nMgs4CzaDQ6Au+Vx71XALuNpL3LjLE6HldOZAgZsDPEKI7G/Aa9olUjPEwHARJQi/b9eCJzdcw==',key_name='tempest-keypair-1913966301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='795b060e4d314d049bb9e866e46f6463',ramdisk_id='',reservation_id='r-kbm0wxti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1384736641',owner_user_name='tempest-SnapshotDataIntegrityTests-1384736641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T21:17:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a163fe0b8a7448dcb8363c1e3007bcc3',uuid=d3df0d93-3eb0-4397-b64f-2e6ba95313b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Converting VIF {"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=cf1ee27c-ff8b-4fed-ad86-d44710b3276b,network=Network(058ee94c-09e6-41aa-ae25-ae736bac9074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1ee27c-ff') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG os_vif [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=cf1ee27c-ff8b-4fed-ad86-d44710b3276b,network=Network(058ee94c-09e6-41aa-ae25-ae736bac9074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1ee27c-ff') {{(pid=75571) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4003893a-e892-5329-aea1-c337bd3f32a9', '_type': 'linux-noop'}}, row=False) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf1ee27c-ff, may_exist=True, interface_attrs={}) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf1ee27c-ff, col_values=(('qos', UUID('19416a98-7857-4e2d-8863-7638340b13ec')),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf1ee27c-ff, col_values=(('external_ids', {'iface-id': 'cf1ee27c-ff8b-4fed-ad86-d44710b3276b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:0f:94', 'vm-uuid': 'd3df0d93-3eb0-4397-b64f-2e6ba95313b4'}),), if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:19 user nova-compute[75571]: INFO os_vif [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=cf1ee27c-ff8b-4fed-ad86-d44710b3276b,network=Network(058ee94c-09e6-41aa-ae25-ae736bac9074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1ee27c-ff')
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 21:17:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] No VIF found with MAC fa:16:3e:ba:0f:94, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 21:17:20 user nova-compute[75571]: DEBUG nova.network.neutron [req-035f30c7-5ad5-4a74-acec-7871c01d2150 req-1dd6542d-ddb0-45e9-a04c-6ef600bdcd8c service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updated VIF entry in instance network info cache for port cf1ee27c-ff8b-4fed-ad86-d44710b3276b. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 21:17:20 user nova-compute[75571]: DEBUG nova.network.neutron [req-035f30c7-5ad5-4a74-acec-7871c01d2150 req-1dd6542d-ddb0-45e9-a04c-6ef600bdcd8c service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updating instance_info_cache with network_info: [{"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:17:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-035f30c7-5ad5-4a74-acec-7871c01d2150 req-1dd6542d-ddb0-45e9-a04c-6ef600bdcd8c service nova] Releasing lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:17:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:21 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-d03740a6-c2cb-44af-a505-65a72dcffd24 req-eb64c68a-a76d-42ef-ba2c-13eb777ea30f service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Received event network-vif-plugged-cf1ee27c-ff8b-4fed-ad86-d44710b3276b {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d03740a6-c2cb-44af-a505-65a72dcffd24 req-eb64c68a-a76d-42ef-ba2c-13eb777ea30f service nova] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d03740a6-c2cb-44af-a505-65a72dcffd24 req-eb64c68a-a76d-42ef-ba2c-13eb777ea30f service nova] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:17:21 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-d03740a6-c2cb-44af-a505-65a72dcffd24 req-eb64c68a-a76d-42ef-ba2c-13eb777ea30f service nova] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:17:21 user nova-compute[75571]: DEBUG nova.compute.manager [req-d03740a6-c2cb-44af-a505-65a72dcffd24 req-eb64c68a-a76d-42ef-ba2c-13eb777ea30f service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] No waiting events found dispatching network-vif-plugged-cf1ee27c-ff8b-4fed-ad86-d44710b3276b {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:17:21 user nova-compute[75571]: WARNING nova.compute.manager [req-d03740a6-c2cb-44af-a505-65a72dcffd24 req-eb64c68a-a76d-42ef-ba2c-13eb777ea30f service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Received unexpected event network-vif-plugged-cf1ee27c-ff8b-4fed-ad86-d44710b3276b for instance with vm_state building and task_state spawning.
Nov 28 21:17:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:22 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-a8768a69-33aa-44b8-bbf6-d6a91891e613 req-fbf02f41-fd33-45fa-aadc-ec47637ae748 service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Received event network-vif-plugged-cf1ee27c-ff8b-4fed-ad86-d44710b3276b {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:17:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a8768a69-33aa-44b8-bbf6-d6a91891e613 req-fbf02f41-fd33-45fa-aadc-ec47637ae748 service nova] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:17:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a8768a69-33aa-44b8-bbf6-d6a91891e613 req-fbf02f41-fd33-45fa-aadc-ec47637ae748 service nova] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:17:23 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-a8768a69-33aa-44b8-bbf6-d6a91891e613 req-fbf02f41-fd33-45fa-aadc-ec47637ae748 service nova] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:17:23 user nova-compute[75571]: DEBUG nova.compute.manager [req-a8768a69-33aa-44b8-bbf6-d6a91891e613 req-fbf02f41-fd33-45fa-aadc-ec47637ae748 service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] No waiting events found dispatching network-vif-plugged-cf1ee27c-ff8b-4fed-ad86-d44710b3276b {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:17:23 user nova-compute[75571]: WARNING nova.compute.manager [req-a8768a69-33aa-44b8-bbf6-d6a91891e613 req-fbf02f41-fd33-45fa-aadc-ec47637ae748 service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Received unexpected event network-vif-plugged-cf1ee27c-ff8b-4fed-ad86-d44710b3276b for instance with vm_state building and task_state spawning.
Nov 28 21:17:23 user nova-compute[75571]: DEBUG nova.compute.manager [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Instance event wait completed in 0 seconds for  {{(pid=75571) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 21:17:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Guest created on hypervisor {{(pid=75571) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 21:17:23 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Instance spawned successfully.
Nov 28 21:17:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 21:17:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Found default for hw_cdrom_bus of ide {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:17:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Found default for hw_disk_bus of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:17:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Found default for hw_input_bus of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:17:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Found default for hw_pointer_model of None {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:17:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Found default for hw_video_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:17:23 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Found default for hw_vif_model of virtio {{(pid=75571) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 21:17:23 user nova-compute[75571]: INFO nova.compute.manager [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Took 6.43 seconds to spawn the instance on the hypervisor.
Nov 28 21:17:23 user nova-compute[75571]: DEBUG nova.compute.manager [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Checking state {{(pid=75571) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 21:17:24 user nova-compute[75571]: INFO nova.compute.manager [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Took 7.13 seconds to build instance.
Nov 28 21:17:24 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.287s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:17:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:17:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:41 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:17:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:17:52 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:17:52 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:17:53 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:17:53 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:17:53 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:17:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:17:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:17:53 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:17:53 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:17:53 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updating instance_info_cache with network_info: [{"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:17:53 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:17:53 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:17:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:17:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:17:56 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:17:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:17:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:17:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:17:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:17:56 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:17:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:17:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:17:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:17:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:17:56 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:17:56 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:17:56 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8869MB free_disk=24.944793701171875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:17:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:17:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:17:57 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:17:57 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:17:57 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:17:57 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing inventories for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 21:17:57 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating ProviderTree inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 21:17:57 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 21:17:57 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing aggregate associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, aggregates: None {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 21:17:57 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing trait associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 21:17:57 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:17:57 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:17:57 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:17:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:17:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:18:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:18:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:18:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:18:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:18:10 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:18:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:18:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:18:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:18:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:18:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:18:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:18:18 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:18:18 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75571) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 21:18:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:18:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:18:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:18:26 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:18:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:18:32 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:18:32 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 21:18:32 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] There are 0 instances to clean {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 21:18:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:18:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:18:41 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:18:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:18:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:18:51 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:18:53 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:18:53 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:18:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:18:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:18:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:18:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:18:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:18:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:18:55 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:18:55 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:18:55 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updating instance_info_cache with network_info: [{"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:18:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:18:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:18:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:18:56 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:18:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:18:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:18:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:18:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:18:56 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:18:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:18:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:18:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:18:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:18:56 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:18:56 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:18:56 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=24.943328857421875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:18:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:18:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:18:57 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:18:57 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:18:57 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:18:57 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:18:57 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:18:57 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:18:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:18:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:18:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:18:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:18:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:18:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:18:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:19:05 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:19:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-9376c91f-356c-4dfc-a202-21d1566638c4 req-461c0b41-b584-46ba-96e5-cdb885453f83 service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Received event network-changed-cf1ee27c-ff8b-4fed-ad86-d44710b3276b {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:19:07 user nova-compute[75571]: DEBUG nova.compute.manager [req-9376c91f-356c-4dfc-a202-21d1566638c4 req-461c0b41-b584-46ba-96e5-cdb885453f83 service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Refreshing instance network info cache due to event network-changed-cf1ee27c-ff8b-4fed-ad86-d44710b3276b. {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 21:19:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9376c91f-356c-4dfc-a202-21d1566638c4 req-461c0b41-b584-46ba-96e5-cdb885453f83 service nova] Acquiring lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:19:07 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9376c91f-356c-4dfc-a202-21d1566638c4 req-461c0b41-b584-46ba-96e5-cdb885453f83 service nova] Acquired lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:19:07 user nova-compute[75571]: DEBUG nova.network.neutron [req-9376c91f-356c-4dfc-a202-21d1566638c4 req-461c0b41-b584-46ba-96e5-cdb885453f83 service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Refreshing network info cache for port cf1ee27c-ff8b-4fed-ad86-d44710b3276b {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 21:19:08 user nova-compute[75571]: DEBUG nova.network.neutron [req-9376c91f-356c-4dfc-a202-21d1566638c4 req-461c0b41-b584-46ba-96e5-cdb885453f83 service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updated VIF entry in instance network info cache for port cf1ee27c-ff8b-4fed-ad86-d44710b3276b. {{(pid=75571) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 21:19:08 user nova-compute[75571]: DEBUG nova.network.neutron [req-9376c91f-356c-4dfc-a202-21d1566638c4 req-461c0b41-b584-46ba-96e5-cdb885453f83 service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updating instance_info_cache with network_info: [{"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:19:08 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-9376c91f-356c-4dfc-a202-21d1566638c4 req-461c0b41-b584-46ba-96e5-cdb885453f83 service nova] Releasing lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:19:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:19:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG nova.objects.instance [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'flavor' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:19:11 user nova-compute[75571]: INFO nova.compute.manager [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Attaching volume 7bda1af6-249a-4636-9103-4b3c00fda639 to /dev/vdb
Nov 28 21:19:11 user nova-compute[75571]: DEBUG os_brick.utils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f109bb-6d83-4c0d-a73d-d5b486de740d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb94f883-895c-407f-87f5-8a02a5e38105]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8edfede-d8dc-4b04-b871-676eaba53f0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ea308c-27d4-4df4-ab2e-08aa13141b79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:19:11 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 21:19:11 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b97e0a-7ca6-4ba6-9e12-f91419546793]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG os_brick.utils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:19:11 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updating existing volume attachment record: f660c925-cf91-431c-bcef-97e29fcfe57f {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 21:19:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:16 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:19:16 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Triggering sync for uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 21:19:16 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRzAOhwd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:19:18 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:19:18 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:19:18 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[77edaaf1-5431-4600-b591-bde6fe3a595d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 21:19:18 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7396ec-5274-459b-ba0e-b8710875a79f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639] added
Nov 28 21:19:18 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9d46a6-d452-4d10-926b-18fcfb29e460]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbe049e-7bb1-47c4-a15b-480b8109bc56]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PRzAOhwd {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PRzAOhwd" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5178fb-a84c-41fb-857f-aab01bc90fdf]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PRzAOhwd'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0a1018-4582-43da-85fd-827845d1ca2d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8205e5a3-fb6f-4d6b-a006-318b597df3c5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 21:19:18 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 21:19:18 user nova-compute[75571]:  {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:19:18 user nova-compute[75571]: WARNING os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 21:19:18 user nova-compute[75571]: 
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dc37ff-9a93-4c1e-9e5f-856d64b04a1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639, portal: 172.16.0.220,3260]
Nov 28 21:19:18 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639, portal: 172.16.0.220,3260] successful.
Nov 28 21:19:18 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a9f426-5f46-4949-832e-0422bc8a7534]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[450809b5-9c43-4fb9-b492-d77d6d95093d]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 (non-flash)
Nov 28 21:19:18 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 (non-flash)
Nov 28 21:19:18 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3988c7-0cd1-4614-abe2-d53c4cc6457e]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 21:19:18 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRzAOhwd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 21:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:19:19 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26666343233316137', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:19:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666343233316137', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 21:19:19 user nova-compute[75571]: DEBUG nova.objects.instance [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'flavor' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:19:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 21:19:19 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:19:19 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 21:19:19 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 21:19:19 user nova-compute[75571]:   <serial>7bda1af6-249a-4636-9103-4b3c00fda639</serial>
Nov 28 21:19:19 user nova-compute[75571]: </disk>
Nov 28 21:19:19 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 21:19:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 21:19:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 21:19:19 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] No VIF found with MAC fa:16:3e:ba:0f:94, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 21:19:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.553s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:19:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.773s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:19:20 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:19:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:19:34 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:19:34 user nova-compute[75571]: INFO nova.compute.manager [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Detaching volume 7bda1af6-249a-4636-9103-4b3c00fda639
Nov 28 21:19:34 user nova-compute[75571]: INFO nova.virt.block_device [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Attempting to driver detach volume 7bda1af6-249a-4636-9103-4b3c00fda639 from mountpoint /dev/vdb
Nov 28 21:19:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Attempting to detach device vdb from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 21:19:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 21:19:34 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:19:34 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 21:19:34 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 21:19:34 user nova-compute[75571]:   <serial>7bda1af6-249a-4636-9103-4b3c00fda639</serial>
Nov 28 21:19:34 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 21:19:34 user nova-compute[75571]: </disk>
Nov 28 21:19:34 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 21:19:34 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Successfully detached device vdb from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the persistent domain config.
Nov 28 21:19:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 21:19:34 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 21:19:34 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:19:34 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 21:19:34 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 21:19:34 user nova-compute[75571]:   <serial>7bda1af6-249a-4636-9103-4b3c00fda639</serial>
Nov 28 21:19:34 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 21:19:34 user nova-compute[75571]: </disk>
Nov 28 21:19:34 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 21:19:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 21:19:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:42 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:19:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:19:52 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:19:53 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:19:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:19:55 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 is timed out.
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:19:55 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Successfully detached device vdb from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the live domain config.
Nov 28 21:19:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRzAOhwd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:19:55 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6301324-87b7-4165-8232-018a320287f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 21:19:55 user nova-compute[75571]: No targets found.
Nov 28 21:19:55 user nova-compute[75571]: iSNS:
Nov 28 21:19:55 user nova-compute[75571]: No targets found.
Nov 28 21:19:55 user nova-compute[75571]: STATIC:
Nov 28 21:19:55 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639
Nov 28 21:19:55 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 21:19:55 user nova-compute[75571]:                 Iface Name: default
Nov 28 21:19:55 user nova-compute[75571]: FIRMWARE:
Nov 28 21:19:55 user nova-compute[75571]: No targets found.
Nov 28 21:19:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 21:19:55 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 21:19:55 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b723b4-7866-40ac-8446-8e9462112a37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1948b60-cd7e-49a4-bb21-79d1814bfd40]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 (non-flash)
Nov 28 21:19:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 (non-flash)
Nov 28 21:19:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7768156050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a18a94-d553-4d00-8a14-fd4582f5483b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb2d458-d885-4ae4-a0b1-8e4ab12b5b4e]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d19c12e-e576-414e-ade7-72631c74a931]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[69abee24-79e5-45bf-a3a7-4f47a85df626]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4cec19-b9aa-4e39-b54e-d48f6c2ea546]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c756ea-7a21-4bb3-861f-78b3542b65dd]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639, portal: 172.16.0.220,3260]
Nov 28 21:19:55 user nova-compute[75571]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639, portal: 172.16.0.220,3260] successful.
Nov 28 21:19:55 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bda1af6-249a-4636-9103-4b3c00fda639 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac0b114-d1d2-4a90-a37d-e38671aeb0e5]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] <== disconnect_volume: return (280ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updating instance_info_cache with network_info: [{"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:19:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:19:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:19:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:19:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:19:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:19:56 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:19:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:19:56 user nova-compute[75571]: DEBUG nova.objects.instance [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'flavor' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:19:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.664s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:19:56 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:19:56 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:19:56 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:19:56 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=24.941997528076172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:19:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:19:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:19:57 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:19:57 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:19:57 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:19:57 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:19:57 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:19:57 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:19:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:19:59 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:19:59 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:19:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:20:04 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:20:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:20:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:20:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:20:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:20:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:20:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:20:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:20:27 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:20:27 user nova-compute[75571]: DEBUG nova.objects.instance [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'flavor' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:20:28 user nova-compute[75571]: INFO nova.compute.manager [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Attaching volume 595acf5e-6427-43eb-ba81-ca299a7d6709 to /dev/vdb
Nov 28 21:20:28 user nova-compute[75571]: DEBUG os_brick.utils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[759deed0-3063-4fa4-ae11-8d0b716bf0c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac5d9d9-4060-4798-8935-5643b6e1d510]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2163c6-c289-4b0d-b673-31ee12d21705]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[729be0ba-7e46-4895-ab63-d5bea209f1d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:20:28 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 21:20:28 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b69d36-6e44-4b01-a7d3-c5fa789cbe54]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG os_brick.utils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:20:28 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updating existing volume attachment record: 307ac72c-bb29-4873-b015-d1e96c39225b {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 21:20:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:20:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:20:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spxMOQJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:20:35 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:20:35 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:20:35 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[71087518-9cfc-4c1a-b976-53900457e4b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 21:20:35 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bee1cc-94dc-40de-bf0e-379c57132ab4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709] added
Nov 28 21:20:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d1a307-ead3-41db-abf4-20971b0b0f59]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e757def0-f7b4-4407-97d6-3a16f6f04c9c]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v spxMOQJY {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v spxMOQJY" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b729e1d1-8c40-4a3f-bdff-6fc9b109e55f]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'spxMOQJY'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfb523e-0b0e-485a-8a89-e557fc9829cd]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c536efe-72a7-4e9e-8c5c-01c6737577e2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 21:20:35 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 21:20:35 user nova-compute[75571]:  {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:20:35 user nova-compute[75571]: WARNING os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 21:20:35 user nova-compute[75571]: 
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a681c78a-bf40-4861-8ee0-d372d2f8c8cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709, portal: 172.16.0.220,3260]
Nov 28 21:20:35 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709, portal: 172.16.0.220,3260] successful.
Nov 28 21:20:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1167734-e515-49f4-8db6-b1466dff9522]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32dae8c-1230-4bf4-9c82-b1e2a0c2b675]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 (non-flash)
Nov 28 21:20:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 (non-flash)
Nov 28 21:20:35 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ce2eb1-e0ab-4859-b14a-07ab5b221a82]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:35 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 21:20:36 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 21:20:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spxMOQJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 21:20:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:20:36 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23565633331633963', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:20:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565633331633963', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 21:20:36 user nova-compute[75571]: DEBUG nova.objects.instance [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'flavor' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:20:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 21:20:36 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:20:36 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 21:20:36 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 21:20:36 user nova-compute[75571]:   <serial>595acf5e-6427-43eb-ba81-ca299a7d6709</serial>
Nov 28 21:20:36 user nova-compute[75571]: </disk>
Nov 28 21:20:36 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 21:20:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 21:20:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 21:20:36 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] No VIF found with MAC fa:16:3e:ba:0f:94, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 21:20:36 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.822s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:20:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:20:39 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:20:39 user nova-compute[75571]: INFO nova.compute.manager [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Detaching volume 595acf5e-6427-43eb-ba81-ca299a7d6709
Nov 28 21:20:39 user nova-compute[75571]: INFO nova.virt.block_device [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Attempting to driver detach volume 595acf5e-6427-43eb-ba81-ca299a7d6709 from mountpoint /dev/vdb
Nov 28 21:20:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Attempting to detach device vdb from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 21:20:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 21:20:39 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:20:39 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 21:20:39 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 21:20:39 user nova-compute[75571]:   <serial>595acf5e-6427-43eb-ba81-ca299a7d6709</serial>
Nov 28 21:20:39 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 21:20:39 user nova-compute[75571]: </disk>
Nov 28 21:20:39 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 21:20:39 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Successfully detached device vdb from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the persistent domain config.
Nov 28 21:20:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 21:20:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 21:20:39 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:20:39 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 21:20:39 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 21:20:39 user nova-compute[75571]:   <serial>595acf5e-6427-43eb-ba81-ca299a7d6709</serial>
Nov 28 21:20:39 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 21:20:39 user nova-compute[75571]: </disk>
Nov 28 21:20:39 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 21:20:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 21:20:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:20:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:20:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:20:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:20:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:20:54 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:20:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:20:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:20:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:20:56 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:20:56 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:20:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:20:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:20:56 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:20:56 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:20:56 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updating instance_info_cache with network_info: [{"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:20:56 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:20:56 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:20:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:20:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:20:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:20:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:20:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:20:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:20:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:20:58 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:20:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:58 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:58 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:20:58 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:20:58 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9003MB free_disk=24.933197021484375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:20:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:20:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:20:59 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 is timed out.
Nov 28 21:20:59 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Successfully detached device vdb from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the live domain config.
Nov 28 21:20:59 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spxMOQJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:20:59 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:20:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58e2038-1722-4508-8e8b-a14d53f28492]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 21:20:59 user nova-compute[75571]: No targets found.
Nov 28 21:20:59 user nova-compute[75571]: iSNS:
Nov 28 21:20:59 user nova-compute[75571]: No targets found.
Nov 28 21:20:59 user nova-compute[75571]: STATIC:
Nov 28 21:20:59 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709
Nov 28 21:20:59 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 21:20:59 user nova-compute[75571]:                 Iface Name: default
Nov 28 21:20:59 user nova-compute[75571]: FIRMWARE:
Nov 28 21:20:59 user nova-compute[75571]: No targets found.
Nov 28 21:20:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 21:20:59 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 21:20:59 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeef1d64-ec60-4df1-b0a7-461ff64fff21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1757d73-43b3-47e9-9d93-e159be7f006d]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 (non-flash)
Nov 28 21:20:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 (non-flash)
Nov 28 21:20:59 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f776811df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 21:20:59 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c54fc75-d09a-4635-990a-ff0f61535ec0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46b4ab6-bb49-495b-b6ac-6370427bdfa6]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fd2b9c-69e5-4cb1-9b54-0431b41041f2]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e8ae30-0183-4885-9b21-fa183a0f11c5]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[44031671-583c-4cd6-b570-fdc5c9674377]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2b8e82-1117-4ad0-b0ca-4168cddf9679]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709, portal: 172.16.0.220,3260]
Nov 28 21:21:00 user nova-compute[75571]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709, portal: 172.16.0.220,3260] successful.
Nov 28 21:21:00 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595acf5e-6427-43eb-ba81-ca299a7d6709 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42f5dad-8d9a-48f3-ad18-af258a06425a]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] <== disconnect_volume: return (280ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG nova.objects.instance [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'flavor' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:21:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.582s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:21:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:21:06 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:21:08 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:21:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:21:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:21:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:21:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:21:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG nova.objects.instance [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'flavor' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:21:32 user nova-compute[75571]: INFO nova.compute.manager [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Attaching volume f5aaa5a2-ff3e-484f-b6e6-670e74943438 to /dev/vdb
Nov 28 21:21:32 user nova-compute[75571]: DEBUG os_brick.utils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[89846a32-af18-49f0-a8bc-d19912a64e89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[801fbfb1-2226-4bf0-b3b0-dee4251e6087]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[8702658c-9da1-4724-a3bd-40af3d432ed5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97e7de3-d86a-4fcb-8c5c-deaabfad27e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:21:32 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 21:21:32 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a72cbe-5882-436d-a62a-6a124e08965c]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG os_brick.utils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:21:32 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updating existing volume attachment record: 71f447ca-5828-4857-9311-e5f148ef9435 {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 21:21:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:21:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lOxcnyzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:21:39 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:21:39 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:21:39 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a238955-a3be-4633-8d8a-3613b70f7f0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 21:21:39 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[851f5994-e353-45e4-9c8f-59de09f95a37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438] added
Nov 28 21:21:39 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[735d0fee-b813-4e22-8dcf-f5cd02849ed0]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.048s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[283faf67-ae6a-4a0b-b1fc-e4037b559b1b]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lOxcnyzg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lOxcnyzg" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca6c3b3-57af-48e6-9443-148d3d7be5d4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lOxcnyzg'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb0cc88-6638-4d89-9a8a-8a5191479d02]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[44483c9b-3e0e-40dd-a6e0-1dc48b329879]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 21:21:39 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 21:21:39 user nova-compute[75571]:  {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:21:39 user nova-compute[75571]: WARNING os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 21:21:39 user nova-compute[75571]: 
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11f4906-ba6a-4829-9c82-f437293904e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438, portal: 172.16.0.220,3260]
Nov 28 21:21:39 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438, portal: 172.16.0.220,3260] successful.
Nov 28 21:21:39 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c227fce5-7900-449e-99d6-2a07038fd03e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3e5cac-2135-4f04-b329-07c2e57ad6cc]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 (non-flash)
Nov 28 21:21:39 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 (non-flash)
Nov 28 21:21:39 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[56efda5c-de6a-4b00-a55d-0768c2a76ad6]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lOxcnyzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 21:21:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:21:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:21:40 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23431643036353463', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:21:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431643036353463', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 21:21:40 user nova-compute[75571]: DEBUG nova.objects.instance [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'flavor' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:21:40 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 21:21:40 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:21:40 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 21:21:40 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 21:21:40 user nova-compute[75571]:   <serial>f5aaa5a2-ff3e-484f-b6e6-670e74943438</serial>
Nov 28 21:21:40 user nova-compute[75571]: </disk>
Nov 28 21:21:40 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 21:21:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 21:21:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 21:21:41 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] No VIF found with MAC fa:16:3e:ba:0f:94, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 21:21:41 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.625s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:21:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:21:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:21:44 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:21:44 user nova-compute[75571]: INFO nova.compute.manager [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Detaching volume f5aaa5a2-ff3e-484f-b6e6-670e74943438
Nov 28 21:21:44 user nova-compute[75571]: INFO nova.virt.block_device [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Attempting to driver detach volume f5aaa5a2-ff3e-484f-b6e6-670e74943438 from mountpoint /dev/vdb
Nov 28 21:21:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Attempting to detach device vdb from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 21:21:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 21:21:44 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:21:44 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 21:21:44 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 21:21:44 user nova-compute[75571]:   <serial>f5aaa5a2-ff3e-484f-b6e6-670e74943438</serial>
Nov 28 21:21:44 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 21:21:44 user nova-compute[75571]: </disk>
Nov 28 21:21:44 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 21:21:44 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Successfully detached device vdb from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the persistent domain config.
Nov 28 21:21:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 21:21:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 21:21:44 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:21:44 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 21:21:44 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 21:21:44 user nova-compute[75571]:   <serial>f5aaa5a2-ff3e-484f-b6e6-670e74943438</serial>
Nov 28 21:21:44 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 21:21:44 user nova-compute[75571]: </disk>
Nov 28 21:21:44 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 21:21:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 21:21:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:21:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:21:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:21:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:21:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:21:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:21:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:21:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:21:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:21:55 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:21:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:21:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:21:57 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:21:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:21:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:21:57 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:21:57 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:21:57 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updating instance_info_cache with network_info: [{"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:21:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:21:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:21:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:21:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:22:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:22:00 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:22:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:22:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:22:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:22:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:22:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:01 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:22:01 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:22:01 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=24.932201385498047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:22:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:22:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:22:01 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:22:01 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:22:01 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:22:01 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:22:01 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:22:01 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:22:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:22:04 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 is timed out.
Nov 28 21:22:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Successfully detached device vdb from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the live domain config.
Nov 28 21:22:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 21:22:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lOxcnyzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:22:04 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:22:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:22:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:22:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:04 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa64bce-54dc-44ad-8722-27f74d0788d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 21:22:04 user nova-compute[75571]: No targets found.
Nov 28 21:22:04 user nova-compute[75571]: iSNS:
Nov 28 21:22:04 user nova-compute[75571]: No targets found.
Nov 28 21:22:04 user nova-compute[75571]: STATIC:
Nov 28 21:22:04 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438
Nov 28 21:22:04 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 21:22:04 user nova-compute[75571]:                 Iface Name: default
Nov 28 21:22:04 user nova-compute[75571]: FIRMWARE:
Nov 28 21:22:04 user nova-compute[75571]: No targets found.
Nov 28 21:22:04 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:22:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 21:22:04 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 21:22:04 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 21:22:04 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 21:22:04 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a33526a-e4bf-46eb-9a5c-f2da1851fad8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb723281-59ce-46b2-8412-b9ea73adcbe3]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 (non-flash)
Nov 28 21:22:05 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 (non-flash)
Nov 28 21:22:05 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77681552d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6513140-83f9-4628-ab3e-187c696d7ea2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1eecbd-cbb4-48e4-a326-7136706fd74b]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3fafd4-0169-4fbc-a6de-4ae71bd936b4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[431e0435-d1ec-4779-b3fa-e2a309397123]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2601640-39f1-4493-ab6e-6b9089b5744d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfe6a58-5780-47bf-9d38-7b4a305a1509]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438, portal: 172.16.0.220,3260]
Nov 28 21:22:05 user nova-compute[75571]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438, portal: 172.16.0.220,3260] successful.
Nov 28 21:22:05 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5aaa5a2-ff3e-484f-b6e6-670e74943438 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d83186-a2bc-4b09-b86b-715765f9b313]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] <== disconnect_volume: return (279ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:22:05 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 21:22:06 user nova-compute[75571]: DEBUG nova.objects.instance [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'flavor' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:22:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.755s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:22:08 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:22:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:22:10 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:22:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:22:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:22:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:22:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:22:30 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:22:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG nova.objects.instance [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'flavor' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:22:37 user nova-compute[75571]: INFO nova.compute.manager [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Attaching volume 0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae to /dev/vdb
Nov 28 21:22:37 user nova-compute[75571]: DEBUG os_brick.utils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b5c351-e940-4143-8237-b6f8ddee417a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:51defa317cbb\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fb7877-7f9b-4c86-8620-4b21a79bd60e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b15c28-05a9-439f-af95-a99cf36f5217]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf4f92c-8cc2-4b3a-959f-f93469276273]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:37 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Running cmd (subprocess): nvme version {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 'nvme version' failed. Not Retrying. {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:22:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] nvme not present on system {{(pid=75571) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 21:22:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:38 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 21:22:38 user nova-compute[75571]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 21:22:38 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[15120930-3093-4834-90c1-4a408e52de9d]: (4, '') {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75571) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 21:22:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 21:22:38 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.lightos [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] LIGHTOS: no hostnqn found. {{(pid=75571) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 21:22:38 user nova-compute[75571]: DEBUG os_brick.utils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:51defa317cbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:22:38 user nova-compute[75571]: DEBUG nova.virt.block_device [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updating existing volume attachment record: 54953239-4f17-4268-920a-d8c05ab5ec5c {{(pid=75571) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 21:22:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:22:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Calling os-brick to attach iSCSI Volume {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEovwAqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:22:44 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:22:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:22:44 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:22:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:22:44 user nova-compute[75571]: INFO os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[add6cb32-55e5-4ad3-9c62-68abbeb3f877]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 21:22:44 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --interface default --op new {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[d194c70e-fffd-49b0-99c4-14e848f9e392]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae] added\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae] added
Nov 28 21:22:44 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[89595fea-b843-4885-b506-ed09df77a641]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b41b32-de3f-419e-886c-cfb850261c0d]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eEovwAqG {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eEovwAqG" returned: 0 in 0.020s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff9583c-e75a-49b9-b905-e6108b9dd4d3]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eEovwAqG'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1249f1c-4be2-4aa4-99a8-a04529997e77]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[78566f59-17c1-4344-852c-27368a2284e9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 21:22:44 user nova-compute[75571]:  {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:22:44 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 21:22:44 user nova-compute[75571]:  {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:22:44 user nova-compute[75571]: WARNING os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 21:22:44 user nova-compute[75571]: 
Nov 28 21:22:44 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --login {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c0ddee-9532-49e6-bf7e-eb38e2b3d3bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae, portal: 172.16.0.220,3260]
Nov 28 21:22:45 user nova-compute[75571]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae, portal: 172.16.0.220,3260] successful.
Nov 28 21:22:45 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9b0d09-4ad1-4b7b-be2f-2d2890c5a66e]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7799d4-7d33-4a0b-9f3a-bc6bf658584f]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae (non-flash)
Nov 28 21:22:45 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae (non-flash)
Nov 28 21:22:45 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Connected to 172.16.0.220:3260 {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75571) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75571) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[017f1f3a-e66a-418b-a4ca-a1b4b36ddff8]: (4, ('- - 0', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75571) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 21:22:45 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEovwAqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75571) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 21:22:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:22:46 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23234626563623630', 'path': '/dev/sdb'} {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:22:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234626563623630', 'path': '/dev/sdb'} {{(pid=75571) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 21:22:46 user nova-compute[75571]: DEBUG nova.objects.instance [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'flavor' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:22:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 21:22:46 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:22:46 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 21:22:46 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 21:22:46 user nova-compute[75571]:   <serial>0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae</serial>
Nov 28 21:22:46 user nova-compute[75571]: </disk>
Nov 28 21:22:46 user nova-compute[75571]:  {{(pid=75571) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 21:22:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] No BDM found with device name vda, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 21:22:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75571) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 21:22:46 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] No VIF found with MAC fa:16:3e:ba:0f:94, not building metadata {{(pid=75571) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 21:22:46 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.811s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:22:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:22:49 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:22:49 user nova-compute[75571]: INFO nova.compute.manager [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Detaching volume 0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae
Nov 28 21:22:49 user nova-compute[75571]: INFO nova.virt.block_device [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Attempting to driver detach volume 0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae from mountpoint /dev/vdb
Nov 28 21:22:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Attempting to detach device vdb from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the persistent domain config. {{(pid=75571) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 21:22:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 21:22:49 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:22:49 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 21:22:49 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 21:22:49 user nova-compute[75571]:   <serial>0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae</serial>
Nov 28 21:22:49 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 21:22:49 user nova-compute[75571]: </disk>
Nov 28 21:22:49 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 21:22:49 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Successfully detached device vdb from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the persistent domain config.
Nov 28 21:22:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the live domain config. {{(pid=75571) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 21:22:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.guest [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 21:22:49 user nova-compute[75571]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 21:22:49 user nova-compute[75571]:   <source dev="/dev/sdb"/>
Nov 28 21:22:49 user nova-compute[75571]:   <target dev="vdb" bus="virtio"/>
Nov 28 21:22:49 user nova-compute[75571]:   <serial>0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae</serial>
Nov 28 21:22:49 user nova-compute[75571]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 21:22:49 user nova-compute[75571]: </disk>
Nov 28 21:22:49 user nova-compute[75571]:  {{(pid=75571) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 21:22:49 user nova-compute[75571]: DEBUG nova.virt.libvirt.driver [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 21:22:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:22:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:22:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:22:56 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:22:57 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:22:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:22:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:22:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:22:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:22:57 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:22:57 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:22:57 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updating instance_info_cache with network_info: [{"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:22:57 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:22:57 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:22:57 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:22:57 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:23:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:23:00 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:23:00 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:23:00 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:23:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:23:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:23:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:23:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:23:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:23:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:23:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:23:00 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:23:00 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:23:00 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:23:00 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=24.931259155273438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:23:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:23:00 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:23:01 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:23:01 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:23:01 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:23:01 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing inventories for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 21:23:01 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating ProviderTree inventory for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 21:23:01 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Updating inventory in ProviderTree for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 21:23:01 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing aggregate associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, aggregates: None {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 21:23:01 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Refreshing trait associations for resource provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI {{(pid=75571) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 21:23:01 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:23:01 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:23:01 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:23:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:23:05 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:23:09 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 is timed out.
Nov 28 21:23:09 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Successfully detached device vdb from instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 from the live domain config.
Nov 28 21:23:09 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] calling os-brick to detach iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777810cfd0>, {'target_iqn': 'iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEovwAqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 21:23:09 user nova-compute[75571]: WARNING os_brick.initiator.connectors.base [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ca95c3-26bc-4b5f-9c64-7a9f23532954]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 21:23:09 user nova-compute[75571]: No targets found.
Nov 28 21:23:09 user nova-compute[75571]: iSNS:
Nov 28 21:23:09 user nova-compute[75571]: No targets found.
Nov 28 21:23:09 user nova-compute[75571]: STATIC:
Nov 28 21:23:09 user nova-compute[75571]: Target: iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae
Nov 28 21:23:09 user nova-compute[75571]:         Portal: 172.16.0.220:3260,-1
Nov 28 21:23:09 user nova-compute[75571]:                 Iface Name: default
Nov 28 21:23:09 user nova-compute[75571]: FIRMWARE:
Nov 28 21:23:09 user nova-compute[75571]: No targets found.
Nov 28 21:23:09 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 21:23:09 user nova-compute[75571]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 21:23:09 user nova-compute[75571]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75571) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae', 0)] {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e9d0e8-e5f7-4e44-9746-8b6c757f313a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba475e7-0050-443f-8b09-0c919bf982b6]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae (non-flash)\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae (non-flash)
Nov 28 21:23:09 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae (non-flash)
Nov 28 21:23:09 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77685077f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae'): ({'sdb'}, set())}) {{(pid=75571) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Removing single pathed devices sdb {{(pid=75571) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1aa7ad-6e43-4d65-85b1-625175ce3260]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[227c3862-240e-453b-99af-b8285523745c]: (4, ('ok\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Flushing IO for device /dev/sdb {{(pid=75571) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb48aad3-7a7a-4022-99eb-b7707ead0baf]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75571) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da5a29c-15da-4b0e-b03e-352a54773e55]: (4, ('1', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.linuxscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] SCSI volumes sdb have been removed. {{(pid=75571) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae')] {{(pid=75571) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baabff2-e571-4b34-aae0-05f93e972aeb]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:23:09 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --logout {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[b261a41c-19da-4ff9-8812-1c5a6a0cb943]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae, portal: 172.16.0.220,3260]
Nov 28 21:23:10 user nova-compute[75571]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae, portal: 172.16.0.220,3260] successful.
Nov 28 21:23:10 user nova-compute[75571]:  stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --op delete {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd4390b-d92c-443c-9256-4ed6167f37d4]: (4, ('', '')) {{(pid=86013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75571) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.base [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] <== disconnect_volume: return (275ms) None {{(pid=75571) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Disconnected iSCSI Volume {{(pid=75571) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG nova.objects.instance [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'flavor' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:23:10 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.619s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:23:11 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:23:12 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:23:15 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:23:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:23:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:23:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:23:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:23:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:23:20 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:23:22 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:23:22 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75571) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 21:23:25 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:23:30 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:23:35 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:23:38 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:23:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Cleaning up deleted instances {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 21:23:38 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] There are 0 instances to clean {{(pid=75571) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 21:23:40 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:23:44 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:23:45 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:23:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:23:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:23:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:23:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:23:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:23:50 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:23:55 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:23:57 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:23:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:23:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:23:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:23:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 21:23:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquired lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 21:23:58 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Forcefully refreshing network info cache for instance {{(pid=75571) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 21:23:58 user nova-compute[75571]: DEBUG nova.objects.instance [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lazy-loading 'info_cache' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:23:58 user nova-compute[75571]: DEBUG nova.network.neutron [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updating instance_info_cache with network_info: [{"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:23:58 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Releasing lock "refresh_cache-d3df0d93-3eb0-4397-b64f-2e6ba95313b4" {{(pid=75571) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 21:23:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updated the network info_cache for instance {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 21:23:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:23:59 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:24:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:24:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:24:01 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:24:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:24:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:24:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:24:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:24:01 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:24:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:24:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:24:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 21:24:01 user nova-compute[75571]: DEBUG oslo_concurrency.processutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 21:24:01 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:24:01 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:24:01 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9002MB free_disk=24.93035888671875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:24:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:24:01 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:24:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75571) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 21:24:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:24:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:24:02 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:24:02 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:24:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:24:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:24:04 user nova-compute[75571]: INFO nova.compute.manager [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Terminating instance
Nov 28 21:24:04 user nova-compute[75571]: DEBUG nova.compute.manager [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Start destroying the instance on the hypervisor. {{(pid=75571) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-daccde47-2c5d-4ae7-a06b-1ff961b3e6b3 req-42a794f9-3939-47d5-9cc4-5134f67301e2 service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Received event network-vif-unplugged-cf1ee27c-ff8b-4fed-ad86-d44710b3276b {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-daccde47-2c5d-4ae7-a06b-1ff961b3e6b3 req-42a794f9-3939-47d5-9cc4-5134f67301e2 service nova] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-daccde47-2c5d-4ae7-a06b-1ff961b3e6b3 req-42a794f9-3939-47d5-9cc4-5134f67301e2 service nova] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-daccde47-2c5d-4ae7-a06b-1ff961b3e6b3 req-42a794f9-3939-47d5-9cc4-5134f67301e2 service nova] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-daccde47-2c5d-4ae7-a06b-1ff961b3e6b3 req-42a794f9-3939-47d5-9cc4-5134f67301e2 service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] No waiting events found dispatching network-vif-unplugged-cf1ee27c-ff8b-4fed-ad86-d44710b3276b {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG nova.compute.manager [req-daccde47-2c5d-4ae7-a06b-1ff961b3e6b3 req-42a794f9-3939-47d5-9cc4-5134f67301e2 service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Received event network-vif-unplugged-cf1ee27c-ff8b-4fed-ad86-d44710b3276b for instance with task_state deleting. {{(pid=75571) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [-] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Instance destroyed successfully.
Nov 28 21:24:04 user nova-compute[75571]: DEBUG nova.objects.instance [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'resources' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=75571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG nova.virt.libvirt.vif [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T21:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1296229397',display_name='tempest-SnapshotDataIntegrityTests-server-1296229397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1296229397',id=53,image_ref='77b9e284-7155-4207-b748-934c25ce18d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr3/3kAGY1yrJtzwxQ2Urupv8grxWxfpF/u1TFQl48WzhWIUqRWrpW/nMgs4CzaDQ6Au+Vx71XALuNpL3LjLE6HldOZAgZsDPEKI7G/Aa9olUjPEwHARJQi/b9eCJzdcw==',key_name='tempest-keypair-1913966301',keypairs=<?>,launch_index=0,launched_at=2023-11-28T21:17:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='795b060e4d314d049bb9e866e46f6463',ramdisk_id='',reservation_id='r-kbm0wxti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77b9e284-7155-4207-b748-934c25ce18d0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1384736641',owner_user_name='tempest-SnapshotDataIntegrityTests-1384736641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T21:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a163fe0b8a7448dcb8363c1e3007bcc3',uuid=d3df0d93-3eb0-4397-b64f-2e6ba95313b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Converting VIF {"id": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "address": "fa:16:3e:ba:0f:94", "network": {"id": "058ee94c-09e6-41aa-ae25-ae736bac9074", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1115093991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "795b060e4d314d049bb9e866e46f6463", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1ee27c-ff", "ovs_interfaceid": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG nova.network.os_vif_util [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=cf1ee27c-ff8b-4fed-ad86-d44710b3276b,network=Network(058ee94c-09e6-41aa-ae25-ae736bac9074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1ee27c-ff') {{(pid=75571) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG os_vif [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=cf1ee27c-ff8b-4fed-ad86-d44710b3276b,network=Network(058ee94c-09e6-41aa-ae25-ae736bac9074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1ee27c-ff') {{(pid=75571) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf1ee27c-ff, bridge=br-int, if_exists=True) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19416a98-7857-4e2d-8863-7638340b13ec) {{(pid=75571) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:04 user nova-compute[75571]: INFO os_vif [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=cf1ee27c-ff8b-4fed-ad86-d44710b3276b,network=Network(058ee94c-09e6-41aa-ae25-ae736bac9074),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1ee27c-ff')
Nov 28 21:24:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Deleting instance files /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4_del
Nov 28 21:24:04 user nova-compute[75571]: INFO nova.virt.libvirt.driver [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Deletion of /opt/stack/data/nova/instances/d3df0d93-3eb0-4397-b64f-2e6ba95313b4_del complete
Nov 28 21:24:04 user nova-compute[75571]: INFO nova.compute.manager [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 21:24:04 user nova-compute[75571]: DEBUG oslo.service.loopingcall [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75571) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG nova.compute.manager [-] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Deallocating network for instance {{(pid=75571) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 21:24:04 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] deallocate_for_instance() {{(pid=75571) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 21:24:05 user nova-compute[75571]: DEBUG nova.network.neutron [-] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Updating instance_info_cache with network_info: [] {{(pid=75571) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 21:24:05 user nova-compute[75571]: INFO nova.compute.manager [-] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Took 0.72 seconds to deallocate network for instance.
Nov 28 21:24:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:24:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:24:05 user nova-compute[75571]: DEBUG nova.compute.manager [req-80a1ea0d-b9e4-454f-8ef7-71aa75f10ac0 req-29aa39bc-2ee6-4970-ace1-9a9314830ee8 service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Received event network-vif-deleted-cf1ee27c-ff8b-4fed-ad86-d44710b3276b {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:24:05 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:24:05 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:24:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:24:05 user nova-compute[75571]: INFO nova.scheduler.client.report [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Deleted allocations for instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4
Nov 28 21:24:05 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.933s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:24:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-720b0be3-2676-4d27-8e2b-a191decc8820 req-fe4f18ef-6232-4653-ad23-0802c901cca0 service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Received event network-vif-plugged-cf1ee27c-ff8b-4fed-ad86-d44710b3276b {{(pid=75571) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 21:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-720b0be3-2676-4d27-8e2b-a191decc8820 req-fe4f18ef-6232-4653-ad23-0802c901cca0 service nova] Acquiring lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-720b0be3-2676-4d27-8e2b-a191decc8820 req-fe4f18ef-6232-4653-ad23-0802c901cca0 service nova] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:24:06 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [req-720b0be3-2676-4d27-8e2b-a191decc8820 req-fe4f18ef-6232-4653-ad23-0802c901cca0 service nova] Lock "d3df0d93-3eb0-4397-b64f-2e6ba95313b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:24:06 user nova-compute[75571]: DEBUG nova.compute.manager [req-720b0be3-2676-4d27-8e2b-a191decc8820 req-fe4f18ef-6232-4653-ad23-0802c901cca0 service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] No waiting events found dispatching network-vif-plugged-cf1ee27c-ff8b-4fed-ad86-d44710b3276b {{(pid=75571) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 21:24:06 user nova-compute[75571]: WARNING nova.compute.manager [req-720b0be3-2676-4d27-8e2b-a191decc8820 req-fe4f18ef-6232-4653-ad23-0802c901cca0 service nova] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Received unexpected event network-vif-plugged-cf1ee27c-ff8b-4fed-ad86-d44710b3276b for instance with vm_state deleted and task_state None.
Nov 28 21:24:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:24:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:12 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:24:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:24:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:24:34 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:24:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:24:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75571) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 21:24:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:24:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75571) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 21:24:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:46 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:24:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:24:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:57 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:24:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:24:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:24:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:24:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 21:24:59 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:24:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:25:00 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:25:00 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:25:00 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:25:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:25:01 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:25:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:25:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:25:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:25:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:25:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:25:02 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:25:02 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:25:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9144MB free_disk=24.957077026367188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:25:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:25:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:25:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:25:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:25:02 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:25:02 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:25:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:25:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:25:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:25:08 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:25:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:25:13 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:25:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:25:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:25:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:25:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:25:34 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:25:39 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:25:44 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:25:48 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:25:49 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:25:54 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:25:58 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:25:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Starting heal instance info cache {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 21:25:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Rebuilding the list of instances to heal {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 21:25:58 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Didn't find any instances for network info cache update. {{(pid=75571) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 21:25:59 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:26:00 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:26:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:26:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:26:01 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:26:01 user nova-compute[75571]: DEBUG nova.compute.manager [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75571) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 21:26:02 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:26:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:26:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:26:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:26:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Auditing locally available compute resources for user (node: user) {{(pid=75571) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 21:26:02 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:26:02 user nova-compute[75571]: WARNING nova.virt.libvirt.driver [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 21:26:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Hypervisor/Node resource view: name=user free_ram=9244MB free_disk=24.949573516845703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75571) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 21:26:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 21:26:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 21:26:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 21:26:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75571) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 21:26:02 user nova-compute[75571]: DEBUG nova.compute.provider_tree [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed in ProviderTree for provider: 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 {{(pid=75571) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 21:26:02 user nova-compute[75571]: DEBUG nova.scheduler.client.report [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Inventory has not changed for provider 8c29bfe4-6f4c-483e-b64c-ec0ca018cd17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75571) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 21:26:02 user nova-compute[75571]: DEBUG nova.compute.resource_tracker [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Compute_service record updated for user:user {{(pid=75571) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 21:26:02 user nova-compute[75571]: DEBUG oslo_concurrency.lockutils [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=75571) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 21:26:04 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:26:09 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:26:09 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 21:26:14 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:26:15 user nova-compute[75571]: DEBUG oslo_service.periodic_task [None req-f6ffbab1-6f9c-40a6-b9a3-66ce58321f38 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75571) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 21:26:19 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:26:24 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 21:26:29 user nova-compute[75571]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75571) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}